Seminars & Colloquia Calendar

Download as iCal file

Mathematical Physics Seminar

Dense Associative Memories and Deep Learning

Dmitry Krotov - Institute for Advanced Study 

Location:  Hill 705
Date & time: Thursday, 25 January 2018 at 12:00PM - 1:00PM


Abstract:  Dense Associative Memories are generalizations of Hopfield nets to higher order (higher than quadratic) interactions between the spins/neurons. I will describe a relationship between these models and neural networks commonly used in deep learning.  From the perspective of associative memory such models deserve attention because they make it possible to store a much larger number of memories, compared to the quadratic case. From the perspective of deep learning these models make it possible to control the kind of representation that the neural networks learn form a given dataset: small powers of the interaction vertex correspond to feature-based representations, large powers - to prototypes. These Dense Associative Memories can be driven by images processed with convolutional neural networks generally used in image analysis. I will discuss the potential for using this idea to mitigate the problem of adversarial images (very small changes to an input image which lead to a gross misclassification) in computer vision. 

Special Note to All Travelers

Directions: map and driving directions. If you need information on public transportation, you may want to check the New Jersey Transit page.

Unfortunately, cancellations do occur from time to time. Feel free to call our department: 848-445-6969 before embarking on your journey. Thank you.