Dmitry Krotov
@krotov.bsky.social
I am a physicist working on neural networks (both artificial and biological). Find me on https://research.ibm.com/people/dmitry-krotov
I am very excited about our new paper just published in PNAS.
www.pnas.org/doi/abs/10.1...
It was a pleasure to work on this idea together with @leokoz8.bsky.social and Jean-Jacques Slotine.
www.pnas.org/doi/abs/10.1...
It was a pleasure to work on this idea together with @leokoz8.bsky.social and Jean-Jacques Slotine.
May 29, 2025 at 6:12 PM
I am very excited about our new paper just published in PNAS.
www.pnas.org/doi/abs/10.1...
It was a pleasure to work on this idea together with @leokoz8.bsky.social and Jean-Jacques Slotine.
www.pnas.org/doi/abs/10.1...
It was a pleasure to work on this idea together with @leokoz8.bsky.social and Jean-Jacques Slotine.
Reposted by Dmitry Krotov
Big week for astrocyte research: 3 new Science papers link astrocytes to behavior. We're excited to add to the momentum with our new PNAS paper: a theory, grounded in biology, proposing astrocytes as key players in memory storage and recall. w/ JJ Slotine and @krotov.bsky.social
(1/6)
(1/6)
May 28, 2025 at 7:44 PM
Big week for astrocyte research: 3 new Science papers link astrocytes to behavior. We're excited to add to the momentum with our new PNAS paper: a theory, grounded in biology, proposing astrocytes as key players in memory storage and recall. w/ JJ Slotine and @krotov.bsky.social
(1/6)
(1/6)
John Hopfield on pursuing interesting things: “Doesn’t matter what they are - interesting is the important one”. www.youtube.com/watch?v=iYgs...
John J. Hopfield, Nobel Prize in Physics 2024: Official interview
YouTube video by Nobel Prize
www.youtube.com
April 25, 2025 at 12:22 AM
John Hopfield on pursuing interesting things: “Doesn’t matter what they are - interesting is the important one”. www.youtube.com/watch?v=iYgs...
I am heading to #ICLR2025 in Singapore. If you want to chat about associative memories, energy-based models, and related topics let’s connect! The highlight for me this year is the New Frontiers in Associative Memories workshop on Sunday April 27. Here is the schedule ⬇️
April 23, 2025 at 3:47 AM
I am heading to #ICLR2025 in Singapore. If you want to chat about associative memories, energy-based models, and related topics let’s connect! The highlight for me this year is the New Frontiers in Associative Memories workshop on Sunday April 27. Here is the schedule ⬇️
Reposted by Dmitry Krotov
New ms! www.biorxiv.org/content/10.1...
I developed a normative coding theory for feedback-modulated canonical networks, providing a unified view of (1) efficient & predictive coding, (2) computational & algorithmic principles, (3) unimodal & multimodal sensory processing.
I developed a normative coding theory for feedback-modulated canonical networks, providing a unified view of (1) efficient & predictive coding, (2) computational & algorithmic principles, (3) unimodal & multimodal sensory processing.
Convergence of efficient and predictive coding in multimodal sensory processing
The existence of pathways connecting different sensory modalities in the brain challenges the traditional view of sensory systems as operating independently. However, the reasons and mechanisms underl...
www.biorxiv.org
March 16, 2025 at 5:35 PM
New ms! www.biorxiv.org/content/10.1...
I developed a normative coding theory for feedback-modulated canonical networks, providing a unified view of (1) efficient & predictive coding, (2) computational & algorithmic principles, (3) unimodal & multimodal sensory processing.
I developed a normative coding theory for feedback-modulated canonical networks, providing a unified view of (1) efficient & predictive coding, (2) computational & algorithmic principles, (3) unimodal & multimodal sensory processing.
Now that ICML papers are submitted and we are in the midst of discussions on whether scaling is enough or new architectural/algorithmic ideas are needed, what can be a better time to submit your best work to our workshop on New Frontiers in Associative Memory @iclr-conf.bsky.social?
January 31, 2025 at 2:40 PM
Now that ICML papers are submitted and we are in the midst of discussions on whether scaling is enough or new architectural/algorithmic ideas are needed, what can be a better time to submit your best work to our workshop on New Frontiers in Associative Memory @iclr-conf.bsky.social?
Reposted by Dmitry Krotov
I am very honored to return to my alma mater to give a distinguished lecture on AI for Science at Rice University's Ken Kennedy Institute.
events.rice.edu/event/spring...
events.rice.edu/event/spring...
January 14, 2025 at 10:37 PM
I am very honored to return to my alma mater to give a distinguished lecture on AI for Science at Rice University's Ken Kennedy Institute.
events.rice.edu/event/spring...
events.rice.edu/event/spring...
I am excited to announce the call for papers for the New Frontiers in Associative Memories workshop at ICLR 2025. New architectures and algorithms, memory-augmented LLMs, energy-based models, Hopfield nets, AM and diffusion, and many other topics.
Website: nfam.vizhub.ai
@iclr-conf.bsky.social
Website: nfam.vizhub.ai
@iclr-conf.bsky.social
January 14, 2025 at 4:56 PM
I am excited to announce the call for papers for the New Frontiers in Associative Memories workshop at ICLR 2025. New architectures and algorithms, memory-augmented LLMs, energy-based models, Hopfield nets, AM and diffusion, and many other topics.
Website: nfam.vizhub.ai
@iclr-conf.bsky.social
Website: nfam.vizhub.ai
@iclr-conf.bsky.social
Wow, what a night! A heartfelt congratulations to my dear friend and collaborator John Hopfield and all the 2024 Laureates. #NobelPrize
December 11, 2024 at 6:33 PM
Wow, what a night! A heartfelt congratulations to my dear friend and collaborator John Hopfield and all the 2024 Laureates. #NobelPrize
What a wonderful day of Nobel lectures and inspiring conversations at the beautiful Aula Magna, Stockholm University! #NobelPrize
December 9, 2024 at 1:35 PM
What a wonderful day of Nobel lectures and inspiring conversations at the beautiful Aula Magna, Stockholm University! #NobelPrize
Physics is a point of view. Wise words from John Hopfield’s Nobel lecture. #NobelPrize
December 8, 2024 at 1:13 PM
Physics is a point of view. Wise words from John Hopfield’s Nobel lecture. #NobelPrize
Most of the work on Dense Associative Memory (DenseAM) thus far has focused on the regime when the amount of data (number of memories) is below the critical memory storage capacity. We are beginning to explore the opposite limit, when the data is large.
Diffusion models create beautiful novel images, but they can also memorize samples from the training set. How does this blending of features allow creating novel patterns? Our new work in Sci4DL workshop #neurips2024 shows that diffusion models behave like Dense Associative Memory networks.
December 5, 2024 at 6:19 PM
Most of the work on Dense Associative Memory (DenseAM) thus far has focused on the regime when the amount of data (number of memories) is below the critical memory storage capacity. We are beginning to explore the opposite limit, when the data is large.
Check out our new #NeurIPS2024 paper, where we develop a distributed representation for a broad class of Dense Associative Memories. Similarly to the traditional Hopfield Network, the number of weights can be kept fixed and independent of the number of memories when new patterns are introduced.
Excited to share "Dense Associative Memory through the Lens of Random Features" accepted to #neurips2024🎉
DenseAMs need new weights for each stored pattern–hurting scalability. Kernel methods let us add memories without adding weights!
Distributed memory for DenseAMs, unlocked🔓
DenseAMs need new weights for each stored pattern–hurting scalability. Kernel methods let us add memories without adding weights!
Distributed memory for DenseAMs, unlocked🔓
December 3, 2024 at 4:51 PM
Check out our new #NeurIPS2024 paper, where we develop a distributed representation for a broad class of Dense Associative Memories. Similarly to the traditional Hopfield Network, the number of weights can be kept fixed and independent of the number of memories when new patterns are introduced.
Hello World! Is this the right place? 🙃
November 24, 2024 at 10:17 PM
Hello World! Is this the right place? 🙃