Matteo Tiezzi
@mtiezzi.bsky.social
PostDoc Researcher @ IIT, Continual and Lifelong Learning -> Robots, Graph Neural Networks, Sequence Processing | CoLLAs 2024 Local Chair
🏠 mtiezzi.github.io
🏠 mtiezzi.github.io
(Top) A standard MLP catastrophically forgets samples learned online when data distribution shifts
(Bottom) A Memory Head is capable to avoid forgetting thanks to its learnable key-value routing mechanism. Keys become representative of the data distribution.
proceedings.mlr.press/v274/tiezzi2...
(Bottom) A Memory Head is capable to avoid forgetting thanks to its learnable key-value routing mechanism. Keys become representative of the data distribution.
proceedings.mlr.press/v274/tiezzi2...
February 19, 2025 at 2:27 PM
(Top) A standard MLP catastrophically forgets samples learned online when data distribution shifts
(Bottom) A Memory Head is capable to avoid forgetting thanks to its learnable key-value routing mechanism. Keys become representative of the data distribution.
proceedings.mlr.press/v274/tiezzi2...
(Bottom) A Memory Head is capable to avoid forgetting thanks to its learnable key-value routing mechanism. Keys become representative of the data distribution.
proceedings.mlr.press/v274/tiezzi2...
TL;DR: in Memory Heads, neurons route their computation across a learnable key-value mechanism
⚡️ dynamic behaviour depending on their own input.
⚡ Only the units(weights) that are relevant to process the observed sample are blended ➡ parameter isolation
proceedings.mlr.press/v274/tiezzi2...
⚡️ dynamic behaviour depending on their own input.
⚡ Only the units(weights) that are relevant to process the observed sample are blended ➡ parameter isolation
proceedings.mlr.press/v274/tiezzi2...
February 19, 2025 at 2:27 PM
TL;DR: in Memory Heads, neurons route their computation across a learnable key-value mechanism
⚡️ dynamic behaviour depending on their own input.
⚡ Only the units(weights) that are relevant to process the observed sample are blended ➡ parameter isolation
proceedings.mlr.press/v274/tiezzi2...
⚡️ dynamic behaviour depending on their own input.
⚡ Only the units(weights) that are relevant to process the observed sample are blended ➡ parameter isolation
proceedings.mlr.press/v274/tiezzi2...
🐱 Learning Over Time (LOT) Spring School 📅 24-27 March 2025 | 📍 Siena, Italy
🔗 sites.google.com/unisi.it/lot...
Organizers:
Stefano Melacci, V. Lomonaco, Andrea Cossu, Alessandro Betti, @mtiezzi.bsky.social
#ContinualLearning #CL #LifelongLearning #CollectionlessAI
🔗 sites.google.com/unisi.it/lot...
Organizers:
Stefano Melacci, V. Lomonaco, Andrea Cossu, Alessandro Betti, @mtiezzi.bsky.social
#ContinualLearning #CL #LifelongLearning #CollectionlessAI
LOT Spring School
Topics
sites.google.com
December 26, 2024 at 2:39 PM
🐱 Learning Over Time (LOT) Spring School 📅 24-27 March 2025 | 📍 Siena, Italy
🔗 sites.google.com/unisi.it/lot...
Organizers:
Stefano Melacci, V. Lomonaco, Andrea Cossu, Alessandro Betti, @mtiezzi.bsky.social
#ContinualLearning #CL #LifelongLearning #CollectionlessAI
🔗 sites.google.com/unisi.it/lot...
Organizers:
Stefano Melacci, V. Lomonaco, Andrea Cossu, Alessandro Betti, @mtiezzi.bsky.social
#ContinualLearning #CL #LifelongLearning #CollectionlessAI
😸 Join the LOT Spring School with an incredible speaker lineup:
Battista Biggio, Nicolò Cesa-Bianchi, Elisa Ricci, Antonio Orvieto, Marco Gori, Tinne, Tinne Tuytelaars
🔗 sites.google.com/unisi.it/lot...
🔗 Pre-registrations are now open, secure your spot today: sites.google.com/unisi.it/lot...
Battista Biggio, Nicolò Cesa-Bianchi, Elisa Ricci, Antonio Orvieto, Marco Gori, Tinne, Tinne Tuytelaars
🔗 sites.google.com/unisi.it/lot...
🔗 Pre-registrations are now open, secure your spot today: sites.google.com/unisi.it/lot...
LOT Spring School - Registration
PRE-REGISTRATION IS REQUIRED!
Fill the form at the bottom of the page to pre-register now! Payment procedures will be activated in january 2025.
sites.google.com
December 26, 2024 at 2:39 PM
😸 Join the LOT Spring School with an incredible speaker lineup:
Battista Biggio, Nicolò Cesa-Bianchi, Elisa Ricci, Antonio Orvieto, Marco Gori, Tinne, Tinne Tuytelaars
🔗 sites.google.com/unisi.it/lot...
🔗 Pre-registrations are now open, secure your spot today: sites.google.com/unisi.it/lot...
Battista Biggio, Nicolò Cesa-Bianchi, Elisa Ricci, Antonio Orvieto, Marco Gori, Tinne, Tinne Tuytelaars
🔗 sites.google.com/unisi.it/lot...
🔗 Pre-registrations are now open, secure your spot today: sites.google.com/unisi.it/lot...
Would love to join, working in CL and I was an organizer of CoLLAs 2024!
December 18, 2024 at 1:21 PM
Would love to join, working in CL and I was an organizer of CoLLAs 2024!
May I join? Thanks
December 17, 2024 at 2:06 PM
May I join? Thanks
Entering the field, could you add me? Thanks!
December 17, 2024 at 2:06 PM
Entering the field, could you add me? Thanks!
Working in Lifelong/Continual Learning, and I was among the organisers of last CoLLAs conference! Please add me☺️
November 30, 2024 at 10:15 AM
Working in Lifelong/Continual Learning, and I was among the organisers of last CoLLAs conference! Please add me☺️