Gido van de Ven
gmvandeven.bsky.social
Gido van de Ven
@gmvandeven.bsky.social
Researcher on continual learning, taking a deep learning as well as cognitive science perspective. At the University of Groningen, the Netherlands.
Reposted by Gido van de Ven
🚨 We’re hiring! 🚨
Together with Marcus Jeschke and Emilie Mace we are looking for a PhD student to join us for developing AI tools for optogenetic sensory restauration.
Apply now: sinzlab.org/positions/20...
#PhDposition #AI #Neuroprosthetics #ML #NeuroAI #Hiring
PhD Position for Deep Learning for Optogenetic Sensory Restoration
How to apply Who to contact? ekfz@sinzlab.org Email subject Start with
sinzlab.org
May 12, 2025 at 8:37 AM
How do you compute the Fisher when using EWC?

Different ways can be found in the continual learning literature, with the most-used one making rather crude approximations.

This has bothered me (and others!) for a long time, and I finally take this on in an ICLR blogpost: arxiv.org/abs/2502.11756
On the Computation of the Fisher Information in Continual Learning
One of the most popular methods for continual learning with deep neural networks is Elastic Weight Consolidation (EWC), which involves computing the Fisher Information. The exact way in which the Fish...
arxiv.org
April 25, 2025 at 5:13 PM
Reposted by Gido van de Ven
Why has continual ML not had its breakthrough yet?

In our new collaborative paper w/ many amazing authors, we argue that “Continual Learning Should Move Beyond Incremental Classification”!

We highlight 5 examples to show where CL algos can fail & pinpoint 3 key challenges

arxiv.org/abs/2502.11927
February 18, 2025 at 1:33 PM
Does continual learning change when there is repetition in the data stream?

The report of the #CVPR2023 CLVision challenge on **Continual learning in the presence of repetition** is out in Neural Networks. #OpenAccess

www.sciencedirect.com/science/arti...
Continual learning in the presence of repetition
Continual learning (CL) provides a framework for training models in ever-evolving environments. Although re-occurrence of previously seen objects or t…
www.sciencedirect.com
December 2, 2024 at 1:02 PM
Reposted by Gido van de Ven
This is one of the most important arguments in the AI discourse, I think: With a large group of experts we explain why generalization of humans and machines works very differently. This is a fundamental points that has crucial implications for language models, as well: arxiv.org/abs/2411.15626
Aligning Generalisation Between Humans and Machines
Recent advances in AI -- including generative approaches -- have resulted in technology that can support humans in scientific discovery and decision support but may also disrupt democracies and target...
arxiv.org
November 27, 2024 at 12:46 PM
Reposted by Gido van de Ven
Is generalisation a process, an operation, or a product? 🤨

Read about the different ways generalisation is defined, parallels between humans & machines, methods & evaluation in our new paper: arxiv.org/abs/2411.15626

co-authored with many smart minds as a product of Dagstuhl 🙏🎉
November 27, 2024 at 1:30 PM