Soham De
@soham-de.bsky.social
Research Scientist at Google DeepMind
Our new paper sheds light on the process of knowledge acquisition in language models, with practical implications for:
- data curricula
- the challenges of learning new knowledge when fine-tuning
- the emergence of hallucinations.
Nicolas did a great job on the project! See his thread below!
- data curricula
- the challenges of learning new knowledge when fine-tuning
- the emergence of hallucinations.
Nicolas did a great job on the project! See his thread below!
Large language models store vast amounts of knowledge, but how exactly do they learn it?
Excited to share my Google DeepMind internship results, which reveal the fascinating dynamics behind factual knowledge acquisition in LLMs!
Excited to share my Google DeepMind internship results, which reveal the fascinating dynamics behind factual knowledge acquisition in LLMs!
April 3, 2025 at 12:29 PM
Our new paper sheds light on the process of knowledge acquisition in language models, with practical implications for:
- data curricula
- the challenges of learning new knowledge when fine-tuning
- the emergence of hallucinations.
Nicolas did a great job on the project! See his thread below!
- data curricula
- the challenges of learning new knowledge when fine-tuning
- the emergence of hallucinations.
Nicolas did a great job on the project! See his thread below!