Research in information retrieval and conversational search: Towards Language models that know what they know 🧠
Homepage : victormorand.github.io
Our method enables reconstruction of entity mentions from any representation within LLMs, allowing to ask: “What entity is the model thinking about right now?”
💡 When reading ‘the City of Lights iconic monument’, the model internally “thinks” of Paris and the Eiffel Tower !
Our method enables reconstruction of entity mentions from any representation within LLMs, allowing to ask: “What entity is the model thinking about right now?”
💡 When reading ‘the City of Lights iconic monument’, the model internally “thinks” of Paris and the Eiffel Tower !
⚛️ Entities are the fundamental building blocks of knowledge. Although some clues emerge from mechanistic interpretability, how auto-regressive LLMs actually encode and retrieve them remains a mystery. 🧵
📄 arxiv.org/abs/2510.09421
⚛️ Entities are the fundamental building blocks of knowledge. Although some clues emerge from mechanistic interpretability, how auto-regressive LLMs actually encode and retrieve them remains a mystery. 🧵
📄 arxiv.org/abs/2510.09421