@ben300694.bsky.social
Reposted
November 10, 2025 at 10:18 AM
Reposted
It's epoch 50. Do you know whether your LLM is grokking?
In our #NeurIPS2025 paper "Less is More: Local Intrinsic Dimensions of Contextual Language Models," we study how the local intrinsic dimension (LID) of embeddings changes during training and fine-tuning.
#research
🧵1/n
In our #NeurIPS2025 paper "Less is More: Local Intrinsic Dimensions of Contextual Language Models," we study how the local intrinsic dimension (LID) of embeddings changes during training and fine-tuning.
#research
🧵1/n
November 3, 2025 at 3:32 PM
It's epoch 50. Do you know whether your LLM is grokking?
In our #NeurIPS2025 paper "Less is More: Local Intrinsic Dimensions of Contextual Language Models," we study how the local intrinsic dimension (LID) of embeddings changes during training and fine-tuning.
#research
🧵1/n
In our #NeurIPS2025 paper "Less is More: Local Intrinsic Dimensions of Contextual Language Models," we study how the local intrinsic dimension (LID) of embeddings changes during training and fine-tuning.
#research
🧵1/n