Chad Peltier
@cgpeltier.bsky.social
Data scientist / MLE @ Janes | NLP, IR, + knowledge graphs
Pour one out for David Lynch
a man in a suit and tie holds a cup of coffee in front of a red curtain
ALT: a man in a suit and tie holds a cup of coffee in front of a red curtain
media.tenor.com
January 16, 2025 at 9:08 PM
Pour one out for David Lynch
ModernBERT future directions I’m esp excited about —
1. Multi-vector retrieval (ie ColBERT)
2. New version of ModernBERT trained with a combo MLM and RTD objectives for classification
1. Multi-vector retrieval (ie ColBERT)
2. New version of ModernBERT trained with a combo MLM and RTD objectives for classification
December 26, 2024 at 4:37 PM
ModernBERT future directions I’m esp excited about —
1. Multi-vector retrieval (ie ColBERT)
2. New version of ModernBERT trained with a combo MLM and RTD objectives for classification
1. Multi-vector retrieval (ie ColBERT)
2. New version of ModernBERT trained with a combo MLM and RTD objectives for classification
ModernBERT and GLiNER (and to a maybe lesser extent, GraphRAG) are definitely the advances I expect to build with the most in 2025
Hot take: shipping BERT-sized models in 2025 will benefit far more people than sharing an LLM overfitted to some saturated leaderboards 🙊
We're already seeing ModernBERT finetunes on the @hf.co Hub. My guess is we'll see hundreds of these by the end of 2025.
We're already seeing ModernBERT finetunes on the @hf.co Hub. My guess is we'll see hundreds of these by the end of 2025.
December 21, 2024 at 2:39 PM
ModernBERT and GLiNER (and to a maybe lesser extent, GraphRAG) are definitely the advances I expect to build with the most in 2025