Alexandre Ramé
@ramealexandre.bsky.social
Research Scientist at DeepMind. PhD from Sorbonne Université. Merging and aligning Gemmas.
https://alexrame.github.io/
https://alexrame.github.io/
Welcome Gemma 3, Google’s new open-weight LLM. All sizes (1B, 4B, 12B and 27B) excel on benchmarks, but the key result may be the 27B reaching 1338 on LMSYS. For this, we scaled post-training, with our novel distillation, RL and merging strategies.
Report: storage.googleapis.com/deepmind-med...
Report: storage.googleapis.com/deepmind-med...
March 12, 2025 at 9:03 AM
Welcome Gemma 3, Google’s new open-weight LLM. All sizes (1B, 4B, 12B and 27B) excel on benchmarks, but the key result may be the 27B reaching 1338 on LMSYS. For this, we scaled post-training, with our novel distillation, RL and merging strategies.
Report: storage.googleapis.com/deepmind-med...
Report: storage.googleapis.com/deepmind-med...