Finally tried Gemma 3. Impressive all around and really happy with its vision capabilities. This is the 12b model running locally with Ollama and LibreChat. I'm getting a zippy 32 tokens/s on my M3 Max. Who else is going to the AI Engineer World's fair next week?
May 28, 2025 at 8:48 PM
Finally tried Gemma 3. Impressive all around and really happy with its vision capabilities. This is the 12b model running locally with Ollama and LibreChat. I'm getting a zippy 32 tokens/s on my M3 Max. Who else is going to the AI Engineer World's fair next week?