I created Intereval - a command-line tool designed to streamline the evaluation and comparison of Large Language Models (LLMs) available locally through Ollama.

- Interactively test prompt against multiple models.
- Test multiple prompts against the same model
github.com/avedave/inte...

A few benchmarks of running various models on my 2 x NVIDIA RTX 5060ti 16GB setup.

Results (Model, Total Duration, Response Processing)
Gemma:
- 1B (0m:4s, 212 t/s)
- 4B (0m:8s, 108 t/s)
- 12B (0m:18s, 44 t/s)
- 27B (0m:42s, 22 t/s)
DeepSeek R1 70B (7m:31s, 3.04 t/s)

7 years, -40kg (-88lbs)

Today marks a special milestone on my journey towards a healthier life!

If you are interested in learning how I did it, leave a comment. I might turn my notes into an actual PDF and share with you.

Intensive but rewarding week in Berlin! 3 events, keynote highlight of the project I'm involved in, MC-ing AI stage, leading feedback roundtables but most importantly, reconnecting with the team and the community!

I love being a host, so it was a real pleasure to be the host and MC at the AI Stage of Google I/O Connect Berlin event!

Google I/O Connect Berlin begins!!!

As I delivered a workshop on ADK + Cloud Run in Hamburg yesterday, the rest of Google decided to make Gemini 2.5 Pro and Flash Generally Available! Yay! There's also a new Gemini Flash-Lite available in preview

I had a chance to host at Google an incredible event - 4th Polish Economic and Technology Forum in Switzerland! On top of leading a panel, I also had a chance to deliver a workshop showcasing Google's AI models and tools!

Solid crowd today at the GDG Cloud Zurich!

We will see about that! 😆

If you are an individual domiciled in, or a company with a principal place of business in the European Union, make sure to check with your lawyers the Llama 4 Use Policy: www.llama.com/llama4/use-p...

TxGemma is a collection of open models designed to improve the efficiency of therapeutic development by leveraging the power of LLMs! Trained to assist throughout the entire discovery process, from identifying promising targets to helping predict clinical trial outcomes.
Learn more: bit.ly/3E14JP1

Gemini 2.5 Pro is out there and you should really try it in Google's AI Studio.
What used to be a full-weekend project can now be generated within seconds!
My prompt: "p5js (no HTML) colorful implementation of the game of life"
Worked on the first attempt :)

I had a great time hosting "Shaping the future" event and learning from the top industry experts about Legal, Tax and Regulatory Insights in New Technologies

Full house at the GDG Cloud Zurich event yesterday!

It's nice to see out-of-the box Gemma 3 27B to be leading the pack for the Polish LLM mt-bench-pl benchmark :)

I recorded a video on how to run Gemma 3 locally on a laptop, but the procedure is so simple, that an animated GIF is a better format :)

1. Download Llama: ollama.com
2. Install Llama
3. Pull Gemma 3 1B from the repository: ollama pull gemma3:1b
4. Run the model locally: ollama run gemma3:1b

Gemma 3 was announced on March 12th, at a very nice event in Paris :) I led a feedback session with the product team :)

Details:
- 1B, 4B, 12B, 27B sizes
- support for 140+ languages
- multimodal inputs
- 128k context window
- currently the best model that can run on a single GPU or TPU