Jannes Gladrow
@entropictrap.bsky.social
Researcher in Cloud Infrastructure and AI. London, UK
All the angst in genAI orgs or even Nvidia because of R1 is overblown. If you want to roll this model out to millions of users, you'd still need a ton of compute. Hyperscalers are safe.
January 25, 2025 at 12:08 AM
All the angst in genAI orgs or even Nvidia because of R1 is overblown. If you want to roll this model out to millions of users, you'd still need a ton of compute. Hyperscalers are safe.
And, from a safety perspective, the apparent ease with which deepseek caught up to OAI would only leave (massive?) restrictions on who gets to use compute as a viable strategy? 🍿 potentially ahead.
January 20, 2025 at 8:54 PM
And, from a safety perspective, the apparent ease with which deepseek caught up to OAI would only leave (massive?) restrictions on who gets to use compute as a viable strategy? 🍿 potentially ahead.
Also, r1 re-establishes the brutal ML principle that simple techniques win. GRPO is almost PPO: no MCTS or similar needed. Just guess until the end, then verify.
January 20, 2025 at 8:47 PM
Also, r1 re-establishes the brutal ML principle that simple techniques win. GRPO is almost PPO: no MCTS or similar needed. Just guess until the end, then verify.
how ironic it would be if the first people that are actually AIed away are those from fields where truth can be established in an automated fashion... #r1
January 20, 2025 at 7:42 PM
how ironic it would be if the first people that are actually AIed away are those from fields where truth can be established in an automated fashion... #r1
So I set up some recurring GPTtask using the new feature. But .. how can I stop it again?
January 19, 2025 at 3:00 PM
So I set up some recurring GPTtask using the new feature. But .. how can I stop it again?
First positive thing to note is an impeccable 5G coverage quite unlike London #vancouver
December 11, 2024 at 4:21 AM
First positive thing to note is an impeccable 5G coverage quite unlike London #vancouver
On my way to #vancouver. First time. What should I see, hear or eat?
December 10, 2024 at 8:45 AM
On my way to #vancouver. First time. What should I see, hear or eat?
Can't believe spiking was NOT considered as an offense until now.
December 9, 2024 at 12:04 AM
Can't believe spiking was NOT considered as an offense until now.
SimpleNN with a poetic touch. Is chatgpt trying to tell me sth?
December 7, 2024 at 2:05 PM
SimpleNN with a poetic touch. Is chatgpt trying to tell me sth?
The official Llama3 repo is not using flash attention? Probably just a minimal code skeleton instead of full open source.
github.com/meta-llama/l...
github.com/meta-llama/l...
December 3, 2024 at 7:16 PM
The official Llama3 repo is not using flash attention? Probably just a minimal code skeleton instead of full open source.
github.com/meta-llama/l...
github.com/meta-llama/l...
Living in London means dreading the province but simultaneously getting to terms with living in a dark mouldy shoebox forever
December 3, 2024 at 9:35 AM
Living in London means dreading the province but simultaneously getting to terms with living in a dark mouldy shoebox forever
Is there a word for the fear of accidentally clicking on a WWII YouTube video provoking the algorithm to from then on only ever show you super-secret-nazi-plan-in-WWII content?
December 1, 2024 at 8:34 PM
Is there a word for the fear of accidentally clicking on a WWII YouTube video provoking the algorithm to from then on only ever show you super-secret-nazi-plan-in-WWII content?
Advent of code seems like the right kind of activity for a day like this one
December 1, 2024 at 8:08 PM
Advent of code seems like the right kind of activity for a day like this one
Anyone seen any projections for what O1-style models will mean in terms of cost/compute?
November 24, 2024 at 11:49 AM
Anyone seen any projections for what O1-style models will mean in terms of cost/compute?
Train back from Cambridge on Wednesday got delayed indefinitely. Train to cambs this morning got cancelled, train back now is delayed.
November 22, 2024 at 4:22 PM
Train back from Cambridge on Wednesday got delayed indefinitely. Train to cambs this morning got cancelled, train back now is delayed.
Morning commute in icy England starts to feel like Christmas
November 20, 2024 at 8:46 AM
Morning commute in icy England starts to feel like Christmas
Maybe now?
November 18, 2024 at 10:23 PM
Maybe now?
August 21, 2024 at 6:46 PM
I guess it's a sign of general number inflation (aka Moore's law) that a quadrillion is now a normal number in machine learning
October 20, 2023 at 3:24 PM
I guess it's a sign of general number inflation (aka Moore's law) that a quadrillion is now a normal number in machine learning