Lot's of excitement about AI agents. But at least in the short term and even the medium term, context window lengths are a limiting factor.
Gemini has 1-2 Million token context window which is essential for good agentic capabilities. All others are much smaller 1-200k
#AI #AIagents
Gemini has 1-2 Million token context window which is essential for good agentic capabilities. All others are much smaller 1-200k
#AI #AIagents
December 4, 2024 at 6:01 PM
@kevinroose.com the Attention is all You Need claim about it being inspired by Arrival is apparently being refuted over on Twitter.
December 1, 2024 at 8:00 PM
@kevinroose.com the Attention is all You Need claim about it being inspired by Arrival is apparently being refuted over on Twitter.
Evergreen post
bluesky posters defending their phronesis
November 23, 2024 at 8:28 PM
Evergreen post
I'm sure lightning never strikes twice, but here are my thoughts.
Reading instruction was a disaster and now folks are starting to see the light - it's very encouraging.
BUT, what's going on with math? It doesn't pass the sniff test with me. Looks overly complicated and confusing.
Reading instruction was a disaster and now folks are starting to see the light - it's very encouraging.
BUT, what's going on with math? It doesn't pass the sniff test with me. Looks overly complicated and confusing.
November 23, 2024 at 7:25 PM
I'm sure lightning never strikes twice, but here are my thoughts.
Reading instruction was a disaster and now folks are starting to see the light - it's very encouraging.
BUT, what's going on with math? It doesn't pass the sniff test with me. Looks overly complicated and confusing.
Reading instruction was a disaster and now folks are starting to see the light - it's very encouraging.
BUT, what's going on with math? It doesn't pass the sniff test with me. Looks overly complicated and confusing.
It's been a while since Sold a Story was released, but today I had a parent find me on LinkedIn asking me advice about their 4 year old. It happens regularly.
November 13, 2024 at 2:46 AM
It's been a while since Sold a Story was released, but today I had a parent find me on LinkedIn asking me advice about their 4 year old. It happens regularly.
Since Lime Scootering Company or whatever they're called didn't respond to me, maybe they're lurking here on Bluesky? Pick up your abandoned scooting machine, it's been in Manhattan for days.
May 21, 2023 at 1:32 AM
Since Lime Scootering Company or whatever they're called didn't respond to me, maybe they're lurking here on Bluesky? Pick up your abandoned scooting machine, it's been in Manhattan for days.
Anyone used Google's MusicLM? I've been playing around with it the last few days and I gotta say it's weird. You get very interesting sounds from non-music based language prompts. Describing a very abstract scene gets you truly bazaar experimental music as a result.
May 19, 2023 at 9:05 PM
Anyone used Google's MusicLM? I've been playing around with it the last few days and I gotta say it's weird. You get very interesting sounds from non-music based language prompts. Describing a very abstract scene gets you truly bazaar experimental music as a result.