hardmaru
@hardmaru.bsky.social
Reposted by hardmaru
「How Competition is Stifling AI Breakthroughs」
Sakana AI共同創業者 Llion Jones のTED AIトークが公開されました。目標を定めすぎないオープンエンドな研究がブレークスルーを生む理由、Transformerの成功が業界にもたらした状況、それを乗り越える次の構想と成果を語りました。
www.ted.com/talks/llion_...
Sakana AI共同創業者 Llion Jones のTED AIトークが公開されました。目標を定めすぎないオープンエンドな研究がブレークスルーを生む理由、Transformerの成功が業界にもたらした状況、それを乗り越える次の構想と成果を語りました。
www.ted.com/talks/llion_...
How competition is stifling AI breakthroughs
Llion Jones cowrote "Attention Is All You Need," the seminal paper that introduced the transformer — the architecture that launched the generative AI revolution. Now he warns that the industry that gr...
www.ted.com
January 29, 2026 at 2:39 AM
「How Competition is Stifling AI Breakthroughs」
Sakana AI共同創業者 Llion Jones のTED AIトークが公開されました。目標を定めすぎないオープンエンドな研究がブレークスルーを生む理由、Transformerの成功が業界にもたらした状況、それを乗り越える次の構想と成果を語りました。
www.ted.com/talks/llion_...
Sakana AI共同創業者 Llion Jones のTED AIトークが公開されました。目標を定めすぎないオープンエンドな研究がブレークスルーを生む理由、Transformerの成功が業界にもたらした状況、それを乗り越える次の構想と成果を語りました。
www.ted.com/talks/llion_...
Our journey at Sakana AI is just getting started.
We are looking for people to help us pioneer the next generation of AI—building from Japan to the world.
Join us: sakana.ai/careers
We are looking for people to help us pioneer the next generation of AI—building from Japan to the world.
Join us: sakana.ai/careers
January 25, 2026 at 4:56 AM
Our journey at Sakana AI is just getting started.
We are looking for people to help us pioneer the next generation of AI—building from Japan to the world.
Join us: sakana.ai/careers
We are looking for people to help us pioneer the next generation of AI—building from Japan to the world.
Join us: sakana.ai/careers
I founded Sakana AI after my time at Google, so it is incredibly meaningful to be able to partner with them now. It feels like a special connection to be working together again to advance the AI ecosystem in Japan.
sakana.ai/google#en
sakana.ai/google#en
We are thrilled to announce a strategic partnership with Google!
Google is also making a financial investment in Sakana AI to strengthen this collaboration. We are combining Google’s world-class products like Gemini and Gemma with our agile R&D to accelerate automated scientific discovery.
Google is also making a financial investment in Sakana AI to strengthen this collaboration. We are combining Google’s world-class products like Gemini and Gemma with our agile R&D to accelerate automated scientific discovery.
January 23, 2026 at 1:04 PM
I founded Sakana AI after my time at Google, so it is incredibly meaningful to be able to partner with them now. It feels like a special connection to be working together again to advance the AI ecosystem in Japan.
sakana.ai/google#en
sakana.ai/google#en
Reposted by hardmaru
Our work on The AI Scientist and ALE-Agent has already shown the power of these models.
Now, we are scaling reliable AI in mission-critical sectors like finance and government to ensure the highest security and data sovereignty.
Full details: sakana.ai/google#en
Now, we are scaling reliable AI in mission-critical sectors like finance and government to ensure the highest security and data sovereignty.
Full details: sakana.ai/google#en
Sakana AI
Sakana AI、Googleとの戦略的パートナーシップ締結を発表
sakana.ai
January 23, 2026 at 1:02 PM
Our work on The AI Scientist and ALE-Agent has already shown the power of these models.
Now, we are scaling reliable AI in mission-critical sectors like finance and government to ensure the highest security and data sovereignty.
Full details: sakana.ai/google#en
Now, we are scaling reliable AI in mission-critical sectors like finance and government to ensure the highest security and data sovereignty.
Full details: sakana.ai/google#en
Reposted by hardmaru
We are thrilled to announce a strategic partnership with Google!
Google is also making a financial investment in Sakana AI to strengthen this collaboration. We are combining Google’s world-class products like Gemini and Gemma with our agile R&D to accelerate automated scientific discovery.
Google is also making a financial investment in Sakana AI to strengthen this collaboration. We are combining Google’s world-class products like Gemini and Gemma with our agile R&D to accelerate automated scientific discovery.
January 23, 2026 at 1:02 PM
We are thrilled to announce a strategic partnership with Google!
Google is also making a financial investment in Sakana AI to strengthen this collaboration. We are combining Google’s world-class products like Gemini and Gemma with our agile R&D to accelerate automated scientific discovery.
Google is also making a financial investment in Sakana AI to strengthen this collaboration. We are combining Google’s world-class products like Gemini and Gemma with our agile R&D to accelerate automated scientific discovery.
Reposted by hardmaru
We just published an unofficial guide on what we look for when interviewing research candidates at Sakana AI.
Written by Stefania Druga, Luke Darlow, and Llion Jones.
The biggest differentiator? Understanding over implementation.
Read it: pub.sakana.ai/Unofficial_G...
Written by Stefania Druga, Luke Darlow, and Llion Jones.
The biggest differentiator? Understanding over implementation.
Read it: pub.sakana.ai/Unofficial_G...
January 20, 2026 at 1:40 AM
We just published an unofficial guide on what we look for when interviewing research candidates at Sakana AI.
Written by Stefania Druga, Luke Darlow, and Llion Jones.
The biggest differentiator? Understanding over implementation.
Read it: pub.sakana.ai/Unofficial_G...
Written by Stefania Druga, Luke Darlow, and Llion Jones.
The biggest differentiator? Understanding over implementation.
Read it: pub.sakana.ai/Unofficial_G...
Reposted by hardmaru
RePo moves us toward models that intelligently curate their own working memory rather than passively accepting input order.
Read the full breakdown on our website:
pub.sakana.ai/repo/
Paper: arxiv.org/abs/2512.14391
Read the full breakdown on our website:
pub.sakana.ai/repo/
Paper: arxiv.org/abs/2512.14391
RePo: Language Models with Context Re-Positioning
In-context learning is fundamental to modern Large Language Models (LLMs); however, prevailing architectures impose a rigid and fixed contextual structure by assigning linear or constant positional in...
arxiv.org
January 19, 2026 at 12:40 AM
RePo moves us toward models that intelligently curate their own working memory rather than passively accepting input order.
Read the full breakdown on our website:
pub.sakana.ai/repo/
Paper: arxiv.org/abs/2512.14391
Read the full breakdown on our website:
pub.sakana.ai/repo/
Paper: arxiv.org/abs/2512.14391
Reposted by hardmaru
Introducing RePo: Language Models with Context Re-Positioning
Standard LLMs force a rigid linear structure on context, treating physical proximity as relevance. Cognitive Load Theory suggests this is inefficient—models waste capacity managing noise instead of reasoning.
arxiv.org/abs/2512.14391
Standard LLMs force a rigid linear structure on context, treating physical proximity as relevance. Cognitive Load Theory suggests this is inefficient—models waste capacity managing noise instead of reasoning.
arxiv.org/abs/2512.14391
January 19, 2026 at 12:39 AM
Introducing RePo: Language Models with Context Re-Positioning
Standard LLMs force a rigid linear structure on context, treating physical proximity as relevance. Cognitive Load Theory suggests this is inefficient—models waste capacity managing noise instead of reasoning.
arxiv.org/abs/2512.14391
Standard LLMs force a rigid linear structure on context, treating physical proximity as relevance. Cognitive Load Theory suggests this is inefficient—models waste capacity managing noise instead of reasoning.
arxiv.org/abs/2512.14391
Reposted by hardmaru
January 14, 2026 at 1:23 PM
Reposted by hardmaru
AI導入は「雇用不安小さい正社員制度が強みに」
日経ビジネスにて、Sakana AI CEO @hardmaru.bsky.social
のインタビューが公開されました。企業へのAI実装が本格化する2026年における現状と課題、そして日本企業の組織文化がAI導入にとってポジティブに働く可能性について語りました。
business.nikkei.com/atcl/gen/19/...
【記事のハイライト】🧵
日経ビジネスにて、Sakana AI CEO @hardmaru.bsky.social
のインタビューが公開されました。企業へのAI実装が本格化する2026年における現状と課題、そして日本企業の組織文化がAI導入にとってポジティブに働く可能性について語りました。
business.nikkei.com/atcl/gen/19/...
【記事のハイライト】🧵
サカナAIのデビッド・ハCEO、AI導入は「雇用不安小さい正社員制度が強みに」
AIファーストを掲げる企業が増加する中、経営者はAIのリスクを正しく理解し、適切に導入を進める必要がある。国内最大級のユニコーンで、企業向けのAIソリューション開発を行うSakana AI（サカナAI、東京・港）のデビッド・ハ最高経営責任者（CEO）に、日本企業のAI導入における課題を聞いた。
business.nikkei.com
January 13, 2026 at 8:46 AM
AI導入は「雇用不安小さい正社員制度が強みに」
日経ビジネスにて、Sakana AI CEO @hardmaru.bsky.social
のインタビューが公開されました。企業へのAI実装が本格化する2026年における現状と課題、そして日本企業の組織文化がAI導入にとってポジティブに働く可能性について語りました。
business.nikkei.com/atcl/gen/19/...
【記事のハイライト】🧵
日経ビジネスにて、Sakana AI CEO @hardmaru.bsky.social
のインタビューが公開されました。企業へのAI実装が本格化する2026年における現状と課題、そして日本企業の組織文化がAI導入にとってポジティブに働く可能性について語りました。
business.nikkei.com/atcl/gen/19/...
【記事のハイライト】🧵
Reposted by hardmaru
Introducing DroPE: Extending Context by Dropping Positional Embeddings
We found embeddings like RoPE aid training but bottleneck long-sequence generalization. Our solution’s simple: treat them as a temporary training scaffold, not a permanent necessity.
arxiv.org/abs/2512.12167
pub.sakana.ai/DroPE
We found embeddings like RoPE aid training but bottleneck long-sequence generalization. Our solution’s simple: treat them as a temporary training scaffold, not a permanent necessity.
arxiv.org/abs/2512.12167
pub.sakana.ai/DroPE
January 12, 2026 at 4:07 AM
Introducing DroPE: Extending Context by Dropping Positional Embeddings
We found embeddings like RoPE aid training but bottleneck long-sequence generalization. Our solution’s simple: treat them as a temporary training scaffold, not a permanent necessity.
arxiv.org/abs/2512.12167
pub.sakana.ai/DroPE
We found embeddings like RoPE aid training but bottleneck long-sequence generalization. Our solution’s simple: treat them as a temporary training scaffold, not a permanent necessity.
arxiv.org/abs/2512.12167
pub.sakana.ai/DroPE
One of my favorite findings: Positional embeddings are just training wheels. They help convergence but hurt long-context generalization.
We found that if you simply delete them after pretraining and recalibrate for <1% of the original budget, you unlock massive context windows. Smarter, not harder.
We found that if you simply delete them after pretraining and recalibrate for <1% of the original budget, you unlock massive context windows. Smarter, not harder.
Introducing DroPE: Extending Context by Dropping Positional Embeddings
We found embeddings like RoPE aid training but bottleneck long-sequence generalization. Our solution’s simple: treat them as a temporary training scaffold, not a permanent necessity.
arxiv.org/abs/2512.12167
pub.sakana.ai/DroPE
We found embeddings like RoPE aid training but bottleneck long-sequence generalization. Our solution’s simple: treat them as a temporary training scaffold, not a permanent necessity.
arxiv.org/abs/2512.12167
pub.sakana.ai/DroPE
January 12, 2026 at 4:12 AM
One of my favorite findings: Positional embeddings are just training wheels. They help convergence but hurt long-context generalization.
We found that if you simply delete them after pretraining and recalibrate for <1% of the original budget, you unlock massive context windows. Smarter, not harder.
We found that if you simply delete them after pretraining and recalibrate for <1% of the original budget, you unlock massive context windows. Smarter, not harder.
Reposted by hardmaru
We are taking our technology far beyond competitive programming to unlock a new era of AI-driven discovery.
We are hiring. Join our team in Tokyo.
sakana.ai/careers/#sof...
We are hiring. Join our team in Tokyo.
sakana.ai/careers/#sof...
January 10, 2026 at 3:07 AM
We are taking our technology far beyond competitive programming to unlock a new era of AI-driven discovery.
We are hiring. Join our team in Tokyo.
sakana.ai/careers/#sof...
We are hiring. Join our team in Tokyo.
sakana.ai/careers/#sof...
We are taking our technology far beyond competitive programming to unlock a new era of AI-driven discovery.
We are hiring. Join our team in Tokyo.
sakana.ai/careers/#sof...
We are hiring. Join our team in Tokyo.
sakana.ai/careers/#sof...
January 10, 2026 at 3:08 AM
When agents compete for limited resources, intelligence reorganizes around survival, not elegance.
January 9, 2026 at 9:26 AM
When agents compete for limited resources, intelligence reorganizes around survival, not elegance.
Survival of the fittest code!
Our paper explores LLMs driving an evolutionary arms race in Core War, where assembly programs fight each other. We task LLMs with evolving "Warriors" in a virtual machine, producing chaotic, self-modifying code dynamics.
Blog: sakana.ai/drq
Paper: pub.sakana.ai/drq/
Our paper explores LLMs driving an evolutionary arms race in Core War, where assembly programs fight each other. We task LLMs with evolving "Warriors" in a virtual machine, producing chaotic, self-modifying code dynamics.
Blog: sakana.ai/drq
Paper: pub.sakana.ai/drq/
Introducing Digital Red Queen (DRQ): Adversarial Program Evolution in Core War with LLMs.
In this work, we explore how LLMs can drive open-ended adversarial evolution of programs within the Core War environment.
Blog sakana.ai/drq
Website pub.sakana.ai/drq/
ArXiv arxiv.org/abs/2601.03335
Thread:
In this work, we explore how LLMs can drive open-ended adversarial evolution of programs within the Core War environment.
Blog sakana.ai/drq
Website pub.sakana.ai/drq/
ArXiv arxiv.org/abs/2601.03335
Thread:
January 8, 2026 at 5:11 PM
Survival of the fittest code!
Our paper explores LLMs driving an evolutionary arms race in Core War, where assembly programs fight each other. We task LLMs with evolving "Warriors" in a virtual machine, producing chaotic, self-modifying code dynamics.
Blog: sakana.ai/drq
Paper: pub.sakana.ai/drq/
Our paper explores LLMs driving an evolutionary arms race in Core War, where assembly programs fight each other. We task LLMs with evolving "Warriors" in a virtual machine, producing chaotic, self-modifying code dynamics.
Blog: sakana.ai/drq
Paper: pub.sakana.ai/drq/
Reposted by hardmaru
Introducing Digital Red Queen (DRQ): Adversarial Program Evolution in Core War with LLMs.
In this work, we explore how LLMs can drive open-ended adversarial evolution of programs within the Core War environment.
Blog sakana.ai/drq
Website pub.sakana.ai/drq/
ArXiv arxiv.org/abs/2601.03335
Thread:
In this work, we explore how LLMs can drive open-ended adversarial evolution of programs within the Core War environment.
Blog sakana.ai/drq
Website pub.sakana.ai/drq/
ArXiv arxiv.org/abs/2601.03335
Thread:
January 8, 2026 at 5:00 PM
Introducing Digital Red Queen (DRQ): Adversarial Program Evolution in Core War with LLMs.
In this work, we explore how LLMs can drive open-ended adversarial evolution of programs within the Core War environment.
Blog sakana.ai/drq
Website pub.sakana.ai/drq/
ArXiv arxiv.org/abs/2601.03335
Thread:
In this work, we explore how LLMs can drive open-ended adversarial evolution of programs within the Core War environment.
Blog sakana.ai/drq
Website pub.sakana.ai/drq/
ArXiv arxiv.org/abs/2601.03335
Thread:
So proud of Team Sakana AI for pulling this off! We managed to get an agent to rank #1 in a difficult heuristic optimization contest. We leaned heavily into test-time inference using a mix of frontier models.
The agent spent $1,300 to autonomously discover an algorithm that beat the human baseline.
The agent spent $1,300 to autonomously discover an algorithm that beat the human baseline.
Our AI agent has achieved 1st place in a competitive optimization programming contest against over 800 human participants.
Blog: sakana.ai/ahc058
Thread:
Blog: sakana.ai/ahc058
Thread:
January 5, 2026 at 4:01 PM
So proud of Team Sakana AI for pulling this off! We managed to get an agent to rank #1 in a difficult heuristic optimization contest. We leaned heavily into test-time inference using a mix of frontier models.
The agent spent $1,300 to autonomously discover an algorithm that beat the human baseline.
The agent spent $1,300 to autonomously discover an algorithm that beat the human baseline.
Reposted by hardmaru
Our AI agent has achieved 1st place in a competitive optimization programming contest against over 800 human participants.
Blog: sakana.ai/ahc058
Thread:
Blog: sakana.ai/ahc058
Thread:
January 5, 2026 at 3:53 PM
Our AI agent has achieved 1st place in a competitive optimization programming contest against over 800 human participants.
Blog: sakana.ai/ahc058
Thread:
Blog: sakana.ai/ahc058
Thread:
Happy New Year! ⛩️
明けましておめでとうございます。
2025年、Sakana AIは事業開発組織を始動させ、研究の成果を社会実装へと繋げる確かな一歩を踏み出しました。 旧年中、私たちと共に歩んでくださった皆様に深く感謝いたします。
2026年、AIはどの産業でも本格実装の時代に突入します。私たちは、最先端のオープンエンドな研究開発を追求し続けると同時に、その成果を日本の産業へと実装し、昨年着手した実装をスケールさせていきます。 日本が世界のAIエコシステムにおいて重要な一角となるよう、業界の皆様と切磋琢磨し、新たな価値を創造していく所存です。
2025年、Sakana AIは事業開発組織を始動させ、研究の成果を社会実装へと繋げる確かな一歩を踏み出しました。 旧年中、私たちと共に歩んでくださった皆様に深く感謝いたします。
2026年、AIはどの産業でも本格実装の時代に突入します。私たちは、最先端のオープンエンドな研究開発を追求し続けると同時に、その成果を日本の産業へと実装し、昨年着手した実装をスケールさせていきます。 日本が世界のAIエコシステムにおいて重要な一角となるよう、業界の皆様と切磋琢磨し、新たな価値を創造していく所存です。
January 1, 2026 at 3:47 AM
Happy New Year! ⛩️
Sakana AI’s office looks like this.
【Sakana AI 採用】 日本の未来を切り拓く、AIの社会実装を支える、オフィスアドミニストレーターを募集します！
急成長中のスタートアップで、快適なオフィス環境作りやメンバーのサポートなど、幅広く活躍してみませんか？
詳細・応募はこちら：
sakana.ai/careers/#off...
急成長中のスタートアップで、快適なオフィス環境作りやメンバーのサポートなど、幅広く活躍してみませんか？
詳細・応募はこちら：
sakana.ai/careers/#off...
December 28, 2025 at 1:43 AM
Sakana AI’s office looks like this.
Software Engineering as a profession will continue to fundamentally change in 2026.
Humans will need to learn to co-adapt to this evolving “alien technology” which comes with no real manual, and figure out how to operate it.
What a time to be alive ✨
twitter.com/karpathy/sta...
Humans will need to learn to co-adapt to this evolving “alien technology” which comes with no real manual, and figure out how to operate it.
What a time to be alive ✨
twitter.com/karpathy/sta...
December 27, 2025 at 1:09 AM
Software Engineering as a profession will continue to fundamentally change in 2026.
Humans will need to learn to co-adapt to this evolving “alien technology” which comes with no real manual, and figure out how to operate it.
What a time to be alive ✨
twitter.com/karpathy/sta...
Humans will need to learn to co-adapt to this evolving “alien technology” which comes with no real manual, and figure out how to operate it.
What a time to be alive ✨
twitter.com/karpathy/sta...
Reposted by hardmaru
Merry Christmas! 🎄
Sakana AIでは、事業開発に関心がある方向けの「カジュアル面談窓口」をオープンしました！金融・防衛・インテリジェンス領域で、私たちがどのような開発に挑んでいるのか。中の人が直接お話しします。
募集職種： エンジニア、Project Manager、Product Manager 内容： 事業戦略、開発の裏側、チームの雰囲気など
最先端のAI開発を社会実装するプロセスに興味がある方、ぜひお気軽にご応募ください！
👉 応募フォームはこちら: forms.gle/sW5wz23SLSvN...
👉 募集要項: sakana.ai/careers/
Sakana AIでは、事業開発に関心がある方向けの「カジュアル面談窓口」をオープンしました！金融・防衛・インテリジェンス領域で、私たちがどのような開発に挑んでいるのか。中の人が直接お話しします。
募集職種： エンジニア、Project Manager、Product Manager 内容： 事業戦略、開発の裏側、チームの雰囲気など
最先端のAI開発を社会実装するプロセスに興味がある方、ぜひお気軽にご応募ください！
👉 応募フォームはこちら: forms.gle/sW5wz23SLSvN...
👉 募集要項: sakana.ai/careers/
December 25, 2025 at 7:47 AM
Merry Christmas! 🎄
Sakana AIでは、事業開発に関心がある方向けの「カジュアル面談窓口」をオープンしました！金融・防衛・インテリジェンス領域で、私たちがどのような開発に挑んでいるのか。中の人が直接お話しします。
募集職種： エンジニア、Project Manager、Product Manager 内容： 事業戦略、開発の裏側、チームの雰囲気など
最先端のAI開発を社会実装するプロセスに興味がある方、ぜひお気軽にご応募ください！
👉 応募フォームはこちら: forms.gle/sW5wz23SLSvN...
👉 募集要項: sakana.ai/careers/
Sakana AIでは、事業開発に関心がある方向けの「カジュアル面談窓口」をオープンしました！金融・防衛・インテリジェンス領域で、私たちがどのような開発に挑んでいるのか。中の人が直接お話しします。
募集職種： エンジニア、Project Manager、Product Manager 内容： 事業戦略、開発の裏側、チームの雰囲気など
最先端のAI開発を社会実装するプロセスに興味がある方、ぜひお気軽にご応募ください！
👉 応募フォームはこちら: forms.gle/sW5wz23SLSvN...
👉 募集要項: sakana.ai/careers/
I doubt that anything resembling genuine AGI is within reach of current AI tools—Terence Tao
mathstodon.xyz/@tao/1157223...
mathstodon.xyz/@tao/1157223...
December 22, 2025 at 7:44 AM
I doubt that anything resembling genuine AGI is within reach of current AI tools—Terence Tao
mathstodon.xyz/@tao/1157223...
mathstodon.xyz/@tao/1157223...
“iRobot Corp., the company that revolutionized robot vacuum cleaners in the early 2000s with its Roomba model, filed for bankruptcy and proposed handing over control to its main Chinese supplier.” 😥
www.bloomberg.com/news/article...
www.bloomberg.com/news/article...
Robot Vacuum Roomba Maker Files for Bankruptcy After 35 Years
iRobot Corp., the company that revolutionized robot vacuum cleaners in the early 2000s with its Roomba model, filed for bankruptcy and proposed handing over control to its main Chinese supplier.
www.bloomberg.com
December 15, 2025 at 12:26 PM
“iRobot Corp., the company that revolutionized robot vacuum cleaners in the early 2000s with its Roomba model, filed for bankruptcy and proposed handing over control to its main Chinese supplier.” 😥
www.bloomberg.com/news/article...
www.bloomberg.com/news/article...