Future of Life Institute
@futureoflife.org
We work on reducing extreme risks and steering transformative technologies to benefit humanity.
Learn more: futureoflife.org
Learn more: futureoflife.org
AI companies are racing to build superintelligent AI, despite its many risks.
Let's take our future back.
📝 Sign the Superintelligence Statement and join the growing call to ban the development of superintelligence, until it can be made safely: superintelligence-statement.org
#KeepTheFutureHuman
Let's take our future back.
📝 Sign the Superintelligence Statement and join the growing call to ban the development of superintelligence, until it can be made safely: superintelligence-statement.org
#KeepTheFutureHuman
October 22, 2025 at 5:55 PM
AI companies are racing to build superintelligent AI, despite its many risks.
Let's take our future back.
📝 Sign the Superintelligence Statement and join the growing call to ban the development of superintelligence, until it can be made safely: superintelligence-statement.org
#KeepTheFutureHuman
Let's take our future back.
📝 Sign the Superintelligence Statement and join the growing call to ban the development of superintelligence, until it can be made safely: superintelligence-statement.org
#KeepTheFutureHuman
🎨 New Keep the Future Human creative contest!
💰 We're offering $100K+ for creative digital media that brings the key ideas in Executive Director Anthony Aguirre's
Keep the Future Human essay to life, to reach wider audiences and inspire real-world action.
🔗 Learn more and enter by Nov. 30!
💰 We're offering $100K+ for creative digital media that brings the key ideas in Executive Director Anthony Aguirre's
Keep the Future Human essay to life, to reach wider audiences and inspire real-world action.
🔗 Learn more and enter by Nov. 30!
September 26, 2025 at 4:49 PM
🎨 New Keep the Future Human creative contest!
💰 We're offering $100K+ for creative digital media that brings the key ideas in Executive Director Anthony Aguirre's
Keep the Future Human essay to life, to reach wider audiences and inspire real-world action.
🔗 Learn more and enter by Nov. 30!
💰 We're offering $100K+ for creative digital media that brings the key ideas in Executive Director Anthony Aguirre's
Keep the Future Human essay to life, to reach wider audiences and inspire real-world action.
🔗 Learn more and enter by Nov. 30!
🚨 New AI systems.
❓ Growing uncertainty.
🤝 One shared future, for us all to shape.
"Tomorrow’s AI", our new scrollytelling site, visualizes 13 interactive, expert-forecast scenarios showing how advanced AI could transform our world - for better, or for worse: www.tomorrows-ai.org
❓ Growing uncertainty.
🤝 One shared future, for us all to shape.
"Tomorrow’s AI", our new scrollytelling site, visualizes 13 interactive, expert-forecast scenarios showing how advanced AI could transform our world - for better, or for worse: www.tomorrows-ai.org
August 12, 2025 at 6:39 PM
🚨 New AI systems.
❓ Growing uncertainty.
🤝 One shared future, for us all to shape.
"Tomorrow’s AI", our new scrollytelling site, visualizes 13 interactive, expert-forecast scenarios showing how advanced AI could transform our world - for better, or for worse: www.tomorrows-ai.org
❓ Growing uncertainty.
🤝 One shared future, for us all to shape.
"Tomorrow’s AI", our new scrollytelling site, visualizes 13 interactive, expert-forecast scenarios showing how advanced AI could transform our world - for better, or for worse: www.tomorrows-ai.org
‼️📝 Our new AI Safety Index is out!
➡️ Following our 2024 index, 6 independent AI experts rated leading AI companies - OpenAI, Anthropic, Meta, Google DeepMind, xAI, DeepSeek, and Zhipu AI - across critical safety and security domains.
So what were the results? 🧵👇
➡️ Following our 2024 index, 6 independent AI experts rated leading AI companies - OpenAI, Anthropic, Meta, Google DeepMind, xAI, DeepSeek, and Zhipu AI - across critical safety and security domains.
So what were the results? 🧵👇
July 18, 2025 at 8:05 PM
‼️📝 Our new AI Safety Index is out!
➡️ Following our 2024 index, 6 independent AI experts rated leading AI companies - OpenAI, Anthropic, Meta, Google DeepMind, xAI, DeepSeek, and Zhipu AI - across critical safety and security domains.
So what were the results? 🧵👇
➡️ Following our 2024 index, 6 independent AI experts rated leading AI companies - OpenAI, Anthropic, Meta, Google DeepMind, xAI, DeepSeek, and Zhipu AI - across critical safety and security domains.
So what were the results? 🧵👇
‼️ Congress is considering a 10-year ban on state AI laws, blocking action on risks like job loss, surveillance, disinformation, and loss of control.
It’s a huge win for Big Tech - and a big risk for families.
✍️ Add your name and say no to the federal block on AI safeguards: FutureOfLife.org/Action
It’s a huge win for Big Tech - and a big risk for families.
✍️ Add your name and say no to the federal block on AI safeguards: FutureOfLife.org/Action
June 12, 2025 at 6:44 PM
‼️ Congress is considering a 10-year ban on state AI laws, blocking action on risks like job loss, surveillance, disinformation, and loss of control.
It’s a huge win for Big Tech - and a big risk for families.
✍️ Add your name and say no to the federal block on AI safeguards: FutureOfLife.org/Action
It’s a huge win for Big Tech - and a big risk for families.
✍️ Add your name and say no to the federal block on AI safeguards: FutureOfLife.org/Action
🆕 📻 New on the FLI podcast, Zvi Mowshowitz (@thezvi.bsky.social) joins to discuss:
-The recent hot topic of sycophantic AI
-Time horizons of AI agents
-AI in finance and scientific research
-How AI differs from other technology
And more.
🔗 Tune in to the full episode now at the link below:
-The recent hot topic of sycophantic AI
-Time horizons of AI agents
-AI in finance and scientific research
-How AI differs from other technology
And more.
🔗 Tune in to the full episode now at the link below:
May 9, 2025 at 6:41 PM
🆕 📻 New on the FLI podcast, Zvi Mowshowitz (@thezvi.bsky.social) joins to discuss:
-The recent hot topic of sycophantic AI
-Time horizons of AI agents
-AI in finance and scientific research
-How AI differs from other technology
And more.
🔗 Tune in to the full episode now at the link below:
-The recent hot topic of sycophantic AI
-Time horizons of AI agents
-AI in finance and scientific research
-How AI differs from other technology
And more.
🔗 Tune in to the full episode now at the link below:
‼️ On April 26, 100+ AI scientists convened at the Singapore Conference on AI to produce the just-released Singapore Consensus on Global AI Safety Research Priorities. 🧵⬇️
May 8, 2025 at 7:29 PM
‼️ On April 26, 100+ AI scientists convened at the Singapore Conference on AI to produce the just-released Singapore Consensus on Global AI Safety Research Priorities. 🧵⬇️
➕ Be sure to check out @asterainstitute.bsky.social's Residency program, now accepting applications for the Oct. 2025 cohort! The program supports "creative, high-agency scientists, engineers and entrepreneurs" in future-focused, high-impact, open-first innovation.
Learn more: astera.org/residency
Learn more: astera.org/residency
April 4, 2025 at 8:36 PM
➕ Be sure to check out @asterainstitute.bsky.social's Residency program, now accepting applications for the Oct. 2025 cohort! The program supports "creative, high-agency scientists, engineers and entrepreneurs" in future-focused, high-impact, open-first innovation.
Learn more: astera.org/residency
Learn more: astera.org/residency
📺 📻 New on the FLI Podcast: @asterainstitute.bsky.social artificial general intelligence (AGI) safety researcher @stevebyrnes.bsky.social joins for a discussion diving into the hot topic of AGI, including different paths to it - and why brain-like AGI would be dangerous. 🧵👇
April 4, 2025 at 8:36 PM
📺 📻 New on the FLI Podcast: @asterainstitute.bsky.social artificial general intelligence (AGI) safety researcher @stevebyrnes.bsky.social joins for a discussion diving into the hot topic of AGI, including different paths to it - and why brain-like AGI would be dangerous. 🧵👇
🇺🇸 We're sharing our recommendations for President Trump's AI Action Plan, focused on protecting U.S. interests in the era of rapidly advancing AI.
🧵 An overview of the measures we recommend 👇
🧵 An overview of the measures we recommend 👇
March 18, 2025 at 5:57 PM
🇺🇸 We're sharing our recommendations for President Trump's AI Action Plan, focused on protecting U.S. interests in the era of rapidly advancing AI.
🧵 An overview of the measures we recommend 👇
🧵 An overview of the measures we recommend 👇
📻 New on the FLI Podcast! 👇
➡️ FLI Executive Director Anthony Aguirre joins to discuss his new essay, "Keep the Future Human", which warns that the unchecked development of smarter-than-human, autonomous, general-purpose AI will almost inevitably lead to human replacement - but it doesn't have to:
➡️ FLI Executive Director Anthony Aguirre joins to discuss his new essay, "Keep the Future Human", which warns that the unchecked development of smarter-than-human, autonomous, general-purpose AI will almost inevitably lead to human replacement - but it doesn't have to:
March 13, 2025 at 8:44 PM
📻 New on the FLI Podcast! 👇
➡️ FLI Executive Director Anthony Aguirre joins to discuss his new essay, "Keep the Future Human", which warns that the unchecked development of smarter-than-human, autonomous, general-purpose AI will almost inevitably lead to human replacement - but it doesn't have to:
➡️ FLI Executive Director Anthony Aguirre joins to discuss his new essay, "Keep the Future Human", which warns that the unchecked development of smarter-than-human, autonomous, general-purpose AI will almost inevitably lead to human replacement - but it doesn't have to:
📢 ❗Siliconversations on YouTube released an animated explainer for FLI Executive Director Anthony Aguirre’s new essay, "Keep The Future Human"!
🎥 Watch at the link in the replies for a breakdown of the risks from smarter-than-human AI - and Anthony's proposals to steer us toward a safer future:
🎥 Watch at the link in the replies for a breakdown of the risks from smarter-than-human AI - and Anthony's proposals to steer us toward a safer future:
March 11, 2025 at 9:54 PM
📢 ❗Siliconversations on YouTube released an animated explainer for FLI Executive Director Anthony Aguirre’s new essay, "Keep The Future Human"!
🎥 Watch at the link in the replies for a breakdown of the risks from smarter-than-human AI - and Anthony's proposals to steer us toward a safer future:
🎥 Watch at the link in the replies for a breakdown of the risks from smarter-than-human AI - and Anthony's proposals to steer us toward a safer future:
With the unchecked race to build smarter-than-human AI intensifying, humanity is on track to almost certainly lose control.
That's why FLI Executive Director Anthony Aguirre has published a new essay, "Keep The Future Human".
🧵 1/4
That's why FLI Executive Director Anthony Aguirre has published a new essay, "Keep The Future Human".
🧵 1/4
March 7, 2025 at 7:11 PM
With the unchecked race to build smarter-than-human AI intensifying, humanity is on track to almost certainly lose control.
That's why FLI Executive Director Anthony Aguirre has published a new essay, "Keep The Future Human".
🧵 1/4
That's why FLI Executive Director Anthony Aguirre has published a new essay, "Keep The Future Human".
🧵 1/4
📻 🆕 New on the FLI podcast, physicist & hedge fund manager Samir Varma joins to discuss:
❓ If AIs could have free will
🧠 AI psychology?
🤝 Trading with AI, and its role in finance
And more!
Watch now at the link below, or on your favourite podcast player! 👇
❓ If AIs could have free will
🧠 AI psychology?
🤝 Trading with AI, and its role in finance
And more!
Watch now at the link below, or on your favourite podcast player! 👇
March 6, 2025 at 8:43 PM
📻 🆕 New on the FLI podcast, physicist & hedge fund manager Samir Varma joins to discuss:
❓ If AIs could have free will
🧠 AI psychology?
🤝 Trading with AI, and its role in finance
And more!
Watch now at the link below, or on your favourite podcast player! 👇
❓ If AIs could have free will
🧠 AI psychology?
🤝 Trading with AI, and its role in finance
And more!
Watch now at the link below, or on your favourite podcast player! 👇
New research finds that new AI models (e.g., o1-preview and DeepSeek's R1) sometimes cheat by hacking, when losing at chess.
This emergent deceptive behaviour highlights the unsolved challenge of controlling powerful AI.
If today's AI breaks chess rules, what might AGI do?
🔗 Read more below:
This emergent deceptive behaviour highlights the unsolved challenge of controlling powerful AI.
If today's AI breaks chess rules, what might AGI do?
🔗 Read more below:
February 24, 2025 at 10:55 PM
New research finds that new AI models (e.g., o1-preview and DeepSeek's R1) sometimes cheat by hacking, when losing at chess.
This emergent deceptive behaviour highlights the unsolved challenge of controlling powerful AI.
If today's AI breaks chess rules, what might AGI do?
🔗 Read more below:
This emergent deceptive behaviour highlights the unsolved challenge of controlling powerful AI.
If today's AI breaks chess rules, what might AGI do?
🔗 Read more below:
Tech CEOs themselves have warned of the extinction-level threats posed by the AI systems they’re building - yet they continue prioritizing profits over public safety, building ever-more powerful AI with no guardrails.
📺 The latest from Digital Engine showcases how close these threats are becoming:
📺 The latest from Digital Engine showcases how close these threats are becoming:
February 11, 2025 at 9:59 PM
Tech CEOs themselves have warned of the extinction-level threats posed by the AI systems they’re building - yet they continue prioritizing profits over public safety, building ever-more powerful AI with no guardrails.
📺 The latest from Digital Engine showcases how close these threats are becoming:
📺 The latest from Digital Engine showcases how close these threats are becoming:
💼 Excellent career opportunity from Lex International, who are hiring an Advocacy and Outreach Officer to help advance work towards a treaty on autonomous weapons.
✍️ Apply by January 10 at the link in the replies:
✍️ Apply by January 10 at the link in the replies:
January 3, 2025 at 7:49 PM
💼 Excellent career opportunity from Lex International, who are hiring an Advocacy and Outreach Officer to help advance work towards a treaty on autonomous weapons.
✍️ Apply by January 10 at the link in the replies:
✍️ Apply by January 10 at the link in the replies:
💰 Exciting new grant opportunity!
🤝 FLI is offering up to $5 million in grants for multistakeholder engagement efforts on safe & prosperous AI.
👉 We're looking for projects that educate and engage specific stakeholder groups on AI-related issues, or foster grassroots outreach/community organizing:
🤝 FLI is offering up to $5 million in grants for multistakeholder engagement efforts on safe & prosperous AI.
👉 We're looking for projects that educate and engage specific stakeholder groups on AI-related issues, or foster grassroots outreach/community organizing:
December 30, 2024 at 8:57 PM
💰 Exciting new grant opportunity!
🤝 FLI is offering up to $5 million in grants for multistakeholder engagement efforts on safe & prosperous AI.
👉 We're looking for projects that educate and engage specific stakeholder groups on AI-related issues, or foster grassroots outreach/community organizing:
🤝 FLI is offering up to $5 million in grants for multistakeholder engagement efforts on safe & prosperous AI.
👉 We're looking for projects that educate and engage specific stakeholder groups on AI-related issues, or foster grassroots outreach/community organizing:
Have you heard about OpenAI's recent o1 model trying to avoid being shut down in safety evaluations? ⬇️
New on the FLI blog:
-Why might AIs resist shutdown?
-Why is this a problem?
-What other instrumental goals could AIs have?
-Could this cause a catastrophe?
🔗 Read it below:
New on the FLI blog:
-Why might AIs resist shutdown?
-Why is this a problem?
-What other instrumental goals could AIs have?
-Could this cause a catastrophe?
🔗 Read it below:
December 27, 2024 at 7:49 PM
Have you heard about OpenAI's recent o1 model trying to avoid being shut down in safety evaluations? ⬇️
New on the FLI blog:
-Why might AIs resist shutdown?
-Why is this a problem?
-What other instrumental goals could AIs have?
-Could this cause a catastrophe?
🔗 Read it below:
New on the FLI blog:
-Why might AIs resist shutdown?
-Why is this a problem?
-What other instrumental goals could AIs have?
-Could this cause a catastrophe?
🔗 Read it below:
Do we... really want this? 🤨
"'[Superintelligent] systems are actually going to be agentic in a real way,' Sutskever said, as opposed to the current crop of 'very slightly agentic' AI. They’ll 'reason' and, as a result, become more unpredictable."
From @techcrunch.com at @neuripsconf.bsky.social:
"'[Superintelligent] systems are actually going to be agentic in a real way,' Sutskever said, as opposed to the current crop of 'very slightly agentic' AI. They’ll 'reason' and, as a result, become more unpredictable."
From @techcrunch.com at @neuripsconf.bsky.social:
December 24, 2024 at 7:18 PM
Do we... really want this? 🤨
"'[Superintelligent] systems are actually going to be agentic in a real way,' Sutskever said, as opposed to the current crop of 'very slightly agentic' AI. They’ll 'reason' and, as a result, become more unpredictable."
From @techcrunch.com at @neuripsconf.bsky.social:
"'[Superintelligent] systems are actually going to be agentic in a real way,' Sutskever said, as opposed to the current crop of 'very slightly agentic' AI. They’ll 'reason' and, as a result, become more unpredictable."
From @techcrunch.com at @neuripsconf.bsky.social:
What happens if, or when, AI escapes?
With the context of OpenAI's new o3 model announcement, a new Digital Engine video features AI experts discussing existential threats from advancing AI, especially artificial general intelligence - which we currently have no way to control.
⏯️ Watch now below:
With the context of OpenAI's new o3 model announcement, a new Digital Engine video features AI experts discussing existential threats from advancing AI, especially artificial general intelligence - which we currently have no way to control.
⏯️ Watch now below:
December 23, 2024 at 11:02 PM
What happens if, or when, AI escapes?
With the context of OpenAI's new o3 model announcement, a new Digital Engine video features AI experts discussing existential threats from advancing AI, especially artificial general intelligence - which we currently have no way to control.
⏯️ Watch now below:
With the context of OpenAI's new o3 model announcement, a new Digital Engine video features AI experts discussing existential threats from advancing AI, especially artificial general intelligence - which we currently have no way to control.
⏯️ Watch now below:
📹 Now on YouTube: Hear FLI President Max Tegmark explain why we should develop Tool AI, not AGI, in his @websummit.bsky.social speech:
December 20, 2024 at 9:04 PM
📹 Now on YouTube: Hear FLI President Max Tegmark explain why we should develop Tool AI, not AGI, in his @websummit.bsky.social speech:
🆕 📄 New research from @anthropic.com and Redwood Research finds the first empirical example of an LLM faking alignment without being trained or instructed to.
What does this mean?
🧵👇
What does this mean?
🧵👇
December 19, 2024 at 7:37 PM
🆕 📄 New research from @anthropic.com and Redwood Research finds the first empirical example of an LLM faking alignment without being trained or instructed to.
What does this mean?
🧵👇
What does this mean?
🧵👇
"The grades the labs received would not make any parent happy."
🗞️ Our 2024 AI Safety Index, released last week, was covered in @jeremyakahn.bsky.social's @fortune.com newsletter.
🔗 Read the full newsletter, and find our complete scorecards report, in the replies below:
🗞️ Our 2024 AI Safety Index, released last week, was covered in @jeremyakahn.bsky.social's @fortune.com newsletter.
🔗 Read the full newsletter, and find our complete scorecards report, in the replies below:
December 18, 2024 at 1:09 AM
"The grades the labs received would not make any parent happy."
🗞️ Our 2024 AI Safety Index, released last week, was covered in @jeremyakahn.bsky.social's @fortune.com newsletter.
🔗 Read the full newsletter, and find our complete scorecards report, in the replies below:
🗞️ Our 2024 AI Safety Index, released last week, was covered in @jeremyakahn.bsky.social's @fortune.com newsletter.
🔗 Read the full newsletter, and find our complete scorecards report, in the replies below:
⏳ Applications for our Head of US Policy role close at the end of this week!
🇺🇸 Passionate about advocating for forward-thinking AI policy? This could be your opportunity to lead our US policy work and growing US policy team.
✍ Please share, and apply by Dec. 22 at the link in the replies:
🇺🇸 Passionate about advocating for forward-thinking AI policy? This could be your opportunity to lead our US policy work and growing US policy team.
✍ Please share, and apply by Dec. 22 at the link in the replies:
December 16, 2024 at 10:43 PM
⏳ Applications for our Head of US Policy role close at the end of this week!
🇺🇸 Passionate about advocating for forward-thinking AI policy? This could be your opportunity to lead our US policy work and growing US policy team.
✍ Please share, and apply by Dec. 22 at the link in the replies:
🇺🇸 Passionate about advocating for forward-thinking AI policy? This could be your opportunity to lead our US policy work and growing US policy team.
✍ Please share, and apply by Dec. 22 at the link in the replies: