A research organization focused on reducing risks of astronomical suffering (s-risks) from advanced AI, with emphasis on conflict prevention and cooperation between transformative AI systems.
A research organization focused on reducing risks of astronomical suffering (s-risks) from advanced AI, with emphasis on conflict prevention and cooperation between transformative AI systems.
People
Updated 05/18/26Executive Director
Funding Details
Updated 05/18/26- Annual Budget
- $1,496,017
- Current Runway
- 12 months
- Funding Goal
- $400,000
- Funding Raised to Date
- -
Org Details
Updated 05/18/26The Center on Long-Term Risk (CLR) is a research organization whose mission is to reduce the risk of astronomical suffering from powerful AI, known as s-risks. Originally founded in July 2013 as the Foundational Research Institute (FRI), a project of the Swiss Effective Altruism Foundation, the organization adopted its current name in March 2020 and became an independent UK-registered charity at the end of 2021. CLR's research agenda centers on understanding and mitigating worst-case risks from advanced AI systems, with a particular focus on conflict scenarios and the technical and philosophical aspects of cooperation. Key research areas include AI model personas and emergent misalignment, Safe Pareto Improvements for AI systems, acausal safety frameworks, and strategic readiness for interventions. CLR researchers have collaborated with researchers at CMU, Oxford, Stanford, Berkeley, MIT, and Google DeepMind, and their work has generated follow-up research from OpenAI and Anthropic. Beyond its core research, CLR operates the CLR Fund, which has distributed approximately $1.9 million in grants since 2018 to support research on s-risk reduction, AI safety, cooperation, and related topics. The organization also runs a Summer Research Fellowship (now in its sixth year), a Fundamentals Program for introducing new researchers to the field, and provides one-on-one career coaching. CLR is led by Managing Director Tristan Cook, who took on the role in January 2025 after Jesse Clifton stepped down as Executive Director. The research team includes specialists in machine learning, game theory, decision theory, and AI alignment. The organization is headquartered in London and is registered as a charity in England and Wales (No. 1195079) under the legal name Foundational Research Institute.
Theory of Change
Updated 05/18/26CLR's theory of change rests on the premise that as humanity develops more powerful technologies, particularly transformative AI, the consequences of poor values or insufficient societal reflection become catastrophically larger in scale. CLR identifies a class of worst-case outcomes called s-risks -- scenarios involving astronomical amounts of suffering -- and focuses on understanding the conditions that could lead to such outcomes. Their primary intervention pathway is developing and communicating insights about safe AI development to relevant stakeholders, including AI labs and policymakers. They focus on robust interventions that reduce conflict and promote cooperation in interactions involving powerful AI systems, reasoning that cooperative frameworks are more likely to prevent the deliberate or accidental creation of suffering at scale. They also invest in community building and talent development to grow the pool of researchers working on these problems.
Grants Received
Updated 05/18/26Projects
Updated 05/18/26The CLR Summer Research Fellowship is an annual 8-week paid program that places researchers on s-risk and empirical AI safety projects, serving as CLR's primary talent pipeline into the field.
The CLR Fund is the grantmaking program of the Center on Long-Term Risk, supporting researchers and projects working to reduce worst-case suffering risks from advanced AI systems.
Discussion
No comments yet. Be the first to share your thoughts.