Database

A research nonprofit focused on how to navigate the transition to a world with superintelligent AI systems, tackling neglected questions in AI macrostrategy.

AI Digest creates interactive explainers and demos to help policymakers and the public understand AI capabilities and their effects, operated as a project of Sage Future, a US 501(c)(3) charity.

A non-profit initiative that runs an online, part-time research program connecting early-career researchers with experienced AI safety mentors to collaborate on concrete projects aimed at reducing existential risk from AI.

An expert-managed grantmaking fund within EA Funds that distributes millions annually to reduce global catastrophic risks, with a primary focus on AI safety research, biosecurity, and other existential risk mitigation work.

A German nonprofit that cultivates the next generation of European AI policy leaders through its flagship Talos Fellowship, combining training, a Brussels policymaking summit, and paid placements at leading think tanks and policy organizations.

80,000 Hours is a nonprofit that provides free research, career advice, and a job board to help people find careers that effectively tackle the world's most pressing problems, with a current focus on AI safety.

A nonprofit grantmaking fund that supports technical AI safety research, AI governance policy, and training programs for new AI safety researchers to reduce catastrophic risks from advanced AI.

A major philanthropic fund that organizes grant applications and evaluates them using the S-Process algorithm to direct Jaan Tallinn's giving toward organizations working to ensure humanity's long-term survival and flourishing. It is the second-largest funder of AI safety after Open Philanthropy.

A Stanford University initiative that hosts and promotes academic scholarship on existential risks, running research fellowships, conferences, courses, and discussion groups focused on AI, nuclear war, pandemics, and climate change.

A global working group that seeks out and incubates high-impact strategies to improve institutional decision-making, with a primary focus on AI governance and existential risk reduction.

A nonpartisan think tank that produces policy research on the implications of advanced AI systems, covering frontier security, compute governance, and international AI strategy to equip policymakers for high-magnitude AI risks.

Intelligence Rising is a strategic AI futures roleplay simulation that lets decision-makers experience the tensions and risks of competitive AI development. It is a project of Technology Strategy Roleplay, a UK registered charity.

Non-Trivial runs free online research fellowships for talented young people ages 14-20 to develop impactful projects on the world's most pressing problems. The program offers mentorship, scholarships up to $10,000, and a global peer community.

An interdisciplinary research group based at Charles University in Prague studying multi-agent systems composed of humans and advanced AI, focused on understanding and mitigating systemic risks from AI integration into human institutions.

FAR.AI is an AI safety research nonprofit that conducts technical research on robustness, alignment, and model evaluation, while building the AI safety field through workshops, fellowships, and grantmaking.

CEEALAR (formerly the EA Hotel) is a residential fellowship in Blackpool, UK that provides free or subsidized accommodation, meals, and stipends to individuals working on effective altruism projects, with a focus on AI safety research.

A nonprofit supporting journalism that helps society navigate the emergence of increasingly advanced AI, through fellowships, grants, and its own publication Transformer.

An independent, expert-led philanthropic advisory that helps major donors direct funding toward reducing catastrophic and existential risks, with a core focus on AI safety, biosecurity, and nuclear weapons policy.

Don't Worry About the Vase is Zvi Mowshowitz's influential blog and Substack newsletter covering AI safety, AI developments, rationality, and policy, with over 32,000 subscribers.

Apollo Research is an AI safety organization that develops evaluations and tools to detect and mitigate deceptive alignment (scheming) in frontier AI systems.

A nonprofit that educates policymakers, civil society, and the public about AI capabilities and dangers through interactive live software demonstrations.

An independent nonprofit supporting whistleblowers at frontier AI companies through expert guidance, legal support, and secure anonymous reporting channels. Now operating as The AI Whistleblower Initiative (AIWI).

An AI safety research organization applying Singular Learning Theory and developmental interpretability to understand how capabilities and values emerge during neural network training.

A global nonprofit incubator that helps founders launch and scale AI safety, security, and resilience organizations by providing mentorship, co-founder matching, and access to seed funding networks.

A Dutch foundation that works to reduce existential risk by informing the public debate through media engagement, policy advocacy, research, and public events.

A Prague-based nonprofit umbrella organization that creates, runs, and supports projects in existential security, epistemics, rationality, and effective altruism, providing fiscal sponsorship, operations infrastructure, and community spaces.

An international AI x-risk strategy think tank that conducts scenario research and governance analysis to mitigate risks from transformative AI technologies.

A nonprofit that develops and advocates for pragmatic policies to reduce the risk of severe harm from advanced AI, promoting transparency, accountability, and safe development through state and federal legislation.

A research group developing mathematical theory for computationally bounded agents to provide rigorous, scalable solutions to the AI alignment problem.

Luthien is a Seattle-based nonprofit building production-ready AI control infrastructure that assumes AI models may act adversarially and prevents misaligned systems from achieving harmful goals.

A research and advocacy nonprofit that conducts public opinion polling on AI risks and advocates for government policies to mitigate catastrophic risks from frontier AI technology.

A Geneva-based think tank that fosters international cooperation on governing frontier AI by conducting research, facilitating dialogue between technical and policy communities, and training diplomats and civil servants.

Sam Eisenstat's independent AI alignment research program, focused on mathematical foundations of agency, logical uncertainty, concept formation (condensation theory), and causal modeling at different levels of abstraction.

AI safety research organization applying computational mechanics from physics and computational neuroscience to build a rigorous science of intelligence, with a focus on understanding the internal representations and emergent behavior of neural networks.

An independent nonprofit and affiliated research company dedicated to accelerating the development of AI safety standards and risk management frameworks, with a focus on EU AI Act standards and global AI safety engineering.

An independent legal research think tank, now operating as the Institute for Law & AI, that conducts foundational research and advises governments on the legal and governance challenges posed by artificial intelligence.

An AI safety field-building nonprofit that builds and maintains digital infrastructure to grow and improve the AI safety ecosystem, including AISafety.com, AISafety.info, and approximately 15 other projects.

A nonprofit research institute that seeks to develop mathematically rigorous foundations for metaphysics, using category theory to formalize insights from contemplative traditions, with applications to AI alignment and trustworthy AI.

A US 501(c)(3) nonprofit dedicated to advancing international cooperation to reduce extreme AI risks, best known for running the International Dialogues on AI Safety (IDAIS) series that convenes leading scientists from around the world.

A center-right tech policy think tank, formerly the Lincoln Network, that bridges Silicon Valley and Washington to advance AI safety policy, technology governance, and pro-innovation reform.

The French Center for AI Safety (Centre pour la Securite de l'IA) is a Paris-based non-profit think tank and research center working to reduce risks from artificial intelligence through education, technical research, and policy advocacy in France and Europe.

A nonprofit research organization founded in 1986 that advances frontier science and technology for the benefit of life, with focus areas spanning secure AI, nanotechnology, longevity biotechnology, neurotechnology, and existential hope.

A nonprofit that runs immersive workshops teaching rationality techniques drawn from cognitive science, behavioral economics, and decision theory, with a focus on improving thinking for people working on high-impact problems including AI safety.

METR is a research nonprofit that develops scientific methods to evaluate whether frontier AI systems could pose catastrophic risks to society, working with leading AI labs on pre-deployment safety assessments.

A pioneering AI safety nonprofit that conducts research and public outreach to help prevent human extinction from the development of artificial superintelligence, with a current focus on policy advocacy and communications.

An independent AI safety research organization that accelerates AI safety talent development and produces impactful research through hackathons, structured fellowships, and collaborative research programs.

Transluce is an independent nonprofit AI research lab that builds open, scalable technology for understanding AI systems and steering them in the public interest.

A nonprofit research organization that develops detailed scenario forecasts of advanced AI trajectories to inform policymakers, researchers, and the public.

A major nonprofit policy research organization that, through its Center on AI, Security, and Technology (CAST) and Global and Emerging Risks division, conducts influential research on AI safety, frontier model security, AI governance, and existential risk policy.