Database

A research nonprofit focused on how to navigate the transition to a world with superintelligent AI systems, tackling neglected questions in AI macrostrategy.

AI Digest creates interactive explainers and demos to help policymakers and the public understand AI capabilities and their effects, operated as a project of Sage Future, a US 501(c)(3) charity.

A non-profit initiative that runs an online, part-time research program connecting early-career researchers with experienced AI safety mentors to collaborate on concrete projects aimed at reducing existential risk from AI.

An expert-managed grantmaking fund within EA Funds that distributes millions annually to reduce global catastrophic risks, with a primary focus on AI safety research, biosecurity, and other existential risk mitigation work.

A global working group that seeks out and incubates high-impact strategies to improve institutional decision-making, with a primary focus on AI governance and existential risk reduction.

CEEALAR (formerly the EA Hotel) is a residential fellowship in Blackpool, UK that provides free or subsidized accommodation, meals, and stipends to individuals working on effective altruism projects, with a focus on AI safety research.

A nonprofit supporting journalism that helps society navigate the emergence of increasingly advanced AI, through fellowships, grants, and its own publication Transformer.

A nonprofit that develops and advocates for pragmatic policies to reduce the risk of severe harm from advanced AI, promoting transparency, accountability, and safe development through state and federal legislation.

An independent legal research think tank, now operating as the Institute for Law & AI, that conducts foundational research and advises governments on the legal and governance challenges posed by artificial intelligence.

The French Center for AI Safety (Centre pour la Securite de l'IA) is a Paris-based non-profit think tank and research center working to reduce risks from artificial intelligence through education, technical research, and policy advocacy in France and Europe.

A nonprofit research organization founded in 1986 that advances frontier science and technology for the benefit of life, with focus areas spanning secure AI, nanotechnology, longevity biotechnology, neurotechnology, and existential hope.

A nonprofit that runs immersive workshops teaching rationality techniques drawn from cognitive science, behavioral economics, and decision theory, with a focus on improving thinking for people working on high-impact problems including AI safety.

PauseAI is a global grassroots movement advocating for an immediate pause on the development of frontier AI systems until their safety can be demonstrated and they can be kept under democratic control.

MATS (ML Alignment & Theory Scholars) is the largest AI safety research fellowship and talent pipeline, running intensive 12-week research programs that pair fellows with leading AI alignment mentors in Berkeley and London.

A nonprofit that uses legal advocacy, including amicus briefs, impact litigation, and policy engagement, to mitigate catastrophic risks from advanced AI systems and biotechnology.

Nonprofit investigating cyber offensive AI capabilities and the controllability of frontier AI models to help humanity avoid permanent disempowerment by strategic AI agents.

BIML is an independent nonprofit research institute focused on machine learning security, specifically the work of building security into ML systems at the design level.

A global participatory futures research think tank that produces the annual State of the Future report and tracks 15 Global Challenges facing humanity, with growing focus on AGI governance and existential risk.

A nonprofit that archives humanity's ideas, ideologies, and world-views through structured debate mapping, with a focus on AI safety, alignment, and democratic governance of AI.

AFFINE (Agent Foundations FIeld NEtwork) runs intensive superintelligence alignment seminars and fellowships to upskill promising newcomers in agent foundations and AI alignment research.

A research project that uses game theory and computational modeling to reduce catastrophic risks from competition in the development of transformative AI.

CASA is a research organization working to ensure the benefits of AI can be widely and equitably distributed globally without compromising essential security, with a focus on Global Majority countries.

A university research lab at the University of Rhode Island directed by Dr. Sarah M Brown, studying how machine learning interacts with complex socio-technical systems, with a focus on fairness of automated decision-making and AI safety evaluation.

Upgradable is an applied research lab and life optimization service that helps effective altruists, AI safety researchers, and existential risk advocates lead more impactful lives.

A European multi-donor foundation that seeds and scales high-impact initiatives for the secure and beneficial development of AI. Astralis unites funders, experts, and entrepreneurs to steer AI toward beneficial outcomes through grantmaking, strategic guidance, and network-building.

Panoplia Laboratories (now operating as Active Site) is a nonprofit that evaluates the risks and capabilities of AI-driven biology through wet lab research, and develops broad-spectrum antivirals for pandemic preparedness.

The 501(c)(4) advocacy arm of the Center for AI Safety, dedicated to advancing bipartisan public policies that maintain U.S. leadership in AI and protect against AI-related national security threats.

A Canadian registered charity that increases public and scientific awareness of AI's catastrophic risks through education and research.

Evitable is a nonprofit that informs and organizes the public to confront societal-scale risks from AI and put an end to the reckless race to develop superintelligence.

CaML researches how synthetic pretraining data can shift AI systems towards greater compassion and moral open-mindedness regarding all sentient beings, including animals and potential digital minds.

Sage builds tools to improve forecasting skills and public understanding of AI capabilities, with the goal of reducing global catastrophic risks from emerging technologies.

Doom Debates is a podcast and debate show hosted by Liron Shapira focused on high-stakes debates about AI existential risk. Its mission is to raise mainstream awareness of potential extinction from AGI and build social infrastructure for high-quality public discourse on the topic.

A Baltimore-based nonprofit media platform that produces podcasts, videos, and social content to bring AI extinction risk into mainstream public conversation.

An AI safety research initiative developing new adaptive theoretical frameworks and AI interface designs to keep human sensemaking at pace with rapidly advancing AI systems.

AI-Plans is a platform for discovering, critiquing, and advancing AI alignment strategies, hosting a contributable compendium of alignment plans and running community research events.

LawZero is a nonprofit AI safety research organization founded by Yoshua Bengio to develop safe-by-design AI systems that cannot act autonomously or pursue hidden goals.

UC Berkeley's Center for Long-Term Cybersecurity (CLTC) is a research and collaboration hub advancing future-oriented cybersecurity research, policy, and education, with a growing focus on AI safety governance and risk management for frontier AI systems.

Horizon Events is a Canadian non-profit that advances AI safety R&D by organizing high-impact events, including the AI Safety Unconference series and monthly Guaranteed Safe AI Seminars.

The US fundraising arm of the ETH Zurich Foundation, enabling American donors to make tax-deductible gifts that support research, teaching, and talent at ETH Zurich in Switzerland.

Mox is San Francisco's largest AI safety coworking and community space, providing workspace, events, and fellowships for researchers and organizations working on high-impact problems.

Collective Action for Existential Safety (CAES) catalyzes coordinated action to reduce existential risks from AI, nuclear weapons, and engineered pandemics. It is an initiative of the Center for Existential Safety, a newly-formed U.S. nonprofit.

Athena is a hybrid mentorship program for women in technical AI alignment research, combining remote mentorship with an in-person retreat to build skills, networks, and representation in the field.

A research organization focused on reducing risks of astronomical suffering (s-risks) from advanced AI, with emphasis on conflict prevention and cooperation between transformative AI systems.

A scientific diplomacy organization working to improve global catastrophic risk governance in Spanish-speaking countries, with focus areas spanning AI regulation, pandemic biosecurity, food security, and risk management systems.

Epoch AI is a nonprofit research institute that tracks and forecasts the trajectory of artificial intelligence by analyzing trends in compute, data, algorithmic efficiency, and capabilities. It produces leading databases and quantitative models to help policymakers, researchers, and funders understand the pace and impact of AI progress.

AXRP is a podcast hosted by Daniel Filan featuring in-depth interviews with AI safety researchers about their published work and how it might reduce the risk of AI causing an existential catastrophe.

Lionheart Ventures is a seed-stage venture capital firm investing in transformative artificial intelligence and frontier mental health technologies to mitigate civilizational risk.

Leaf runs online fellowships for exceptional teenagers (ages 15-19) to explore how they can have the most positive impact, including through a flagship course on AI safety called Dilemmas and Dangers in AI.

A 501(c)(3) nonprofit that accelerates neglected approaches to AI alignment by providing researchers with engineering teams, compute resources, and operational infrastructure.