A small agent foundations research group using foundational mathematics to develop rigorous understanding of AI agents and their safety properties.

AI Risk Explorer (AIRE) is an online platform that monitors large-scale AI risks across cyber offense, biological risk, loss of control, and manipulation, providing curated evidence and actionable insights for policymakers and researchers.

A collaborative hardware security research effort between WPI and UMass Amherst focused on developing tamper-detection and verification mechanisms for semiconductor chips, with applications to AI governance and hardware-enabled guarantees.

Georgetown University is a major private Jesuit research university in Washington, D.C. that hosts several programs relevant to AI safety and governance, including the Center for Security and Emerging Technology (CSET), the McCourt School's Tech & Public Policy program, and the Law School's Institute for Technology Law & Policy.

PEAKS is a coworking space in Zurich, Switzerland for professionals working on Effective Altruism and AI Safety research.

The US fundraising arm of the ETH Zurich Foundation, enabling American donors to make tax-deductible gifts that support research, teaching, and talent at ETH Zurich in Switzerland.

The Global Partnership on Artificial Intelligence (GPAI) is an international initiative of 46 member countries and the European Union that promotes the responsible development and use of AI, grounded in human rights, inclusion and democratic values. In July 2024, GPAI joined forces with the OECD’s AI policy work as an integrated partnership under the GPAI brand, hosted at the OECD in Paris.

One of the world's oldest universities, home to the Center for Reasoning, Normativity and AI (CERNAI), which conducts AI safety and alignment research led by Prof. Federico Faroldi.

An interactive educational web series by Nicky Case explaining AI safety concepts to general audiences through accessible comics and interactive explainers.

Meta Charity Funders (MCF) is a donor funding circle that pools capital and expertise to support EA meta charities - organizations working one level removed from direct impact. Members each commit $100,000 or more annually and coordinate through biannual open grant rounds.

A curated directory of AI safety podcasts, newsletters, YouTube channels, blogs, books, and forums maintained by AISafety.com. It helps newcomers and practitioners stay informed about rapid developments in the AI safety field.

Singapore's first civil society organization for AI safety, providing a co-working space, events, and community hub for researchers and professionals working on AI safety governance, technical research, and field-building in Asia.

Saturn Data builds FPGA-accelerated servers for high-memory, high-bandwidth workloads and has received funding to prototype flexible hardware-enabled governors (FlexHEGs) for AI compute governance.

A nonprofit educational organization that runs immersive rationality and AI-focused camps for mathematically talented young people, including ESPR, PAIR, and ASPR.

South Korea's national AI safety research institute, established under the Ministry of Science and ICT in November 2024 to evaluate AI risks and develop safety frameworks and technologies.

FRI advances the science of forecasting to improve decision-making on high-stakes issues including AI risk, nuclear risk, and biosecurity. It was co-founded by superforecasting pioneer Philip Tetlock.

Mox is San Francisco's largest AI safety coworking and community space, providing workspace, events, and fellowships for researchers and organizations working on high-impact problems.

Ulyssean builds integrated hardware and software to secure the data center infrastructure where frontier AI models are trained and deployed, protecting AI model weights against state-sponsored and intelligence-grade threats.

Google DeepMind is Alphabet's primary AI research lab, formed in 2023 by merging DeepMind and Google Brain, working toward artificial general intelligence that benefits humanity.

Canada's second-largest research university by research volume, and the institutional home of leading AI safety researchers including Yoshua Bengio and David Krueger. UdeM anchors Montreal's position as a global hub for AI research and responsible AI development.

Collective Action for Existential Safety (CAES) catalyzes coordinated action to reduce existential risks from AI, nuclear weapons, and engineered pandemics. It is an initiative of the Center for Existential Safety, a newly-formed U.S. nonprofit.

TAIGA is a private platform for qualified AI governance researchers to share non-public research, coordinate efforts, and find collaborators. It serves as a centralized hub to improve the efficiency and effectiveness of the transformative AI strategy and governance research community.

Rice, Hadley, Gates & Manuel (RHGM) is an international strategic consulting firm founded by former senior U.S. national security officials that helps companies navigate emerging markets and technology policy. Through Open Philanthropy funding, the firm has conducted research on AI accident risk and technology competition between the U.S. and China.

Species is a YouTube channel run by Drew Spartz that produces high-effort mini-documentaries educating a general audience about AI risk and the implications of advancing AGI.

Athena is a hybrid mentorship program for women in technical AI alignment research, combining remote mentorship with an in-person retreat to build skills, networks, and representation in the field.

Coordinal Research builds automation tools to accelerate AI safety and alignment research. The organization develops AI-powered scaffolds and workflows that help researchers conduct alignment experiments faster and at greater scale.

TruthfulAI is a non-profit AI safety research organization based in Berkeley that studies situational awareness, deception, and hidden reasoning in large language models.

Geodesic Research is a technical AI safety organization based in Cambridge, UK, focused on implementing and measuring pre- and post-training methods to improve model safety and alignment.

A research organization focused on reducing risks of astronomical suffering (s-risks) from advanced AI, with emphasis on conflict prevention and cooperation between transformative AI systems.

A directory within AISafety.com that consolidates free guidance calls from AI safety advisors, helping newcomers identify how to contribute most effectively to the field.

A leading U.S. law school that conducts research on AI governance, policy, and safety through its PULSE program and Institute for Technology, Law & Policy.

A scientific diplomacy organization working to improve global catastrophic risk governance in Spanish-speaking countries, with focus areas spanning AI regulation, pandemic biosecurity, food security, and risk management systems.

Columbia University is an Ivy League research university in New York City with significant AI safety, governance, and policy research activity across multiple schools and centers.

Pause House is a residential community in Blackpool, UK, that provides free housing and stipends to activists working toward a global pause on AGI development.

Argentine nonprofit conducting interdisciplinary research to advance frontier AI safety, embedded within the Laboratory of Innovation and Artificial Intelligence at the University of Buenos Aires.

One of Germany's oldest and most prestigious research universities, founded in 1477 and designated a University of Excellence, hosting leading AI and machine learning research groups including the Tübingen AI Center and the Cluster of Excellence in Machine Learning.

A 501(c)(3) nonprofit that educates the American public and traditional societal institutions about AI safety through free in-person workshops nationwide.

A long-form interview podcast by Dwarkesh Patel featuring deeply researched conversations with leading AI researchers, scientists, historians, and economists on topics including AI safety, AGI timelines, and the future of technology.

AI Policy Bulletin is a peer-reviewed digital magazine publishing policy-relevant perspectives on frontier AI governance, aimed at informing policymakers and the broader AI policy community.

A research center at Brown University focused on AI governance, policy, and socially responsible computing, housed within the Center for Technological Responsibility, Reimagination and Redesign (CNTR) at the Data Science Institute.

A major public research university in Seattle with significant AI research programs, including responsible AI and AI safety-relevant work through its Paul G. Allen School of Computer Science & Engineering and the RAISE center.

A nonprofit research institute that develops methods to align AI systems, markets, and democratic institutions with what people genuinely value, using an approach they call full-stack alignment.

Leap Labs builds AI-powered interpretability tools to accelerate scientific discovery by finding patterns in complex datasets that humans and standard methods miss.

Mila is the Quebec Artificial Intelligence Institute, the world's largest academic research center for deep learning, founded by Turing Award winner Yoshua Bengio. It brings together over 1,400 researchers and professors to advance AI for the benefit of all, with responsible and safe AI as a core strategic priority.

No summary available yet.

An AI safety advocacy nonprofit that monitors major AI companies' safety policies and conducts public campaigns to pressure the industry toward greater transparency, accountability, and responsible development practices.

IIIT Hyderabad is India's first and leading research-focused IIIT, a not-for-profit public-private partnership university specializing in computer science and AI. It hosts the Responsible and Safe AI Systems course, supported by Open Philanthropy, and is a major hub for AI and machine learning research in India.

Future Matters is a nonprofit strategy consultancy and think tank based in Berlin that helps organizations working on climate protection, AI governance, and biosecurity create effective policy and social change.

Virtue AI is an AI-native security and compliance platform that helps enterprises secure their AI systems and agents against threats like prompt injection, hallucinations, and data poisoning. It was founded in 2024 by leading AI safety researchers Bo Li, Dawn Song, Carlos Guestrin, and Sanmi Koyejo.