One of the world's oldest universities, home to the Center for Reasoning, Normativity and AI (CERNAI), which conducts AI safety and alignment research led by Prof. Federico Faroldi.
- Team
- ?
- Led by
Loading results...
Showing 301-350 of 456 results
Clear filtersOne of the world's oldest universities, home to the Center for Reasoning, Normativity and AI (CERNAI), which conducts AI safety and alignment research led by Prof. Federico Faroldi.
An interactive educational web series by Nicky Case explaining AI safety concepts to general audiences through accessible comics and interactive explainers.
Meta Charity Funders (MCF) is a donor funding circle that pools capital and expertise to support EA meta charities - organizations working one level removed from direct impact. Members each commit $100,000 or more annually and coordinate through biannual open grant rounds.
Singapore's first civil society organization for AI safety, providing a co-working space, events, and community hub for researchers and professionals working on AI safety governance, technical research, and field-building in Asia.
Saturn Data builds FPGA-accelerated servers for high-memory, high-bandwidth workloads and has received funding to prototype flexible hardware-enabled governors (FlexHEGs) for AI compute governance.
A nonprofit educational organization that runs immersive rationality and AI-focused camps for mathematically talented young people, including ESPR, PAIR, and ASPR.
South Korea's national AI safety research institute, established under the Ministry of Science and ICT in November 2024 to evaluate AI risks and develop safety frameworks and technologies.
FRI advances the science of forecasting to improve decision-making on high-stakes issues including AI risk, nuclear risk, and biosecurity. It was co-founded by superforecasting pioneer Philip Tetlock.
Mox is San Francisco's largest AI safety coworking and community space, providing workspace, events, and fellowships for researchers and organizations working on high-impact problems.
Ulyssean builds integrated hardware and software to secure the data center infrastructure where frontier AI models are trained and deployed, protecting AI model weights against state-sponsored and intelligence-grade threats.
Google DeepMind is Alphabet's primary AI research lab, formed in 2023 by merging DeepMind and Google Brain, working toward artificial general intelligence that benefits humanity.
Canada's second-largest research university by research volume, and the institutional home of leading AI safety researchers including Yoshua Bengio and David Krueger. UdeM anchors Montreal's position as a global hub for AI research and responsible AI development.
Collective Action for Existential Safety (CAES) catalyzes coordinated action to reduce existential risks from AI, nuclear weapons, and engineered pandemics. It is an initiative of the Center for Existential Safety, a newly-formed U.S. nonprofit.
TAIGA is a private platform for qualified AI governance researchers to share non-public research, coordinate efforts, and find collaborators. It serves as a centralized hub to improve the efficiency and effectiveness of the transformative AI strategy and governance research community.
Rice, Hadley, Gates & Manuel (RHGM) is an international strategic consulting firm founded by former senior U.S. national security officials that helps companies navigate emerging markets and technology policy. Through Open Philanthropy funding, the firm has conducted research on AI accident risk and technology competition between the U.S. and China.
Species is a YouTube channel run by Drew Spartz that produces high-effort mini-documentaries educating a general audience about AI risk and the implications of advancing AGI.
Athena is a hybrid mentorship program for women in technical AI alignment research, combining remote mentorship with an in-person retreat to build skills, networks, and representation in the field.
Coordinal Research builds automation tools to accelerate AI safety and alignment research. The organization develops AI-powered scaffolds and workflows that help researchers conduct alignment experiments faster and at greater scale.
TruthfulAI is a non-profit AI safety research organization based in Berkeley that studies situational awareness, deception, and hidden reasoning in large language models.
Geodesic Research is a technical AI safety organization based in Cambridge, UK, focused on implementing and measuring pre- and post-training methods to improve model safety and alignment.
A research organization focused on reducing risks of astronomical suffering (s-risks) from advanced AI, with emphasis on conflict prevention and cooperation between transformative AI systems.
A leading U.S. law school that conducts research on AI governance, policy, and safety through its PULSE program and Institute for Technology, Law & Policy.
A scientific diplomacy organization working to improve global catastrophic risk governance in Spanish-speaking countries, with focus areas spanning AI regulation, pandemic biosecurity, food security, and risk management systems.
Columbia University is an Ivy League research university in New York City with significant AI safety, governance, and policy research activity across multiple schools and centers.
Pause House is a residential community in Blackpool, UK, that provides free housing and stipends to activists working toward a global pause on AGI development.
Argentine nonprofit conducting interdisciplinary research to advance frontier AI safety, embedded within the Laboratory of Innovation and Artificial Intelligence at the University of Buenos Aires.
One of Germany's oldest and most prestigious research universities, founded in 1477 and designated a University of Excellence, hosting leading AI and machine learning research groups including the Tübingen AI Center and the Cluster of Excellence in Machine Learning.
A 501(c)(3) nonprofit that educates the American public and traditional societal institutions about AI safety through free in-person workshops nationwide.
A long-form interview podcast by Dwarkesh Patel featuring deeply researched conversations with leading AI researchers, scientists, historians, and economists on topics including AI safety, AGI timelines, and the future of technology.
AI Policy Bulletin is a peer-reviewed digital magazine publishing policy-relevant perspectives on frontier AI governance, aimed at informing policymakers and the broader AI policy community.
A research center at Brown University focused on AI governance, policy, and socially responsible computing, housed within the Center for Technological Responsibility, Reimagination and Redesign (CNTR) at the Data Science Institute.
A major public research university in Seattle with significant AI research programs, including responsible AI and AI safety-relevant work through its Paul G. Allen School of Computer Science & Engineering and the RAISE center.
A nonprofit research institute that develops methods to align AI systems, markets, and democratic institutions with what people genuinely value, using an approach they call full-stack alignment.
Leap Labs builds AI-powered interpretability tools to accelerate scientific discovery by finding patterns in complex datasets that humans and standard methods miss.
Mila is the Quebec Artificial Intelligence Institute, the world's largest academic research center for deep learning, founded by Turing Award winner Yoshua Bengio. It brings together over 1,400 researchers and professors to advance AI for the benefit of all, with responsible and safe AI as a core strategic priority.
An AI safety advocacy nonprofit that monitors major AI companies' safety policies and conducts public campaigns to pressure the industry toward greater transparency, accountability, and responsible development practices.
IIIT Hyderabad is India's first and leading research-focused IIIT, a not-for-profit public-private partnership university specializing in computer science and AI. It hosts the Responsible and Safe AI Systems course, supported by Open Philanthropy, and is a major hub for AI and machine learning research in India.
Future Matters is a nonprofit strategy consultancy and think tank based in Berlin that helps organizations working on climate protection, AI governance, and biosecurity create effective policy and social change.
Virtue AI is an AI-native security and compliance platform that helps enterprises secure their AI systems and agents against threats like prompt injection, hallucinations, and data poisoning. It was founded in 2024 by leading AI safety researchers Bo Li, Dawn Song, Carlos Guestrin, and Sanmi Koyejo.
Goodfire is an AI interpretability research lab that builds tools to understand and design the internal mechanisms of neural networks. Their flagship product, Ember, gives engineers direct, programmable access to AI model internals.
A major Washington, DC-based think tank founded in 1910 that produces independent policy research on international security, democracy, and governance, with a growing program on AI safety and technology governance.
Successif helps mid-career and senior professionals transition into high-impact careers in AI safety and governance through free personalized advising, workshops, and job market research.
Softmax is an AI alignment research startup developing the science of organic alignment through multi-agent reinforcement learning. Founded by Emmett Shear, Adam Goldstein, and David Bloomin, the company studies how agents learn to cooperate, share goals, and form collectively intelligent systems.
Singapore's national AI safety institute, operated by the Digital Trust Centre at NTU in partnership with IMDA, focusing on AI evaluation, testing, and governance to address gaps in global AI safety science.
A major public research university in Ann Arbor, Michigan, hosting faculty conducting AI safety and alignment research funded by organizations including Open Philanthropy.
Epoch AI is a nonprofit research institute that tracks and forecasts the trajectory of artificial intelligence by analyzing trends in compute, data, algorithmic efficiency, and capabilities. It produces leading databases and quantitative models to help policymakers, researchers, and funders understand the pace and impact of AI progress.
Guide Labs builds interpretable AI systems and foundation models that humans can reliably understand, audit, and steer. Their flagship model, Steerling-8B, is the first inherently interpretable large language model at scale.
AXRP is a podcast hosted by Daniel Filan featuring in-depth interviews with AI safety researchers about their published work and how it might reduce the risk of AI causing an existential catastrophe.
Oregon State University is a public research university in Corvallis, Oregon, whose hardware security research group contributed to AI compute governance through the Survival and Flourishing Fund's FlexHEG (Flexible Hardware-Enabled Guarantees) program.
Americans for Responsible Innovation (ARI) is a bipartisan 501(c)(4) nonprofit that advocates for thoughtful AI governance frameworks in the United States. It works to help policymakers develop policies that protect the public from AI-related harms while maintaining American technological leadership.