A nonprofit research organization focused on theoretical AI alignment research, developing formal mechanistic explanations of neural network behavior to ensure future ML systems are aligned with human interests.
- Team
- 9
Loading results...
Showing 51-100 of 3167 results
Clear filtersA nonprofit research organization focused on theoretical AI alignment research, developing formal mechanistic explanations of neural network behavior to ensure future ML systems are aligned with human interests.
Showing 51-100 of 3167 results
Active filters: Type: Org, Individual
Clear filters to view everything →A nonprofit research institute applying category theory, topos theory, and type theory to develop mathematical foundations and open-source tools for collective sense-making, collaborative modeling, and shaping technology for public benefit.
A nonprofit research organization that works to reduce societal-scale risks from artificial intelligence through safety research, field-building, and advocacy.
An African-led research program dedicated to building talent, generating impactful research, and shaping policy to advance AI safety, based in Nairobi, Kenya.
A university research lab at the University of Louisville directed by Dr. Roman Yampolskiy, one of the founders of the field of AI safety, conducting research on the theoretical limits of AI controllability, AI containment, and cybersecurity.
PauseAI is a global grassroots movement advocating for an immediate pause on the development of frontier AI systems until their safety can be demonstrated and they can be kept under democratic control.
MATS (ML Alignment & Theory Scholars) is the largest AI safety research fellowship and talent pipeline, running intensive 12-week research programs that pair fellows with leading AI alignment mentors in Berkeley and London.
A nonprofit that uses legal advocacy, including amicus briefs, impact litigation, and policy engagement, to mitigate catastrophic risks from advanced AI systems and biotechnology.
CLAIR is building the field of Law and AI Safety, producing and promoting legal scholarship on reducing catastrophic and existential risks from advanced artificial intelligence.
A nonprofit that runs fellowships and educational programs to develop expert, mission-aligned talent for AI safety research and governance.
A project that tracks and evaluates frontier AI companies on their safety practices through a weighted scorecard, focusing on actions labs should take to avert extreme risks from advanced AI.
IASEAI is an independent nonprofit that works to ensure AI systems operate safely and ethically by shaping policy, promoting research, and building a global community around AI safety.
A Swiss non-profit think tank that develops evidence-based policy proposals on AI safety, biosecurity, and emerging technologies, bridging science, politics, and civil society for Switzerland and beyond.
A non-profit AI alignment research organization focused on agent foundations, pursuing formal goal alignment approaches that would scale to superintelligence.
A nonprofit organization based in the US and Europe that works to align AI through better governance, developing and advocating for AI governance mechanisms ranging from laws and regulations to voluntary frameworks.
A philanthropic platform and 501(c)(3) nonprofit that facilitates regranting, impact certificates, and crowdfunding for charitable projects, with a primary focus on AI safety and effective altruism cause areas.
An Israeli academic research and advocacy nonprofit focused on reducing catastrophic and existential risks through AI safety research, biosecurity policy, and standards development.
Atlas Computing is a 501(c)(3) nonprofit that maps neglected AI safety risks, sources expert founders, and prototypes solutions to scale human control over advanced AI capabilities.
Carnegie Mellon University is a leading private research university in Pittsburgh, Pennsylvania, widely regarded as one of the world's top institutions for AI and computer science research. It hosts multiple AI safety and governance programs spanning technical research, policy, and applied AI security.
A French nonprofit that develops AI risk management frameworks, independently rates AI companies' safety practices, and contributes to international AI governance standards.
Youth-led AI policy nonprofit that advances AI safety, governance, and accountability through nonpartisan legislative advocacy and public education, headquartered in Washington, DC.
Nonprofit investigating cyber offensive AI capabilities and the controllability of frontier AI models to help humanity avoid permanent disempowerment by strategic AI agents.
The legal entity behind the Centre for Long-Term Resilience (CLTR), a UK-based independent think tank working to transform global resilience to extreme risks, particularly in AI safety and biosecurity.
AE Studio is a bootstrapped technology studio and AI alignment research organization that funds neglected safety research from its software consulting profits. Their work spans brain-computer interfaces, self-other overlap fine-tuning to reduce LLM deception, and consciousness research.
Co-founder and CEO of Impact Ops, leading its work on nonprofit operations; previously held senior operations leadership roles at Effective Ventures, the Centre for Effective Altruism, and the Marine Megafauna Foundation, and now advises the SparkWell accelerator and selected high-impact projects on compliance, governance, and hiring.
Contramont Research is a nonprofit AI safety lab that studies where safety and security evaluation methods break down, using cryptographic model organisms to expose fundamental limitations of existing techniques.
Johns Hopkins University hosts AI safety-relevant research led by Prof. Anqi (Angie) Liu, whose group focuses on machine learning for trustworthy AI, including distributionally robust learning and uncertainty quantification under distribution shift.
Gregory Makoff has been a CIGI senior fellow since 2015 and is an expert on sovereign debt restructuring; he authored "Default: The Landmark Court Battle over Argentina’s $100 Billion Debt Restructuring" and previously spent over two decades advising sovereign borrowers at Citigroup and served as a senior policy adviser at the U.S. Department of the Treasury.
No summary available yet.
Kate McCallum is an award-winning Los Angeles-based producer, writer, and transmedia consultant who founded and serves as executive director of c3: Center for Conscious Creativity. With over 40 years of experience in the creative industries, she works at the intersection of storytelling, immersive media, and future trends in arts and entertainment and chairs the Global Arts & Media Node of The Millennium Project.
No summary available yet.
Lawrence Phillips is the co-founder and CTO of FutureSearch. He holds a PhD in Atomic and Molecular Physics from Heriot-Watt University and an MSc from Imperial College London, and previously led the AI team at Metaculus and held machine learning roles at Cambridge Consultants, GTN, Jawbone Health, and GSK.
No summary available yet.
Robert M. Gates is a principal at Rice, Hadley, Gates & Manuel LLC and formerly served as the 22nd U.S. Secretary of Defense from 2006 to 2011, the only defense secretary asked to remain in office by presidents from both parties. A career national security official, he previously served as Director of Central Intelligence and held senior roles on the National Security Council staff, and he now also serves as Chancellor of William & Mary.
No summary available yet.
Executive Director of the AI Governance and Safety Institute, working on educational materials and advertising campaigns that communicate existential risk from advanced AI to specific audiences. His public bio notes experience in machine learning, political campaigning, and having founded a startup that donated over $100,000 to effective nonprofits, as well as running large-scale outreach projects such as distributing Russian-language editions of HPMOR.
Cornelia Kutterer, LL.M., is a Senior Policy Fellow at SaferAI, where she advises the team on institutional engagement and AI governance research. She is Co-Founder and Chief Legal Officer of Scrydon, an agentic AI startup, and previously spent many years at Microsoft leading European government affairs on responsible technology, rule of law, and competition policy. She also holds part-time roles as Adjunct Professor at UC Law San Francisco and Senior Research Fellow at the Multidisciplinary Institute in AI at the University of Grenoble, focusing on AI governance and regulation.
BIML is an independent nonprofit research institute focused on machine learning security, specifically the work of building security into ML systems at the design level.
No summary available yet.
No summary available yet.
No summary available yet.
Santeri Tani is a Finnish AI safety field builder currently serving as Research Community Manager at the Center on Long-Term Risk (CLR), a London-based research organization focused on reducing s-risks from advanced AI. He studied Computer Science at the University of Helsinki and has a background spanning robotics, machine vision, health tech, and the nonprofit sector. Previously, he was the Operative Director of the Finnish Center for Safe AI (TUTKE), an organization he helped establish to advance AI safety work in Finland. He also served as co-director of Effective Altruism Finland. He has been involved in organizing technical AI safety programs including the Finnish Alignment Engineering Bootcamp, and is advancing forecasting and preparedness capabilities through the RAND Forecasting Initiative. TUTKE received Long-Term Future Fund grant funding for field-building activities in Finland.
A nonprofit that commissions and funds open, expert evaluation and quantitative rating of economics and social science research relevant to global priorities, without the constraints of traditional academic journals.
Tristan Williams is an AI policy researcher and effective altruist based in Spain. He was a Research Fellow at the Center for AI Policy (CAIP), where he focused on societal risks posed by AI and identifying policy solutions, before CAIP ceased operations in 2025. Prior to CAIP, he worked as a research assistant at the Center for AI Safety and at Conjecture, operating at the intersection of AI governance research and advocacy. He is an M.A. Candidate in Security Studies at Georgetown University with a focus on AI policy and governance. He is an active member of the EA Spain community, involved in reviving the EA Madrid group, and has spoken on AI governance at events including AI Safety Barcelona. He has published reports on AI and education, privacy, cybersecurity, and the impacts of AI on creative industries, and authored a post on the EA Forum documenting the closure of CAIP.
Sahil Kulshrestha is an independent AI alignment researcher and founder of Groundless Alignment (groundless.ai), where he develops what he calls "Live Theory" — a framework for understanding risks and opportunities from moderately capable AI systems deployed at scale as infrastructural technology. His core research agenda critiques the dominant "agentic" frame for AI and argues instead for a co-agentic vision in which AI functions as attentive infrastructure rather than autonomous agents. He received a Long-Term Future Fund grant for the development of a mathematical language for highly adaptive entities with stable commitments rather than stable mechanisms. He contributed to the PIBBSS fellowship 2022 (suggesting and facilitating its deep reading group format) and provided curriculum inputs for the "Key Phenomena in AI Risk" facilitated reading group alongside researchers from FHI, PIBBSS, and MIRI. He has engaged with researchers including Scott Garrabrant and received a $100,000 personal donation from Richard Ngo in 2025 to support his live theory work, with Ngo describing him as having one of the most ambitious and philosophically coherent overall visions for the future of AI among researchers he had consulted.
Aalok Mehta is director of the Wadhwani AI Center at the Center for Strategic and International Studies in Washington, DC, where he oversees projects and research on a wide range of AI policy topics, including governance, national security, economic competitiveness, and global AI strategy. Before joining CSIS in 2025, he was Responsible AI Policy Lead at Google, previously led U.S. public policy at OpenAI during the launches of DALL·E 2 and ChatGPT, served as a senior advisor at AI policy nonprofit SeedAI, and held senior technology policy roles at the White House, the Office of Management and Budget, the Federal Communications Commission, and on Capitol Hill.
CARMA is a research and policy think tank working to lower the risks to humanity and the biosphere from transformative AI through integrated risk management, policy research, and technical safety work.
Researcher at the AI Futures Project specialising in forecasting AI chip production and usage. He graduated cum laude from Harvard University with a concurrent master’s in computer science focused on security and hardware, and previously served as an AI Policy Fellow at the Institute for AI Policy and Strategy.
No summary available yet.
Rebecca Gorman is co-founder, Chief Technologist and CEO of Aligned AI, and an expert in near-term AI threats focused on the interface between technology and human behaviour and the tension between AI systems and human preferences. She has co-developed core alignment IP for Aligned AI, including ACE, EquitAI and ClassifAI, and has been recognised in RE•Work’s Top 100 Women Advancing AI in 2023.