Database

Jessica Taylor has worked as a mathematical researcher at the Machine Intelligence Research Institute, holds an MS in Computer Science from Stanford University, and blogs at unstableontology.com.

Dan Schwarz is the co-founder and CEO of FutureSearch. He holds a BS in Symbolic Systems from Stanford University and previously served as CTO at Metaculus, was a senior software engineer at Google and Waymo, and created Google’s internal prediction market.

David Abecassis is a Technical Governance Researcher at the Machine Intelligence Research Institute (MIRI), where he focuses on strategies to mitigate risks from frontier AI development, particularly technical mechanisms for halting dangerous AI activities. He holds a BS in Symbolic Systems from Stanford University. Before joining MIRI, he was the lead designer of Teamfight Tactics at Riot Games, with a background in rapid prototyping of strategy games and social system architecture. He participated in the MATS Summer 2024 program under the mentorship of Lisa Thiergart, where he developed forecasts of US-China relations in the context of transformative AI. His research includes co-authoring papers on technical requirements for halting dangerous AI activities and an international agreement to prevent the premature creation of artificial superintelligence. He has submitted recommendations to the US AI Action Plan advocating for preserving the option to halt AI development as a safeguard against existential risks from artificial superintelligence.

Kyle Redman is a researcher and practitioner of deliberative democracy who serves as Democracy Lead at the AI & Democracy Foundation and Program Manager at the Federation for Innovation in Democracy – Europe, and was previously Research and Design Director at the newDemocracy Foundation.

6-month salary for SERI MATS scholar to continue working on theoretical AI alignment research, trying to better understand how ML models work to reduce X-risk from future AGI

3-month part-time salary in order to work on AI governance projects and activities

Funding ends June 2025: Urgent support for proven AI safety pipeline converting technical talent from 26+ countries into published contributors

Nick Beckstead is co‑founder and CEO of the Secure AI Project, an advocacy organization developing pragmatic policies to reduce risks of severe harm from advanced AI. Previously he was an early employee and Program Officer at Open Philanthropy, worked as Policy Lead at the Center for AI Safety, served as CEO of the FTX Future Fund, and was a research fellow at Oxford University’s Future of Humanity Institute. He holds a BA in mathematics and philosophy from the University of Minnesota and a PhD in philosophy from Rutgers University.

No summary available yet.

No summary available yet.

Adrian Dumitrescu is a mission design engineer and aerospace researcher serving as Mission Design Lead at Astera Institute, where he works on advanced space mission concepts and spacecraft structures. He previously held a Mission Design Engineer role at Astera, co-founded and is CTO of AIM Space, contributed to projects with the Romanian Space Initiative and Astroscale, and holds a PhD in aerospace engineering from the University of Southampton focused on 3D-printed structures for spacecraft applications.

No summary available yet.

No summary available yet.

One year grant for a project to reverse-engineer human social instincts by implementing Steven Byrnes' brain-like AGI

No summary available yet.

Beth Barnes is the founder and CEO of METR, where she leads a growing technical team that designs and runs evaluations of generative AI models to assess catastrophic risks from frontier systems. Before founding METR she worked with DeepMind’s Chief Scientist on scaling laws to forecast deep‑learning progress and at OpenAI, where she helped develop safety targets and evaluated scalable oversight techniques and code models for misalignment before deployment; she previously studied computer science at the University of Cambridge.

Scott Niekum is an Associate Professor in the College of Information and Computer Sciences at the University of Massachusetts Amherst and director of the Safe, Confident, and Aligned Learning + Robotics Lab (SCALAR). His research aims to ensure that AI systems are well-aligned with human objectives and can be deployed safely in the real world, developing efficient learning algorithms that enforce safety constraints, provide performance guarantees, and infer and align human and agent objectives across settings from large language models to robotics.

No summary available yet.

No summary available yet.

No summary available yet.

4 month grant to upskill for AI governance work before starting Science and Technology Policy PhD

Philippe Beaudoin is a researcher, programmer and entrepreneur serving as an affiliated researcher at LawZero. He holds a Ph.D. in computer science from Université de Montréal and completed postdoctoral work at the University of British Columbia, then joined Google as a senior engineer working on Chrome’s recommendation systems. In 2016 he co-founded Element AI and later founded the AI startup Waverly, and by joining LawZero in 2025 he continues his long-standing focus on designing AI systems that support human flourishing.

Building AI tools for charities

Max Tegmark is a physicist, machine learning researcher, and author who is a professor of physics at the Massachusetts Institute of Technology and founder and president of the Future of Life Institute. He has written more than 300 technical papers and the bestselling books Our Mathematical Universe and Life 3.0, and his recent AI safety research focuses on mechanistic interpretability and guaranteed safe AI.

No summary available yet.

No summary available yet.

Senior policy counsel who has served at the Center for AI Safety Action Fund, where he worked on California’s AI safety bill SB 1047 and broader AI policy issues.

Gary McGraw, Ph.D., is co-founder and CEO of the Berryville Institute of Machine Learning and a globally recognized authority on software security whose work now focuses on machine learning security. Previously he spent more than two decades as a senior executive and CTO at Cigital (acquired by Synopsys), authored numerous software security books and papers, and helped create the Building Security In Maturity Model (BSIMM).

4-month wage for alignment upskilling: gain research eng skills (projects) + understand current alignment agendas

No summary available yet.

No summary available yet.

Funding for full-time, independent research on agent foundations

No summary available yet.

Dr Tomasz Hollanek is an Assistant Research Professor and Postdoctoral Research Fellow at the Leverhulme Centre for the Future of Intelligence and an Affiliated Lecturer in the Department of Computer Science and Technology at the University of Cambridge. Working at the intersection of AI ethics, critical design and human–AI interaction, his research explores how critical and speculative design methods can support socially just and environmentally sustainable governance, development and deployment of AI systems, including within projects such as AI for Just and Sustainable Futures and the HEAT EU AI Act toolkit.

Thomas Woodside is Co-Founder and Senior Policy Advisor at the Secure AI Project, an organization that develops and advocates for pragmatic policies to reduce risks of severe harm from advanced AI. He is also a master's student in Security Studies at Georgetown University. He holds a BS in Computer Science from Yale University, where his undergraduate thesis focused on vulnerabilities in large language models. He was the first employee at the Center for AI Safety (CAIS), where he worked with Director Dan Hendrycks and co-authored the widely read paper "An Overview of Catastrophic AI Risks" with Hendrycks and Mantas Mazeika. He subsequently served as a Junior Fellow at Georgetown's Center for Security and Emerging Technology (CSET), publishing research on LLM evaluation, emergent abilities, AI agents, and AI reporting requirements. His policy work includes advocacy on California SB 1047, SB 53, and the New York RAISE Act.

Funding the last year of my PhD on embedded agency, to free up my time from teaching

No summary available yet.

Associate Professor of Machine Learning at the University of Oxford and Director of Research at the UK Government’s AI Safety Institute (now AI Security Institute).

Aqib Zakaria is an analyst for ChinaTalk. Originally from New Orleans, he graduated from Harvard University with an A.B. in Government and an A.M. in Regional Studies—East Asia, and his research interests include semiconductors, robotics, and industrial policy.

Help fund our student’s trip to NeurIPS to present his main conference paper on interpretable features in text-to-image diffusion models.

Vivian Dong is Programs Director at Legal Advocates for Safe Science and Technology (LASST). She is a graduate of Harvard Law School and, before joining LASST, worked as a litigator and associate attorney at the law firm of Kellogg, Hansen, Todd, Figel & Frederick, P.L.L.C. in Washington, D.C.

6-month salary to finish writing a book on international AI governance and three other smaller AI governance projects

No summary available yet.

Taniel Yusef is a research affiliate at the Centre for the Study of Existential Risk and a researcher and advocate working on portfolios at the UN, European and UK parliaments with an emphasis on disarmament. Her work focuses on weapons technology regulation across AI, nuclear weapons, outer-space threats and cybersecurity, as well as supply chains, global trade, development, emerging economies and gender, and she holds roles including Technology Developers Coordinator of the UK Campaign to Stop Killer Robots, visiting lecturer at the University of East London and member of the WILPF Advisory Board.

No summary available yet.

Joe Edelman is a philosopher, sociologist, and entrepreneur who co-founded and co-leads the Meaning Alignment Institute, where he serves as a principal investigator on programs such as Full-Stack Alignment and AGI Institutions. He previously developed meaning-based metrics used at companies like CouchSurfing, Facebook, and Apple, and co-founded the Center for Humane Technology.

Designing a Project Funding Proposal

Paul Christiano is a researcher in artificial intelligence alignment who formerly led the language model alignment team at OpenAI, founded and headed the nonprofit Alignment Research Center, and now serves as Head of Safety for the Center for AI Standards and Innovation at the U.S. National Institute of Standards and Technology (NIST).