Database

5-month salary and compute expenses for technical AI Safety research on penalizing RL agent betrayal

Nathan Sherburn is a software engineer and entrepreneur who leads Good Ancestors’ technical research projects, including its Legal Zero-Days work, drawing on experience building AI-assisted products and tools.

6-month stipend to continue independent interpretability research

Katja Grace is a researcher focused on understanding the future impacts of artificial intelligence. She co-founded AI Impacts, a long-running project examining empirical and conceptual questions relevant to AI forecasting and decision-making, and leads its research on technological trajectories, expert prediction, model scaling and related topics.

No summary available yet.

2 months of part-time salary for a trial + developer costs to maintain and improve the AI governance document sharing hu

No summary available yet.

No summary available yet.

Arthur Grimonpont is Head of Advocacy at CeSIA, where he represents the organisation in parliamentary hearings and public debates on systemic AI risks. He is also an essayist and advisor on AI at Reporters Without Borders (RSF) and author of the book “Algocratie”, which examines how artificial intelligence shapes the information ecosystem.

No summary available yet.

I'm an independent AI researcher and systems architect based in Querétaro, Mexico. I've been building and deploying AI systems since 2024, working across full-stack architecture, applied ML, and behavioral analysis.

Promoting pandemic preparedness, with special focus on influenza

sailing the cyberspace

Lewis Hammond is a DPhil candidate in computer science at the University of Oxford and Research Director at the Cooperative AI Foundation. His doctoral research, supervised by Alessandro Abate, Julian Gutierrez, and Michael Wooldridge, focuses on safety and cooperation in multi-agent systems, motivated by the goal of ensuring AI and other powerful technologies are developed and governed safely and democratically. He holds a BSc in mathematics and philosophy from the University of Warwick and an MSc in artificial intelligence from the University of Edinburgh. His key research areas span game theory, formal methods, machine learning, cooperative AI, causal reasoning in games, and scalable oversight; notably, his ICLR 2025 paper on neural interactive proofs introduces a framework for how a computationally bounded verifier can learn to interact with powerful but untrusted provers to solve tasks, directly addressing the scalable oversight problem. He is also affiliated with the Centre for the Governance of AI, is a Pathways to AI Policy Fellow at the Wilson Center, and was previously a DPhil Affiliate at the Future of Humanity Institute. His scalable oversight experiments received funding from the Long-Term Future Fund and OpenAI.

No summary available yet.

No summary available yet.

No summary available yet.

No summary available yet.

No summary available yet.

Geoffrey D. Dabelko, PhD, is Senior Advisor and former director of the Wilson Center’s Environmental Change and Security Program, a professor and associate dean at Ohio University’s George V. Voinovich School of Leadership and Public Affairs, and an associate senior fellow with the Stockholm International Peace Research Institute’s Environment of Peace Initiative.

No summary available yet.

Founder of Wiser Human, background in risk management, focusing on developing technical human control mechanisms for agentic AI systems which are robust to agent subversion

Ship It: Building Bridges for Better AI Outcomes

No summary available yet.

AE Studio ops

3-month salary for SERI-MATS extension

No summary available yet.

AGI safety / alignment and neuroscience researcher at Astera Institute

No summary available yet.

Rolls‑Royce Commonwealth Eminent Professor of Commerce at the University of Virginia, Co‑Director of AI Research @ UVA and Special Advisor to the Provost for AI Research, whose work and teaching focus on artificial intelligence, cybersecurity and the diffusion of innovations in organizations.

No summary available yet.

Meia Chita-Tegmark is a psychologist and human–robot interaction researcher who conducts research at Tufts University’s Human–Robot Interaction Lab. She serves as treasurer of the Beneficial AI Foundation and is a co‑founder and board secretary of the Future of Life Institute, with work focused on how emerging technologies and artificial intelligence affect human psychology, social interaction and well‑being.

No summary available yet.

Magdalena Wache is a technical AI safety researcher based in Darmstadt, Germany. She holds a Master's degree in Machine Learning and works as a researcher at the Fraunhofer Institute for Secure Information Technology (SIT). She was a SERI MATS scholar and a PIBBSS (Principles of Intelligence) fellow in 2024, where she produced a paper co-authored with Scott Garrabrant and others titled 'Factored Space Models: Towards Causality Between Levels of Abstraction' (arXiv:2412.02579), developing mathematical foundations for understanding causality between abstraction levels. She co-founded the European Network for AI Safety (ENAIS) and organized the AI Safety Europe Retreat 2023 in Berlin, bringing together 67 AI safety researchers and field-builders. She has also served as CEO of Effektiver Altruismus Darmstadt e.V. and as an advisor to ENAIS. She received funding from the Long-Term Future Fund to self-study AI safety and test fit for theoretical research.

Scott Wisor is Policy Director at the Secure AI Project, where he leads state‑level advocacy on AI safety and liability legislation, including transparency and child‑protection measures in Illinois and other states. He previously worked as a philosophy academic, including roles at Minerva University and the University of Birmingham, focusing on applied ethics and global justice.

Engineer

No summary available yet.

Founder of Effective Thesis and member of its board of directors; also works as an analyst at the Czech Science Foundation and is a Sociology of Science PhD candidate at Charles University in Prague.

Einar Urdshals is a Research Scientist at Timaeus, an AI safety research organization focused on Singular Learning Theory. He completed his PhD in theoretical physics at Chalmers University of Technology in Gothenburg, Sweden, where he studied dark matter-electron interactions in detector materials, defending in April 2024. Following his PhD, he transitioned into AI safety research, supported by a Long-Term Future Fund grant for mentored independent research and upskilling. His AI safety research spans interpretability, neural network compressibility, and trajectory modeling of language models; his most notable work applies Singular Learning Theory and the minimum description length principle to measure neural network complexity. He also participated in AI Safety Camp (AISC9, 2024) and Apart Research hackathons during his transition into the field.

Misha Yagudin is a world‑class forecaster who leads the Samotsvety super team and co‑founded the forecasting consultancy Arb Research, with a background spanning software engineering, philosophy and development economics.

Create a value learning benchmark with contextualized scenarios by leveraging a recent breakthrough in natural language processing

No summary available yet.

Janus is a pseudonymous alignment researcher, also known as "repligate" and "moire", who impacts the real world through outputs such as alignment research and mythological translations.

Software Developer & Climber

No summary available yet.

12-month salary to work on alignment research!

No summary available yet.

No summary available yet.