Database

The AI Safety Communications Centre (AISCC) connects journalists to AI safety experts and resources, helping improve media coverage of AI risks and safety issues.

No summary available yet.

4 month salary for independent research and AIS field building in South Africa, including working with the AI Safety Hub to coordinate reading groups, research projects and hackathons to empower people to start working on research.

Support to conduct work in AI safety

Miles has co-founded Compassion Aligned Machiner Learning which has been running for 2 years and produced the first benchmarks on Inspect-AI for measuring animal cruelty. CaML has also run the Hyperstition for Good competition to form the only corpus of AIs aligned to non-humans for mid-training data. He has also co-founded another succesful AI safety org called Modelling Cooperation. His background is in economics and he has worked at many Australian think tanks suggesting policy for the government.

Assistant Professor of the Practice in AI Governance and Policy at Brown University’s Data Science Institute and Policy Director for the CNTR AISLE program, whose work focuses on AI governance and policy, bridging technical, legal, and societal perspectives on algorithmic systems and leading the policy team that analyzes trends in AI legislation across the United States.

The University of Virginia is a major public research university in Charlottesville, Virginia, with faculty and programs conducting AI safety and alignment research.

No summary available yet.

Daniel Araya is a CIGI senior fellow, senior partner with the World Legal Summit and consultant whose work focuses on artificial intelligence, technology policy and governance, including AI’s implications for global governance, education and the future of work.

Four months of funding for a MATS 5.0 extension, working on improving methods in latent adversarial training

3-month stipend to do independent AI governance research

No summary available yet.

Co‑founder and executive director of the Collective Intelligence Project, and a political economist and social technologist who previously worked in Microsoft’s Office of the CTO and held roles at institutions including Oxford’s Ethics in AI Institute, the Ostrom Workshop, and the Harvard Safra Center.

Building bridges between Western and Chinese AI governance efforts to address global AI safety challenges.

No summary available yet.

Jimmy Farrell is the EU AI Policy Co-Lead for Pour Demain, a think tank working at the interface between technology and policy across national, regional and international fora. He works on policy recommendations to ensure the responsible development and deployment of general-purpose AI. Previously, he worked on the EU’s AI Act from the European Parliament’s Internal Market and Consumer Protection (IMCO) committee secretariat and in EU public affairs consultancy on digital and fintech policy. He holds an MSc in Public Policy and a BSc in Economics from Erasmus University Rotterdam.

Benji Gering is a public service fellow whose background includes business development, strategic sales, and technical product deployment across global markets. He previously served as Director of Customer Success and Operations at Wavefront Security, where he was a founding employee.

Independent researcher and system designer focused on constraint-based governance for large language models, with an emphasis on preventing authority drift and institutional overreach.

Jeremy Schlatter is a Research Engineer at Palisade Research. He is a software engineer who has previously worked at the Machine Intelligence Research Institute, Google, and OpenAI, among other Silicon Valley companies, contributed to projects such as OpenAI’s Dota 2 bot and a debugger for the Go programming language, and holds a bachelor’s degree in computer science from Washington University in St. Louis.

No summary available yet.

No summary available yet.

No summary available yet.

No summary available yet.

181,448 evaluations proving no production AI model reliably maintains corrections. Expanding coverage and pursuing multi pass validation.

Tony Blair is the Executive Chairman and founder of the Tony Blair Institute for Global Change and served as Prime Minister of the United Kingdom from 1997 to 2007, winning three consecutive general elections as Labour leader. In his current role he works with political leaders worldwide on strategy, policy and delivery, with technology as a central enabler of reform.

Director of U.S. Policy at the Institute for Law & AI whose research focuses on administrative law, agency decision‑making, and liability. He previously clerked on the U.S. Court of Appeals for the Third Circuit, worked in public‑health law at a New York nonprofit, completed a Fulbright grant in Ourense, Spain, and graduated cum laude from Harvard Law School.

Travel support to attend the Symposium on AGI Safety in Oxford in May

Trooper Sanders is an expert in AI, social policy, and financial health who founded the advisory practice Predawn.ai and serves as president of the State AI Safety Roundtable, a nonprofit supporting state-level AI safety efforts. He previously was CEO of Benefits Data Trust and has held senior roles in the White House, philanthropy, and the nonprofit sector.

Pablo is an Ambassador at Giving What We Can and co‑founder and chairman of Regalador.com. He has extensive experience in the nonprofit and consultancy sectors and previously served as president of Effective Altruism Spain.

Felix Hofstätter is a Research Scientist on the evaluations team at Apollo Research, an AI safety organization based in London. He was previously a MATS Fellow (MATS 5.0 program), where he conducted research on AI alignment with a focus on how AI systems can strategically underperform on capability evaluations, a phenomenon known as sandbagging. He is best known for co-authoring the paper "AI Sandbagging: Language Models can Strategically Underperform on Evaluations," which demonstrated that frontier models like GPT-4 and Claude can be prompted or fine-tuned to selectively hide capabilities during assessments, undermining the trustworthiness of AI safety evaluations. Prior to his research career, he worked as a Software Consultant at TNG Technology Consulting and studied at Imperial College London. He writes about AI alignment topics on Medium and the Alignment Forum, aiming to make technical alignment research accessible to ML practitioners.

Creating a contest for Robust, Detailed Proposals and Redteaming of AI Safety Plans: Fast Action for Safe Transformative AI

No summary available yet.

No summary available yet.

Amon Elders is a PhD student in machine learning at the University of Oxford, supervised by Prof. Michael Osborne at the Computational and Biological Learning Lab. He received a $250,000 grant from the Long-Term Future Fund in May 2021 to support his PhD, which focuses on AI safety topics including robustness and distributional shift. He holds a Master's degree in Computer Science and Machine Learning (with distinction) from University College London (UCL). Prior to his PhD, he worked as an ML engineer at Spark Wave and completed a year-long research position at the Italian Institute of Technology in Genoa, which resulted in a co-authored publication at AIES 2019 on multitask learning for fair classification. During his undergraduate studies at the University of Amsterdam, he co-founded the EA society, and he has also served as a Summer Research Fellow at the Stanford Existential Risks Initiative (SERI).

No summary available yet.

No summary available yet.

Randima (Randy) Fernando is a co‑founder and former executive director of the Center for Humane Technology, where he has helped shape global understanding of extractive technology and humane alternatives. Working at the intersection of technology, mindfulness, and social impact, he previously led award‑winning graphics projects and authored several books at NVIDIA, and later served as executive director of Mindful Schools.

Sharon Hammond is the Chief Operating Officer on the Society Library’s executive/core team, helping lead the organization’s operations.

No summary available yet.

No summary available yet.

LLM persona researcher in the Alignment of Complex Systems group, creator of the open-source representation-engineering library repeng, 2024 New Science fellow, and AI researcher with a background in computational linguistics.

No summary available yet.

A Substack newsletter by Ajeya Cotra exploring AI capabilities, timelines, and the societal implications of increasingly autonomous AI systems.

Benedikt Höltgen (Ben) is a researcher with interdisciplinary training in mathematics, philosophy, and computer science, currently affiliated with the Hasso Plattner Institute's Data & AI cluster in Potsdam, Germany. He completed an MSc in Mathematical Philosophy at the Munich Center for Mathematical Philosophy (MCMP) and an MSc in Computer Science at the University of Oxford with a focus on machine learning, before starting a PhD at the University of Tübingen in 2022 under Bob Williamson as part of the ELLIS PhD program, co-supervised by Nuria Oliver at the University of Alicante. His research focuses on the mathematical assumptions and technical modeling choices underlying AI systems and their societal implications, including probability interpretation, individual-group dynamics, and algorithmic fairness. Earlier in his career, following advice from 80,000 Hours, he transitioned from philosophy to ML research and worked with the OATML group at Oxford (Yarin Gal's lab) alongside Sören Mindermann and Jan Brauner, contributing to the RHO-Loss paper on prioritized training published at ICML 2022. He received a Long-Term Future Fund grant in December 2021 to support 10 months of research on AI safety and alignment, with a focus on scaling laws and interpretability, during this Oxford period.

No summary available yet.

Milo McBride is a fellow in the Sustainability, Climate, and Geopolitics Program at the Carnegie Endowment for International Peace in Washington, DC, researching the geopolitics of energy‑transition technologies, critical minerals, and next‑generation innovations that can accelerate global decarbonization.

Inaugural Program Manager at Brown University’s Center for Technological Responsibility, Reimagination, and Redesign (CNTR) and CNTR AISLE Product Director, leading short- and long-term strategic planning and product development for CNTR’s projects, with a background in program management, digital innovation, and technology for social impact and a focus on integrating technological ethics and critical disability studies.

Abe Smith is a Silicon Valley enterprise software executive and Chief of Global Field Operations at Freshworks, leading worldwide field sales after prior leadership roles at Zoom, Oracle, Cisco/WebEx, and Cision.