Database

prodigal son

No summary available yet.

Kat Woods is President and co-founder of Nonlinear. She previously co-founded Charity Entrepreneurship, an Open Philanthropy-funded charity incubator that has launched numerous charities including Fortify Health, Fish Welfare Initiative, Family Empowerment Media, and Training for Good, and co-founded Charity Science Health, which helped vaccinate over 200,000 children in India and received multiple GiveWell grants.

New techniques to impose minimal structure on LLM internals for monitoring, intervention, and unlearning.

No summary available yet.

John Bridge is a legal researcher affiliated with the effective altruism community who received a grant from the Long-Term Future Fund to research the international viability of FHI's Windfall Clause, a policy proposal by the Future of Humanity Institute for AI developers to commit a portion of transformative AI profits to public benefit. At the time of his research, he identified as a law student. He wrote a sequence on the EA Forum titled "Towards a Worldwide, Watertight Windfall Clause" examining the legal enforceability of the Windfall Clause across seven common law jurisdictions. His published posts (May-June 2022) include analyses of inadequate contractual remedies and the challenges English law poses for good-faith obligations in AI governance agreements. He shelved the project in 2023 due to competing research demands. His work was acknowledged by Cullen O'Keefe and Haydn Bellfield, key figures in the GovAI and FHI Windfall Clause research.

Our mission is to inform and organize the public to confront societal-scale risks of AI, and put an end to the reckless race to develop superintelligent AI.

Rachel Shu is the Director of Mox, an AI safety community hub in San Francisco’s Mission District, where she focuses on venue operations and community-building for researchers, engineers, and policymakers working on high-stakes questions in technology. She also works on writing and documentary projects, including cinematography for the film “SB 1047: The Battle for the Future of AI” and an Open Philanthropy–funded documentary on high-impact COVID responses.

Jack Clark is a co-founder and Head of Public Benefit at Anthropic, where he leads work at the intersection of AI policy, governance, and public benefit, and he writes Import AI, a weekly newsletter on frontier AI research and its societal implications. He previously served as Policy Director at OpenAI and, before entering AI labs, worked as a technology journalist covering supercomputers, distributed systems, and neural networks for outlets including Bloomberg BusinessWeek and The Register, as well as helping found and co-chair the AI Index at Stanford and serving on national and international AI advisory bodies.

Geoffrey Hinton & Yoshua Bengio Interviews Secured, Funding Still Needed

No summary available yet.

6-month budget to self-study ML and research the possible applications of a Neuro/CogScience perspective for AGI Safety

Rui Zhang is an Assistant Professor in the Computer Science and Engineering Department at Penn State University and a co-director of the Penn State Natural Language Processing Lab. His research focuses on trustworthy human-centered AI, LLM agents, and AI for science, and he has received recognitions including an NSF CAREER Award, a Senior Area Chair Paper Award at NAACL 2025, and an Outstanding Area Chair Award at EMNLP 2024. He is the principal investigator of an Open Philanthropy–funded project at Penn State to better mitigate sandbagging in AI models, studying behaviors such as exploration hacking and password-locking.

No summary available yet.

Pip Foweraker is CEO of Beacon, a 501(c)(3) fiscal sponsorship agency focusing on catastrophic and existential risk, and Executive Director of Research at the Certes Institute, working on infrastructure and support for AI safety and other existential risk research.

Honours student at Deakin University focusing on transferring safety knowledge between environments using multi-objective reinforcement learning, with prior experience as a research assistant on several machine learning projects at both Deakin University and Federation University.

No summary available yet.

No summary available yet.

Darren McKee is a Canadian author, senior policy advisor, and AI safety communicator based in Ottawa, Ontario. He holds an MSc in Experimental Psychology and a Master of Public Administration with a Global Governance concentration. McKee has served as a senior policy advisor in the Canadian federal government for over 15 years, working across domains including science and technology, behavioural science, and foresight, with roles at the Privy Council Office and Treasury Board of Canada Secretariat. He is the author of Uncontrollable: The Threat of Artificial Superintelligence and the Race to Save the World (2023), a beginner-friendly book on AI risk and safety that received endorsements from Max Tegmark, Will MacAskill, and Roman Yampolskiy, and became a number-one bestseller. McKee also co-authored a chapter on AI and autonomy in Westworld Psychology (2021) and serves as an advisor to AIGS Canada (Artificial Intelligence Governance and Safety Canada). He is the host of The Reality Check, an award-winning skepticism and critical thinking podcast ranked in the top 0.5% of podcasts globally with over 4 million downloads.

Megan Stifel is Chief Strategy Officer at the Institute for Security and Technology, where she leads organizational strategy and cyber‑related work, and is the founder of Silicon Harbor Consultants, a firm providing strategic cybersecurity operations and policy counsel after earlier service as an attorney in the U.S. Department of Justice National Security Division.

Nicholas Greig is a researcher who has worked on neural network interpretability in the context of AI safety. He received a grant from the Long-Term Future Fund (LTFF) for neural network interpretability research, indicating engagement with the EA-adjacent AI safety community.

Wendy Schmidt is an American philanthropist and investor who serves as president and co-founder of the Schmidt Family Foundation and Schmidt Ocean Institute and has created and led multiple philanthropic initiatives focused on clean energy, resilient food systems, healthy oceans, human rights, and scientific research, including the 11th Hour Project, Schmidt Marine Technology Partners, 11th Hour Racing, Remain, and Schmidt Sciences.

No summary available yet.

Joar Skalse is an AI safety researcher who completed his DPhil in Computer Science at the University of Oxford in 2025, supervised by Professor Alessandro Abate and supported by the Future of Humanity Institute. He received his BA and MCompPhil in Computer Science and Philosophy at Oxford, graduating top of year. His doctoral research focused on safe reinforcement learning, reward learning, and misspecification, with particular emphasis on formally defining and characterizing reward hacking. He is best known for co-authoring the influential mesa-optimizers paper ("Risks from Learned Optimization in Advanced Machine Learning Systems") as an undergraduate, and for his NeurIPS 2022 paper "Defining and Characterizing Reward Hacking". His work also includes contributions to mechanistic interpretability, the STARC framework for comparing reward functions, and the "Towards Guaranteed Safe AI" framework. He has been affiliated with FAR AI as a researcher and is co-founder and CEO of Deducto Limited, a startup applying reinforcement learning. He received a $10,000 grant from the Long-Term Future Fund in 2019 to upskill in machine learning and accelerate his contributions to AI safety research.

Funding for building agents with causal models of the world and using those models for impact minimization.

No summary available yet.

No summary available yet.

Victor Shepardson is a co-founder of the Berryville Institute of Machine Learning and a machine learning researcher and engineer whose work spans deep learning, music and interactive systems, including roles at Ntrepid and the University of Iceland’s Intelligent Instruments Lab. He co-authors BIML’s foundational papers on security engineering for machine learning and architectural risk analysis of ML systems.

No summary available yet.

No summary available yet.

No summary available yet.

Daniel Barcay is the executive director of the Center for Humane Technology and a co‑host of the podcast Your Undivided Attention. A technologist and former vice president of product at Planet Labs, he now focuses on how powerful technologies reshape human psychology, relationships, and control, drawing on experience in software engineering, strategy, and research fellowships.

No summary available yet.

No summary available yet.

Kane Nicholson is a Machine Learning Engineer at Leonardo AI (a Sydney-based generative AI platform acquired by Canva in 2024), based in Australia. He holds a Bachelor of Engineering from Queensland University of Technology (QUT) in Brisbane. Prior to his ML career, he worked as a Software Engineer at Reel Time Gaming and as a Programming Tutor at QUT Law Society. He received a Long-Term Future Fund grant equivalent to six months of salary to fund a career transition and upskilling period with the goal of entering AI safety work. Following this upskilling grant, he transitioned into machine learning engineering at Leonardo AI.

Scott Singer is a co-founder and strategic leader of the Oxford China Policy Lab and a fellow in the Technology and International Affairs Program at the Carnegie Endowment for International Peace, where he works on global AI development and governance with a focus on China. His research and policy work centre on US–China AI relations, structural risks in the US–China relationship, and emerging technology governance, and he has contributed to landmark reports including the California Report on Frontier AI Policy and the International AI Safety Report. Scott holds a PhD in International Relations from the University of Oxford, where he was a Clarendon Scholar, and previously worked for the U.S. State Department and U.S. Senate.

No summary available yet.

David Teter works with donors and partners at Open Philanthropy’s successor organization Coefficient Giving on high‑leverage work in AI and biosecurity; before joining, he helped start Ergo Impact, built a grants function at Effective Giving, and previously worked at BlackRock on long‑term growth and strategy.

Making sure AI systems don't mess up acausal interactions

No summary available yet.

No summary available yet.

Aryeh Englander is a mathematician and AI researcher at the Johns Hopkins University Applied Physics Laboratory (APL), where he focuses on AI safety and AI risk analysis. He is also pursuing a PhD in Information Systems at the University of Maryland, Baltimore County (UMBC), with research centered on decision and risk analysis under extreme uncertainty, particularly regarding potential existential risks from very advanced AI. In 2021, he received a $100,000 grant from the Long-Term Future Fund to replace income lost from reducing to half-time at APL in order to pursue his doctorate, with the rationale that a PhD would position him for greater leadership and influence over AI safety practices at a major federal research institution. He is a co-leader of the Modelling Transformative AI Risks (MTAIR) project alongside David Manheim and Daniel Eth, and co-authored the paper TanksWorld: A Multi-Agent Environment for AI Safety Research. Englander is an active contributor to the AI Alignment Forum, LessWrong, and EA Forum communities.

Funding a new computer for AI alignment work, specifically a summer PIBBSS fellowship and ML coding

Matt Beard is an advisor at 80,000 Hours, where he provides one‑on‑one career advising focused on high‑impact paths, especially in AI governance and policy. Before joining 80,000 Hours he worked as a legislative staffer on Canada’s National Security Committee, managed a Member of Parliament’s legislative office, and held policy analyst and grantmaking roles in the Canadian civil service. He holds an MA in political science and is based in Washington, DC.

Sören Mindermann is a machine learning researcher and AI safety scientist currently based in Montreal, where he is a postdoctoral researcher at Mila (Quebec Artificial Intelligence Institute) under Yoshua Bengio. He completed his DPhil (PhD) in machine learning at the University of Oxford (2019-2023), supervised by Yarin Gal at the OATML group and Allan Dafoe at the Centre for the Governance of AI, co-funded by Oxford and Google DeepMind. He also holds degrees in machine learning from UCL and in mathematics and Future Planet Studies from the University of Amsterdam. He served as the Scientific Lead of the first International AI Safety Report (2025), a comprehensive review of AI capabilities and risks backed by 33 nations, and is a Research Affiliate at the Oxford Martin AI Governance Initiative. His research covers AI safety evaluations, large language model honesty, data selection for large-scale deep learning, causal inference, and health applications of machine learning. Notable publications include co-authorship on "The Alignment Problem from a Deep Learning Perspective" (ICLR 2024), "Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training" (2024), and "Managing Extreme AI Risks amid Rapid Progress" (Science, 2024), as well as influential COVID-19 policy intervention studies published in Science and Nature Communications. He received funding from the Long-Term Future Fund for his AI strategy PhD at Oxford/FHI.

Professor Julia Powles is the Executive Director of the UCLA Institute for Technology, Law & Policy at UCLA School of Law and UCLA Samueli School of Engineering, and Tech Policy Lead for the university-wide UCLA DataX initiative. Her research and teaching focus on privacy, intellectual property, internet governance, and the law and politics of data, automation and artificial intelligence.

Ex product design @ whatsapp, neeva.

One-course teaching buyout for Steve Peterson for two academic semesters to work on the foundational issue of *agency* for AI safety