Database

Matteo Pistillo is a Senior AI Governance Researcher and Advisor at Apollo Research, where he conducts technical governance and AI policy research focused on evaluations, internal deployment, loss‑of‑control risks, and security‑relevant standards for frontier AI systems. Before working full‑time in AI governance, he practised as an international commercial disputes lawyer at Cleary Gottlieb Steen & Hamilton and specialised in technology regulation as a Fulbright Scholar at Stanford Law School.

No summary available yet.

4 different projects (finding RLHF alignment failures, debate, improving CoT faithfulness, and model organisms)

Computational cognitive scientist @ Princeton, studying introspection in LLMs.

No summary available yet.

American meditation teacher and researcher in awakening, author of The Science of Enlightenment and Natural Pain Relief, and creator of the Unified Mindfulness system, which has been used in collaborations with institutions such as Harvard Medical School, Carnegie Mellon University, and the University of Vermont in contemplative neuroscience research.

No summary available yet.

No summary available yet.

No summary available yet.

Retroactive funding for running an alignment theory mentorship program with Evan Hubinger

I like tweaking LLMs to understand their working

No summary available yet.

No summary available yet.

No summary available yet.

Rory Gillis is a UK-based AI policy professional currently serving as Senior Policy Adviser (AI International) at the UK Department for Science, Innovation and Technology (DSIT), where he focuses on the UK's international engagement on artificial intelligence. He holds an MPhil in Political Theory from the University of Oxford (Mansfield College) and a BSc in Politics and Philosophy from the London School of Economics and Political Science. Prior to joining DSIT, he worked as a Research Assistant and Project Support Officer at the Oxford Internet Institute, contributing to the Governance of Emerging Technologies (GET) programme under Professor Brent Mittelstadt and Professor Sandra Wachter. In that role, he co-authored written evidence submitted to UK parliamentary committees on AI regulation and co-authored the 2024 paper "Trust and Trustworthiness in Artificial Intelligence" (with Johann Laux and Brent Mittelstadt), which examines philosophical frameworks of trust and proposes recommendations for AI governance debates. He received a small research grant to map and offer a preliminary assessment of AI ideal governance research, reflecting his early-career focus on understanding the landscape of normative AI governance scholarship.

No summary available yet.

No summary available yet.

No summary available yet.

Nicolas Papernot is a computer scientist whose work focuses on the security and privacy of machine learning. He is a Canada CIFAR AI Chair based at the Vector Institute and a faculty member at the University of Toronto, and he serves as Co-Director of the Canadian AI Safety Institute Research Program at CIFAR.

Seeking funds to present “Benchmark Inflation” at ICML 2024, my paper on making AI progress measures more accurate

Nick Raushenbush is a founder, investor, and advisor to tech startups who co-founded the software company Shogun and the creative agency Glass + Marker, runs a small fund investing in Y Combinator companies, and advises startups as an operating partner at Halcyon.

Joseph Bloom is a mechanistic interpretability researcher who co-founded Decode Research / Neuronpedia and led development of the SAELens library for training sparse autoencoders. He is now Head of White Box Evaluations (model transparency) at the UK AI Security Institute, and has co-authored prominent work including Open Problems in Mechanistic Interpretability, SAEBench, and "Sparse Autoencoders Do Not Find Canonical Units of Analysis." Before joining AISI he worked as an independent AI safety researcher focusing on decision transformer interpretability.

No summary available yet.

Peter Ruschhaupt is a researcher and policy analyst with a background in electrochemical energy storage, who has been exploring a transition into AI governance. He holds a PhD from the Karlsruhe Institute of Technology (KIT) and Helmholtz Institute Ulm (HIU), where his research focused on binders and electrolytes for supercapacitors, and an MSc from Friedrich-Alexander University Erlangen-Nuremberg (FAU). He worked as a Cleantech Analyst at Future Cleantech Architects (FCA), a climate innovation think tank based in Germany, where he contributed to research and policy analysis on industrial decarbonization and energy storage. He received a grant from the Long-Term Future Fund to spend three months exploring career options in AI governance, including upskilling, networking, producing work samples, and applying for relevant positions.

Support for research into applied technical AI alignment work

No summary available yet.

Armielyn Obinguar is Chief Technology Officer and co‑founder of Safe, a fintech startup building escrow‑as‑a‑payment tools, and an AI community leader in Southeast Asia. She was recognized as a Women in AI APAC AI Humanitarian finalist in 2023 and collaborates with organizations such as UNICEF, the ITU and UNDP on projects that use AI to broaden access to education and promote inclusive development.

Founding Dean of Deep Science Ventures’ College, where he leads the Venture Science Doctorate, a three-year fully funded PhD program training commercially minded scientists to build moonshot companies addressing global challenges.

No summary available yet.

Acting Director at AI Impacts, research engineer at Palisade

No summary available yet.

2 month funding to get into mechanistic interpretability and to do 2-3 projects, than learn briefly related fields

2-6 months' stipend to financially cover my self-development in Machine Learning for alignment work

Vass Bednar is a CIGI senior fellow and managing director of the Canadian Shield Institute whose work sits at the intersection of technology and public policy; she previously led McMaster University’s MPP in Digital Society program and writes the "regs to riches" policy newsletter.

No summary available yet.

Alex is a Community Engagement Coordinator at Giving What We Can, growing the community of pledgers through high‑touch personal outreach and one‑on‑one relationships and helping people explore what meaningful impact looks like for them. Before joining GWWC, he spent a year focused on personal development through travel, entrepreneurship and volunteer work, launched his own business, and gained experience at Natixis Investment Managers during his placement year. He holds a First Class Honours degree in International Relations from Loughborough University.

No summary available yet.

Dr. Jan Kinne is a researcher in the Economics of Innovation and Industrial Dynamics unit at ZEW – Leibniz Centre for European Economic Research in Mannheim and co-founder and CEO of ISTARI.AI, where he develops AI-based web-mining methods for firm- and innovation-level analysis. He studied geoinformatics at Heidelberg University and Loughborough University and earned a doctorate (Dr. rer. nat.) from the University of Salzburg on web-based innovation indicators.

Supporting aspiring researchers of AI alignment to boost themselves into productivity

Independent Researcher

Jack Wildman is a senior software engineer at FutureSearch. He holds a PhD in Materials Physics from Heriot-Watt University and previously worked as a senior software engineer at Metaculus and as a development team lead at Ito World.

Arjun Panickssery is an AI safety researcher and entrepreneur based in the San Francisco Bay Area. He studied at the University of Illinois at Urbana-Champaign and has been active in AI alignment research through multiple programs and institutions. He participated in MATS (Machine Learning Alignment Theory Scholars), including an extension phase in London, where his research on the safety implications of LLM self-recognition produced the widely-cited paper "LLM Evaluators Recognize and Favor Their Own Generations" (co-authored with Samuel R. Bowman and Shi Feng), which demonstrated that frontier models such as GPT-4 can recognize their own outputs and exhibit self-preference bias that could undermine safety techniques like reward modeling and constitutional AI. He subsequently worked on scalable oversight benchmarks as part of MATS Summer 2024 and previously held roles at METR Evals and an AI risks organization. He is also building Zembla, an AI-powered platform for accelerated, individualized learning, and writes frequently about AI tutoring and education research.

No summary available yet.

Let's warn millions of people about the near-term AI extinction threat by directly & proactively explaining the issue in every context where it belongs

Anand Srinivasan is a mathematician and researcher currently pursuing a PhD at the University of Cambridge in the Department of Applied Mathematics and Theoretical Physics (DAMTP), where he works in the Biological Physics and Mechanics group on active matter and distributed control systems. He holds a BS in Mathematics from MIT, where he worked on Ising models for image classification and fuzzy manifold learning (independently published at NeurIPS). He co-founded AlphaSheets, a cloud-based spreadsheet startup, and served as CTO managing a six-person engineering team from 2015 to 2019. Upon leaving the company, he redirected his focus toward AI safety research, receiving a $30,000 grant from the Long-Term Future Fund in 2019 for independent deconfusion work titled "Formalizing perceptual complexity with application to safe intelligence amplification," which aimed to develop a framework enabling provable claims about what AI systems can and cannot internally represent based on their architectures and training processes. He has since published research on contracting dynamical systems in Banach spaces with MIT's Jean-Jacques Slotine, and has worked as a senior research software engineer at Harvard University Research Computing.

Emerson Spartz is the co-founder of Nonlinear and a serial media entrepreneur. Before his EA work he founded the viral media company Dose, after earlier creating more than twenty large viral content sites that attracted tens of millions of monthly visitors, and at age twelve he founded MuggleNet, a leading Harry Potter fan site. His work in digital media led to recognition on Forbes and Inc. "30 Under 30" lists.

Jerome C. Glenn is co-founder and Executive Director/CEO of The Millennium Project, a leading global futures research think tank established in 1996. He has over 50 years of experience in futures research, is lead author of the State of the Future report series, chairs the High-Level Expert AGI Panel for the UN Council of Presidents of the General Assembly, and previously served as executive director of the American Council for the United Nations University.

No summary available yet.