Database

No summary available yet.

Independent AI safety researcher building deterministic oversight, trace evaluation, and causal memory tools for agent systems.

12-month support for independent AI alignment research

Nathaniel Sharadin (Nate) is an Assistant Professor of Philosophy at the University of Hong Kong, where he teaches in the MA program in AI, Ethics, and Society. He received his PhD from UNC Chapel Hill under Geoffrey Sayre-McCord and Simon Blackburn, specializing in value theory. Prior to HKU, he held positions as Assistant Professor at The College of New Jersey, Sutton Faculty Fellow at Syracuse University, and Visiting Assistant Professor at Ohio State University. His research focuses on the moral, social, and political impacts of large-scale AI systems, including AI regulation, the ethics of AI research, and AI alignment. He co-founded the Hong Kong Ethics Lab, serves as a Principal Investigator in the AI & Humanity Lab at HKU, and is a Research Affiliate at the Center for AI Safety (2023 Philosophy Fellow). He has published op-eds on AI policy in outlets including the Bulletin of the Atomic Scientists and the South China Morning Post, and has appeared on BBC Radio and Bloomberg Radio London discussing AI risks.

A Washington, D.C.-based nonprofit that educates the public and policymakers about the risks of advanced AI and advocates for bipartisan safeguards.

No summary available yet.

A high-level international dialogue series that brings together leading AI scientists and governance experts to build consensus on managing extreme risks from frontier AI systems.

Programming language that enforces AI safety as runtime substrate properties rather than training-time alignment, already shipping on real hardware.

No summary available yet.

Free/Subsidized/Cheap office space outside of EU but in good timezones with favorable visa policies (especially for Chinese/Russian but also US&others near EU).

Advisor & Groups Lead at Probably Good with over a decade of experience in social impact, including nonprofit leadership, capacity-building, and philanthropic advising, and former director of a regional nonprofit helping people align their careers, time, and donations with impact.

3-week salaries for Sam, Eric, and Drake to work on reviewing various AI alignment agendas

Engineer at Fifty Years focused on deepening the firm’s AI tooling to identify and support the next generation of indispensable founders; previously led Data Science at Dyson, shipping production AI systems across multiple domains, and before that worked at Sky, BAE Systems, and Fidessa on data science and mission‑critical trading software.

No summary available yet.

Technical University of Munich (TUM) is one of Europe's leading research universities, with significant AI safety and reliable AI research programs including the Konrad Zuse School of Excellence in Reliable AI (relAI).

Founding Generalist at Kairos leading internal operations and grantmaking logistics, previously working in operations at METR and Open Philanthropy on nonprofit and grantmaking compliance, HR, and other administrative functions, with a background in community building and event planning.

Nathan Labenz is a technology entrepreneur and artificial intelligence analyst based in Detroit, Michigan. He is the founder and former CEO of Waymark, a generative AI-powered video advertising company, and has led it from inception to becoming a prominent example of applied generative AI. Nathan now focuses on AI full time as an "AI scout" and hosts The Cognitive Revolution podcast, where he explores how advances in AI are transforming work, society, and culture through in-depth interviews and analysis.

Czech national organization promoting effective altruism through community building, events, and project incubation, with a particular focus on AI safety and high-impact careers.

Matteo Pistillo is a Senior AI Governance Researcher and Advisor at Apollo Research, where he conducts technical governance and AI policy research focused on evaluations, internal deployment, loss‑of‑control risks, and security‑relevant standards for frontier AI systems. Before working full‑time in AI governance, he practised as an international commercial disputes lawyer at Cleary Gottlieb Steen & Hamilton and specialised in technology regulation as a Fulbright Scholar at Stanford Law School.

No summary available yet.

4 different projects (finding RLHF alignment failures, debate, improving CoT faithfulness, and model organisms)

Computational cognitive scientist @ Princeton, studying introspection in LLMs.

No summary available yet.

ML4Good runs intensive, fully-funded in-person bootcamps to train motivated people for careers in AI safety, covering both technical and governance tracks.

Research Manager at Rethink Priorities

American meditation teacher and researcher in awakening, author of The Science of Enlightenment and Natural Pain Relief, and creator of the Unified Mindfulness system, which has been used in collaborations with institutions such as Harvard Medical School, Carnegie Mellon University, and the University of Vermont in contemplative neuroscience research.

No summary available yet.

No summary available yet.

No summary available yet.

Retroactive funding for running an alignment theory mentorship program with Evan Hubinger

I like tweaking LLMs to understand their working

No summary available yet.

No summary available yet.

No summary available yet.

Rory Gillis is a UK-based AI policy professional currently serving as Senior Policy Adviser (AI International) at the UK Department for Science, Innovation and Technology (DSIT), where he focuses on the UK's international engagement on artificial intelligence. He holds an MPhil in Political Theory from the University of Oxford (Mansfield College) and a BSc in Politics and Philosophy from the London School of Economics and Political Science. Prior to joining DSIT, he worked as a Research Assistant and Project Support Officer at the Oxford Internet Institute, contributing to the Governance of Emerging Technologies (GET) programme under Professor Brent Mittelstadt and Professor Sandra Wachter. In that role, he co-authored written evidence submitted to UK parliamentary committees on AI regulation and co-authored the 2024 paper "Trust and Trustworthiness in Artificial Intelligence" (with Johann Laux and Brent Mittelstadt), which examines philosophical frameworks of trust and proposes recommendations for AI governance debates. He received a small research grant to map and offer a preliminary assessment of AI ideal governance research, reflecting his early-career focus on understanding the landscape of normative AI governance scholarship.

No summary available yet.

No summary available yet.

No summary available yet.

Nicolas Papernot is a computer scientist whose work focuses on the security and privacy of machine learning. He is a Canada CIFAR AI Chair based at the Vector Institute and a faculty member at the University of Toronto, and he serves as Co-Director of the Canadian AI Safety Institute Research Program at CIFAR.

Seeking funds to present “Benchmark Inflation” at ICML 2024, my paper on making AI progress measures more accurate

Nick Raushenbush is a founder, investor, and advisor to tech startups who co-founded the software company Shogun and the creative agency Glass + Marker, runs a small fund investing in Y Combinator companies, and advises startups as an operating partner at Halcyon.

Joseph Bloom is a mechanistic interpretability researcher who co-founded Decode Research / Neuronpedia and led development of the SAELens library for training sparse autoencoders. He is now Head of White Box Evaluations (model transparency) at the UK AI Security Institute, and has co-authored prominent work including Open Problems in Mechanistic Interpretability, SAEBench, and "Sparse Autoencoders Do Not Find Canonical Units of Analysis." Before joining AISI he worked as an independent AI safety researcher focusing on decision transformer interpretability.

No summary available yet.

Peter Ruschhaupt is a researcher and policy analyst with a background in electrochemical energy storage, who has been exploring a transition into AI governance. He holds a PhD from the Karlsruhe Institute of Technology (KIT) and Helmholtz Institute Ulm (HIU), where his research focused on binders and electrolytes for supercapacitors, and an MSc from Friedrich-Alexander University Erlangen-Nuremberg (FAU). He worked as a Cleantech Analyst at Future Cleantech Architects (FCA), a climate innovation think tank based in Germany, where he contributed to research and policy analysis on industrial decarbonization and energy storage. He received a grant from the Long-Term Future Fund to spend three months exploring career options in AI governance, including upskilling, networking, producing work samples, and applying for relevant positions.

Support for research into applied technical AI alignment work

No summary available yet.

The Schwartz Reisman Institute for Technology and Society (SRI) is a University of Toronto research institute that convenes experts across disciplines to ensure that powerful technologies like AI are responsible, inclusive, and beneficial to everyone.

Armielyn Obinguar is Chief Technology Officer and co‑founder of Safe, a fintech startup building escrow‑as‑a‑payment tools, and an AI community leader in Southeast Asia. She was recognized as a Women in AI APAC AI Humanitarian finalist in 2023 and collaborates with organizations such as UNICEF, the ITU and UNDP on projects that use AI to broaden access to education and promote inclusive development.

Founding Dean of Deep Science Ventures’ College, where he leads the Venture Science Doctorate, a three-year fully funded PhD program training commercially minded scientists to build moonshot companies addressing global challenges.