Open Philanthropy

AI Safety Retreat (Bin Yu)

$527,366

Research Group Support (Maksym Andriushchenko)

$12,000

to ELLIS Institute Tübingen

$1,000,000

New Methods for Estimating Rare Event Probabilities (Hongseok Namkoong)

to Timaeus

$1,540,000

to Columbia University

$451,159

Research on Diffuse Threat Models in AI Systems

to Arcadia Impact

$32,358

LLM Techniques for Generating and Verifying Code (Nada Amin)

Research on Jailbreaking in LLMs (Eugene Belilovsky and Geraldin Nanfack)

$653,431

$200,750

Covert Communication in LLMs (Yonatan Belinkov)

to Technion - Israel Institute of Technology

$365,378

Operating Expenses

to Collider

$800,000

Nonlinear Structure in Language Models (Melanie Weber)

Novel Method for Concept Unlearning (Sanmi Koyejo)

$36,700

Research on Steganographic Encoding (Jonathan May)

$420,482

to University of Southern California

$257,803

Robust Unlearning Evaluations (Roy Rinberg)

$124,300

Research on Chain-of-Thought Reasoning in LLMs (Liu Leqi)

to Simplex

$2,045,200

to University of Texas at Austin

$214,500

Mitigating Collusion in LLMs for Multi-Agent Security (Christian Schoeder de Witt)

Research on Unlearning Methods (Leo Schwinn)

$352,365

to Technical University of Munich

$325,600

Techniques to Mitigate Emergent Misalignment (Weiyan Shi)

Adversarial Reasoning Training (Aviral Kumar and Aditi Raghunathan)

$333,300

AI Evaluation and Testing

$466,183

Encoded Reasoning Project

$10,000,000

to Poseidon Research

$640,200

AI Safety Research and Field-building

to FAR AI

$28,675,000

Off-target Effects of Fine-tuning in LLMs (Aly Kassem and Golnoosh Farnadi)

to Mila

$195,800

Work to Mitigate AI Agent Sandbagging (Rui Zhang)

to Penn State University

$166,078

Emergent Collusion Project (Kaiqing Zhang)

Modularized Reasoning Language Models (Alane Suhr)

$280,500

Research on Realistic Alignment Faking

$310,200

to Meridian Cambridge

$561,000

Research on Emergent Misalignment (Scott Niekum)

to University of Massachusetts Amherst

$426,371

Research on LLM Rare Event Estimation (Scott Niekum)

to University of Massachusetts Amherst

$293,427

Study on Backdoors in AI Agents (Anudeep Das, Gurjot Singh, Pract Chantasantitam)

to University of Waterloo

$58,100

Alignment Faking Experiments (Lu Wang)

to University of Michigan

$637,755

Reasoning in LLMs (Yiqiao Zhong)

to University of Wisconsin–Madison

$200,200

Latent Adversarial Training Method (Yu Meng)

to University of Virginia

$482,350

Neural Network Context Learning and Generalization (Zohar Ringel)

to Hebrew University of Jerusalem

$82,000

Mechanistic Interpretability in Clinical Settings (Byron Wallace)

Mechanistic Interpretability Research (Danilo Bzdok)

$800,000

to Mila

$310,000

AI Safety and Alignment Initiatives (Schwartz Reisman Institute for Technology and Society)

to BlueDot Impact

$25,649,888

to University of Toronto

$700,000

Study on Frontier Model Behavior (Emma Pierson)

AI Security and Stability Program

$499,597

AI Governance Research Fellowship

$8,324,325

to Arcadia Impact

$540,344

AI Governance Workshop

to International Conference on Machine Learning

$12,545

Study on Encoded Reasoning in LLMs (Tom Goldstein, Ashwinee Panda)

$2,800,000

Research on Emergent Misalignment

$218,000

to Meridian Cambridge

$396,000

Secure Enclaves for LLM Evaluation

to OpenMined

$10,943,400

Research on Avoiding Encoded Reasoning in LLMs

to Meridian Cambridge

$244,614

Research on Prompt Injection Attacks (Xin Chen, Florian Tramer)

to ETH Zürich

$20,000

Robust AI Benchmarks (Tatsunori Hashimoto)

Governance of AI Lab (Noam Kolt)

$1,922,145

to Hebrew University of Jerusalem

$2,724,999

Cybersecurity Bootcamp

Cyberoffense Benchmark (Dawn Song)

$223,134

$3,390,000

Emerging Technology Initiatives

to Kairos Project

$195,000

AI for Formal Software Verification (Contract)

$2,500,000

to Theorem Labs

$1,000,000

Robust AI Unlearning Techniques (Virginia Smith, Steven Wu)

$584,108

$1,000,000

2025 Summer Fellowship

Robust AI Unlearning Techniques (Sijia Liu, Shiyu Chang, Mingyi Hong)

$350,000

to Michigan State University

$484,000

Research Exploration

to Atlas Computing

$100,000

AI Safety Summer Fellowship

to PIBBSS

$1,686,289

AI Safety Research Collaborations

to Palisade Research

$2,123,463

to Redwood Research

$1,100,000

Compute Resources for AI Safety Research (Jacob Steinhardt)

Conference on Artificial General Intelligence

$2,587,634

$140,000

$32,786,000

AI Governance Workshop

Research on AI Safety and Computational Complexity Theory (Scott Aaronson)

$56,915

to University of Texas at Austin

$1,650,000

AI Safety and Governance Work

to Association for Long Term Existence and Resilience (ALTER)

$309,257

LLM Hacking Benchmarks

to Daniel Kang

$265,000

AI Communications and Outreach

to FAR AI

$2,420,253

AI Field Building

to FAR AI

$6,650,000

Course Buyouts (Anqi Liu)

to Johns Hopkins University

$94,600

to Carnegie Endowment for International Peace

$443,732

AI Governance Retreat

to Arb Research

$70,000

AI Governance Field-Building

to Talos Network

$1,493,840

to Institute for AI Policy and Strategy

$11,510,081

AI Interpretability Research (Christopher Potts)

Transformative AI Summer Program (Philip Trammell)

$743,500

AI Safety Conference

to Epistea

$200,000

$165,000

AI Benchmark Improvements

to SeedAI

$1,610,178

to SecureBio

$37,000

Leadership Training Program

$500,000

AI Biological Capabilities Dashboard

to SecureBio

$58,450

AI Chip Export Control Initiative (Philip Reiner, Steve Kelly)

to Institute for Security and Technology

$240,597

Research Scholarships

to AI Safety Argentina

$77,000

AI Standards Report (Colin Kahl)

AI Safety Research Expenses

$387,500

Mechanistic Interpretability Course Development

$6,880,000

to Sincxpress Education

$30,000

FrontierMath Benchmark Improvements

to Tarbell Center for AI Journalism

$70,000

Operating Costs

$2,888,000

Oxford AI Governance Initiative

$1,647,005

$5,423,018

AI Safety Competition Prizes

$2,995,207

to Berkeley Center for Responsible, Decentralized Intelligence

$20,000

Global Catastrophic Risks Advocacy

to Global Shield

$2,320,000

Zero-knowledge Proofs for Secure AI Audits (Daniel Kang)

AI Governance Field-building

$615,000

$441,613

InterACT Lab (Anca Dragan)

$4,132,488

AI Red-teaming Bootcamp (Andrew Reddie)

$775,000

to Oxford AI Safety Initiative

$100,000

Office Access

$18,309

InterACT Lab (Anca Dragan)

$59,400

Operating Costs and EU Tech Policy Fellowship

$1,000,000

Operating Expenses

to Timaeus

$1,557,000

AI Alignment Hackathons

to Apart Research

$161,280

to Training For Good

$461,069

AI Safety Bootcamps

to ML4Good

$140,382

AI Fellowships

to ERA

$2,505,245

AI Safety Research Expenses

$3,600,000

Global Catastrophic Risks Advocacy

$660,000

to Good Ancestors Policy

$580,236

AI Safety Research (Christian Tarsney, Brad Knox)

to University of Texas at Austin

$885,000

Research on AI Benchmarks

to Daniel Kang

$701,000

AI Safety Coworking Space

to Trajectory Labs

$250,087

Cybersecurity Bootcamp

$42,807

Operating Costs

to Cambridge AI Safety Hub

$589,903

$400,000

AI Cybersecurity Project (Brianna Rosen, Ciaran Martin)

$600,000

$264,666

to Tarbell Center for AI Journalism

$816,000

AI 2025 Forecasting Questions (Contract)

to Sage Future

$7,275

AI Governance Initiatives

to Tony Blair Institute for Global Change

$636,000

Shallow Review of AI Safety Research

to Arb Research

$5,000

AI Safety Capacity Building

to AI Safety Hungary

$22,450

NeurIPS Prizes

to Virtue AI

$30,000

Analytical Chemistry Benchmark (Kevin Jablonka)

to Friedrich Schiller University Jena

$828,979

AI Safety University Group Support

to Kairos Project

$886,285

AI Risk Explorer

to Observatorio de Riesgos Catastróficos Globales

$212,510

AI Law Field Building

to Vista Institute for AI Policy

$846,265

Student AI Safety Groups

to Langsikt - Centre for Long-Term Policy

$1,170,000

AI Safety Advocacy

$660,000

AI Takeoff Speeds Paper (Cameron Domenico Kirk-Giannini)

$26,675

Tripwire Capability Evaluations

$358,850

$2,500,000

MATS Program Extension

Australian AI Safety Forum

$709,567

to Gradient Institute

$20,000

Oxford Martin AI Governance Initiative

AI Progress Forecasting Panel

$35,000

to Effective Institutions Project

$1,071,000

Abundance Conference

$10,000

AI Governance Work

$400,000

AI R&D Benchmark (Arvind Narayanan)

to Princeton University

$863,143

Cybersecurity Services

to Wavefront Security

$206,464

LLM Cybersecurity Benchmark (Yizheng Chen)

Algorithmic Alignment Group

$1,721,079

LLM Research Replication (Jakob Foerster)

$30,000

LLM Adversarial Attacks Benchmark (Florian Tramér)

$622,167

to ETH Zürich

$130,000

Interpretability Work

to Practical AI Alignment and Interpretability Research Group

$737,000

to Center for Responsible Innovation

$3,000,000

Software Engineering Benchmark (Koushik Sen)

Research Mentorship Program

$739,866

to Supervised Program for Alignment Research

$189,350

to Americans for Responsible Innovation

$3,000,000

Language Model Capabilities Benchmarking

to Algorithmic Research Group

$1,052,500

to Centre for Long-Term Resilience (CLTR)

$5,119,246

Technology and Security Policy Center

AI Research and Governance Workshop

$6,000,000

AI Safety Policy Research and Advocacy (Exit Grant)

$78,000

to Foundation for American Innovation

$423,500

Data Science Benchmark (Lorenzo Pacchiardi, José Hernández-Orallo, Lucy Cheke)

$517,693

Economics Research on AI Model Scaling Effects

to Talos Network

$662,378

to Ali Merali

$54,650

AI Alignment Research Projects

to FAR AI

$2,400,000

LLM Model-Based Planning Report

$739,105

to Jennifer Lin

$70,000

LLM Cybersecurity Benchmark (Alex Leader, Dan Zhao, He He)

$318,272

to New York University

$2,077,350

LLM Research Benchmark

$1,700,000

LLM Cybersecurity Benchmark (Percy Liang)

LLM Research Benchmark (Najoung Kim, Sebastian Schuster)

$2,937,000

to Boston University

$756,396

Global AI Risks Initiative

to Centre for International Governance Innovation

$300,000

Emerging Technology Initiatives

Legal Automation Benchmark (Dongyeop Kang)

$5,000,000

to University of Minnesota, Twin Cities

$74,132

LLM Persuasiveness Evaluation (Josh Kalla)

to Yale University

$596,200

Programmatic Activities and Operating Expenses

$16,750,000

$1,680,000

to FAR AI

$12,000,000

LLM Moneymaking Benchmark

to Harmony Intelligence

$54,270

LLM Use Case Database (William Wang)

to University of California, Santa Barbara

$133,402

MATS Program 6.0 + 7.0

$3,382,029

AI Safety Research

to Mila

$2,000,000

MATS Program 6.0 + 7.0

Software Engineering LLM Benchmark (Karthik Narasimhan)

$2,381,609

to Princeton University

$1,045,620

Information Security Talent Development

to Effective Altruism Israel

$139,228

Large Language Model Interpretability Research (David Bau)

LLM-Generated Research Ideation Benchmark (Tatsunori Hashimoto)

$1,095,017

Wargame for AI Documentary

$880,000

to Faculty AI

$92,597

LLM Use Case Database (Hong Shen, Fei Fang)

AI Systems Course (Ponnurangam Kumaraguru)

$266,805

Forecasting Tournaments

to Metaculus

$532,400

to International Institute of Information Technology Hyderabad

$7,000

AI Explainers

to Sage Future

$550,000

AI Standards and Risk Management Frameworks

$200,000

$2,178,700

Scalable Oversight Research (Dimitris Papailiopoulos)

$115,887

to University of Wisconsin–Madison

$100,000

to Institute for AI Policy and Strategy

$828,049

AI for Epistemics Workshop

$21,060

AI Safety Retreat

to EA Netherlands

$25,000

Scalable Oversight Research (Jason Lee)

to FAR AI

$2,160,000

FAR Labs Office Space

to FAR AI

$1,700,000

AI Field Building

to FAR AI

$1,800,000

to Princeton University

$100,000

AI Persuasiveness Evaluation (Benjamin Bergen)

to Constellation

$3,200,000

to University of California, San Diego

$470,731

Forecasting Benchmark

AI Policy Development and Related Events

$100,000

to SeedAI

$1,500,000

Red-line Evaluations

Emerging Technology Fellowships and Research

$125,000

to London AI Safety Research (LASR) Labs

$2,500,000

Fellowship Program

$288,732

to Simon Institute for Longterm Governance

$1,461,194

Latent Adversarial Training Project

Benchmark for Web-Based Tasks (Graham Neubig)

$45,000

Benchmarks for Biology Research and Development

$547,452

$2,946,250

AI Policy Work

to Observatorio de Riesgos Catastróficos Globales

$110,000

Benchmark for Language Model Forecasting

to FutureSearch

$606,600

to Institute for Law & AI (LawAI)

$300,000

London Coworking Space

Large Language Model Replication Games

$821,248

$174,112

Scalable Oversight Research (Samet Oymak)

to University of Michigan

$100,000

AI Governance Legal Research (Gabriel Weil)

to Touro College & University System

$19,783

LLM Cyberoffense Benchmark

to Straumli

$400,000

AI Risk Management Frameworks

AI Risk Management Frameworks

$713,000

to Center for Long-Term Cybersecurity

$200,000

LLM Misuse Database

to Lee Foster

$223,000

Cambridge AI Fellowship

to ERA

$767,585

AI Interpretability, Controllability, and Safety Research (Martin Wattenberg, Fernanda Viégas)

AI Alignment Research Projects

$1,000,000

to FAR AI

$645,750

CHAI Internships

$1,050,000

AI Documentary

to Nice Light

$127,070

to Institute for AI Policy and Strategy

$3,011,895

Astra Fellowship

LLM Hacking Benchmarks (Daniel Kang)

$617,000

AI Research and Governance Workshop

$800,000

General Support for MIT AI Alignment

$66,950

Operating Expenses

to Safe AI Forum

$1,167,513

Machine Learning Research Support

$612,470

to ETH Zurich Fondation (USA)

$25,000

Machine Learning and AI Safety Bootcamps

to ML4Good

$104,803

Harvard AI Safety Team

AI Economic Impacts Workshop

$550,000

$120,000

to EleutherAI

$2,642,273

$98,186

MATS Program

$732,631

MATS

$2,641,368

$237,000

AI Alignment Workshop

University Collaboration Program

$26,000

General Support (Exit Grant)

$70,000

Emerging Technology Initiatives

$1,866,559

Mechanistic Interpretability Research (David Bau)

$10,500,000

Operating Costs and Tarbell Fellowship

$116,072

to Training For Good

$999,000

Software for AI Audits

to OpenMined

$6,000,000

Alignment Workshop

to FAR AI

$166,500

Language Model Capabilities Benchmarking

to Matthew Kenney

$397,350

Data Production for AI Safety Research (Contract)

to Surge AI

$126,250

HAIST Office Space

AI Governance Roundtables (Peter Conti-Brown)

$151,678

to University of Pennsylvania

$110,000

Scalable Oversight Dataset

AI Safety Communications Centre

$70,000

to Effective Ventures Foundation

$288,000

ITAM AI Futures Fellowship

to Angela Aristizábal

$390,155

Open Access Interpretability Project

to Guide Labs

$750,000

AI Safety Bootcamp

to Swiss AI Safety Summer Camp

$51,248

Law & AI Summer Research Fellowship

to Institute for Law & AI (LawAI)

$75,000

AI Safety Research

to Modulo Research

$408,255

AI Research and Governance Workshop

Research on Neural Network Generalization (Tom Goldstein)

$38,220

$350,000

Expert Survey on Progress in AI

$620,000

Course on Human-AI Alignment (Daniel Brown)

$345,000

to University of Utah

$31,773

$2,911,324

Lab Retreat

$35,000

to FAR AI

$460,000

SERI MATS 4.0

AI Safety Policy Advocacy

$428,942

to Foundation for American Innovation

$552,500

$1,240,840

$5,300,000

$1,535,480

AI Evaluations Research (Owain Evans)

to Effective Ventures Foundation

$1,652,076

Research on Complementary AI (Chenhao Tan)

to University of Chicago

$250,000

Workshop on Human-Level AI

$146,165

to Mila

$50,000

$3,000,000

$223,569

$154,810

$6,922,565

Policy Fellowship

Language Model Evaluations (Percy Liang)

$312,959

$250,000

SERI MATS

AI Alignment Research (Daniel Brown)

$245,000

to University of Utah

$140,000

$4,025,729

to Leap Labs

$230,000

AI Governance Workshop

Safe Learning-Enabled Systems

$302,390

to National Science Foundation

$5,000,000

Emerging Technology Fellowships and Research

Situational Awareness Research

$5,500,000

AI Interpretability Research

$443,716

to FAR AI

$100,000

AI Alignment Research (Ben Levinstein)

$80,000

AI Safety Field-Building

to Cambridge Effective Altruism

$387,741

FAR Labs Office Space

to FAR AI

$280,000

AI Safety Labs

$25,239

AI Safety Summer Fellowship

to PIBBSS

$239,000

AI Research (Yan Zhang)

$39,000

AI Policy Development at the OECD

to Longview Philanthropy

$770,076

AI Worldview Investigations

Adversarial Robustness Research (Matthias Bethge)

$188,558

to University of Tübingen

$575,000

Psychology Research

to Brian Christian

$37,903

AI Safety Research (Lionel Levine)

to Cornell University

$342,645

MIT Office Space

$143,751

Law, Ethics, and AI Course Development (Federico Faroldi)

$18,800

to University of Pavia

$23,245

Philosophy Fellowship and NeurIPS Prizes

to Responsible AI Collaborative

$1,433,000

Staff Support

to Arb Research

$25,000

AI Incident Database

$100,000

Machine Learning Bootcamps

$284,629

Alignment Research (Toryn Klassen)

to Neel Nanda

$70,000

AI Safety Retreat

to Jeremy Rubinoff

$16,587

to University of Toronto

$80,000

Independent AI Alignment Research

to Adam Jermyn

$19,231

Adversarial Robustness Research (Cihang Xie)

to University of California, Santa Cruz

$114,000

AI Alignment Research (Jeff Clune)

to University of British Columbia

$100,375

AI Alignment Bootcamp

to Lausanne AI Alignment

$21,092

AI Risk Workshop

to Simon McGregor

$7,000

Language Model Research (Xiangyu Zhang)

to Purdue University

$170,000

to FAR AI

$625,000

Inverse Scaling Prize

to FAR AI

$49,500

AI Alignment Hackathons

to Apart Research

$89,000

Independent AI Alignment Research

to FAR AI

$50,000

to Jérémy Scheurer

$110,000

Policy Fellowship

to Georgetown University

$239,061

Large Language Model Interpretability Research (David Bau)

$562,128

$47,359

$1,538,000

to Alignment Research Center

$1,250,000

AI Alignment Research

to Jacob Steinhardt

$100,000

Independent AI Journalism

$5,160,000

to Mordechai Rorvig

$110,000

Machine Learning Alignment Theory Scholars

$2,047,268

SERI MATS Program in London

$100,000

OxAI Safety Hub

to Catherine Brewer

$11,622

Foundation Model Tracker

to Thomas Liao

$15,000

$457,380

Research Assistant

Compute Strategy Workshop

$19,200

Shutdown Problem Contest

to AI Alignment Awards

$75,000

to Centre for Effective Altruism (CEA)

$50,532

Startup Costs

to AI Safety Hub

$203,959

Harvard AI Safety Office

$250,000

Language Model Misalignment

to FAR AI

$463,693

Adversarial Robustness Research (Chaowei Xiao)

to Arizona State University

$200,000

Effective Altruism Debate Camp

to Redwood Research

$10,700,000

AI Alignment Projects

to Daniel Dewey

$175,000

to Apollo Fellowship

$321,838

Philosophy of AI Course Development (Jared Moore)

to University of Washington

$15,524

Research on Adversarial Examples (Aditi Raghunathan)

$343,235

Work on AI Governance

AI Alignment Research (Clark Barrett, Scott Viteri)

$5,149,398

Language Model Alignment Research

$153,820

$40,000

$1,960,000

$364,893

SERI Summer Fellowships

Research on Privacy-Enhancing Technologies and AI Safety

$400,000

to OpenMined

$28,320

AI Standards

$210,000

2022 Class

AI Standards (Center for Long-Term Cybsecurity)

$1,840,000

Project Expenses for Deep Learning Projects

$20,000

to Funding for AI Alignment Projects Working With Deep Learning Systems

$16,604,737

SERI MATS Program

Research on Trends in Machine Learning (Jaime Sevilla)

$1,008,127

Course Development Support (Ben Levinstein)

$42,000

David Krueger Collaboration

$58,141

$140,050

to Carnegie Endowment for International Peace

$597,717

Research Collaboration with David Krueger

to Usman Anwar

$6,526

Compute Cluster for AI Safety Research

to Hofvarpnir Studios

$1,443,540

$2,728,319

Research Collaboration with David Krueger

$13,277,348

to Egor Krasheninnikov

$6,526

AI Policy Analysis

to Stiftung Neue Verantwortung

$444,000

to Alignment Research Center

$265,000

Work and Study Support

$113,372

CHAI Collaboration

Safety-Critical Machine Learning

$1,126,160

to National Academies of Sciences, Engineering, and Medicine

$309,441

2022 Cohort

to Open Philanthropy Technology Policy Fellowship

$2,869,940

AI Policy Training Program

$2,011,251

AI Field Building

$2,537,600

Policy Fellowship

to Georgetown University

$246,564

AI Alignment Research (Percy Liang)

to Redwood Research

$9,420,000

Research Project on Artificial Intelligence

$1,500,000

to Mila

$237,931

SERI MATS Program

Language Model Misalignment

$195,000

to FAR AI

$425,800

Adversarial Robustness Research (Ludwig Schmidt)

to University of Washington

$730,000

High School Courses on Neural Networks

$250,275

AI Index

Research Project on Artificial Intelligence

$78,000

to Université de Montréal

$210,552

Risks from Militarized AI

Adversarial Robustness Research (Aditi Raghunathan)

$101,187

Adversarial Robustness Research (Robin Jia)

$87,829

to University of Southern California

$320,000

Adversarial Robustness Research (Dimitris Tsipras)

Adversarial Robustness Research (Shibani Santurkar)

$330,792

$330,792

to Center for Security and Emerging Technology

$38,920,000

AI Standards

$300,000

AI Standards

AI and Strategic Stability

$25,000

to Center for International Security and Cooperation

$365,361

Report on Security Clearances

to Applied Research Laboratory for Intelligence and Security

$70,000

MineRL BASALT Competition

AI Governance Research (Contract)

$70,000

Adversarial Robustness Research (Zico Kolter)

$612,185

Farm Animal Welfare in Southeast Asia and Latin America

$330,000

$650,000

Machine Learning Self-Study

$19,200

AI Alignment Project

to Daniel Dewey

$175,000

2021 Class

AI Policy Training Program

$1,000,000

Machine Learning Research (David Krueger)

$291,214

to University of Cambridge

$250,000

Security and Safety in Machine Learning Systems Workshop

to International Conference on Learning Representations

$3,000

The Alignment Problem Book Promotion (Contract)

to Brian Christian

$60,859

SERI Summer Fellowships

Adversarial Robustness Research (David Wagner)

$210,000

Adversarial Robustness Research (Dawn Song)

$330,000

Robustness Research (Wieland Brendel)

$330,000

to University of Tübingen

$590,000

Adversarial Robustness Research (Matthias Hein)

to University of Tübingen

$300,000

Adversarial Robustness Research (Aleksander Madry)

$1,430,000

to Center for Security and Emerging Technology

$8,000,000

Center for Human-Compatible Artificial Intelligence

Machine Learning Security Research (Gary McGraw)

$11,955,246

to Berryville Institute of Machine Learning

$150,000

Adversarial Robustness Research (Cihang Xie)

to University of California, Santa Cruz

$265,000

Machine Learning Research (Chris Maddison)

to University of Toronto

$520,000

$550,688

$50,000

AI and Security Projects

$116,744

AI Governance Projects

Participatory Approaches to Machine Learning Workshop

$24,350

to Smitha Milli

$370

AI Accident Risk and Technology Competition

to Center for International Security and Cooperation

$67,000

AI Accident Risk and Technology Competition (Contract)

to Rice, Hadley, Gates & Manuel LLC

$25,000

AI Accident Risk and Technology Competition

to Center for Strategic and International Studies

$118,307

AI Policy Seminar Series

Paper on Machine Learning Model Robustness

$496,540

to Andrew Lohn

$15,000

Machine Learning Paper Awards

$450,000

to International Conference on Learning Representations

$3,500

2020 Class

Global AI Council Workshop

$2,300,000

to World Economic Forum

$50,000

Neural Network Training and Performance (Jared Kaplan, Brice Ménard)

to Johns Hopkins University

$55,000

Scholarship Support

to Study and Training Related to AI Policy Careers

$593,540

Report on Assurance in Machine Learning Systems (Contract)

$540,000

AI Policy Seminar Series

$368,440

AI Safety Seminar (Dorsa Sadigh)

$7,703,750

$6,500

Research on the State of AI Assurance Methods

$150,000

Support for Human Compatible

$30,751

$17,000

AI Safety Research (Jacob Steinhardt)

to Ought

$1,593,333

$1,111,000

Center for Human-Compatible AI

to Ought

$1,000,000

$200,000

CHAI Collaboration

$705,000

2019 Class

$2,325,000

Center for Security and Emerging Technology

$2,652,500

to Center for Security and Emerging Technology

$55,000,000

CHAI ML Engineers

Study of the Robustness of Machine Learning Models (Contract)

$250,000

to Daniel Kang

$2,351

AI Safety Research (Pieter Abbeel, Aviv Tamar)

Outreach on Technological Risk Led by Richard Danzig

$1,145,000

Workshop on Goal Specifications for Reinforcement Learning

$400,352

to GoalsRL

$7,500

Machine Learning Security Research (Dan Boneh, Florian Tramer)

$100,000

AI Policy Seminar Series

Research on the Global Politics of AI (Allan Dafoe)

$400,000

AI Safety Retraining Program

$429,770

$150,000

$100,000

2018 Class

$1,245,000

NIPS Workshop on Machine Learning Security

to Ought

$525,000

$6,771

Scholarship Support

to AI Scholarships

$159,000

AI Safety Research (Sergey Levine, Anca Dragan)

$3,750,000

Technological Risks and National Security

$1,450,016

Core Support and CHAI Collaboration

$260,000

Research on the Global Politics of AI (Allan Dafoe)

$403,890

to Yale University

$299,320

AI Safety Research

to Mila

$2,400,000

AI Governance Work (Edward Parson, Richard Re)

to UCLA School of Law

$1,536,222

Support for Percy Liang

$1,337,600

to OpenAI

$30,000,000

to Distill Prize for Clarity in Machine Learning

$25,000

Percy Liang Planning Grant

$25,000

to Future of Humanity Institute (FHI)

$1,995,425

Artificial Intelligence Scenarios and Social Impacts

$32,000

to Electronic Frontier Foundation

$199,000

Center for Human-Compatible AI

$500,000