Center for AI Risk Management & Alignment (CARMA)
The Center for AI Risk Management & Alignment (CARMA) conducts interdisciplinary research and policy development aimed at safely managing the progression of rapidly advancing artificial intelligence. Founded in 2022 and led by Executive Director Richard Mallah, CARMA employs a systems-based methodology spanning governance frameworks, risk modeling, public safety preparedness, international cooperation mechanisms, and technical safety research. The organization operates five research programs covering comprehensive risk assessment, public security policy, geostrategic dynamics, offense/defense dynamics, and alignment of dynamical cognitive systems. CARMA is a fiscally sponsored project of Social & Environmental Entrepreneurs, Inc., a California 501(c)(3) nonprofit.
Funding Details
- Annual Budget
- -
- Monthly Burn Rate
- -
- Current Runway
- -
- Funding Goal
- -
- Funding Raised to Date
- -
- Fiscal Sponsor
- Social & Environmental Entrepreneurs (SEE)
Theory of Change
CARMA believes that reducing catastrophic AI risk requires a multi-layered, proactive approach that addresses both technical and governance dimensions before harms materialize. By developing rigorous risk assessment frameworks (such as PRA for AI), CARMA aims to give researchers, developers, regulators, and policymakers structured tools to identify and quantify AI-related hazards early. Simultaneously, the organization works to shape policy frameworks that account for AGI-level capabilities, improve national and international preparedness for AI-related crises, and design cooperation mechanisms that prevent destabilizing arms races or concentration of power. CARMA's theory of change holds that technical safety research, governance innovation, and strategic policy advocacy must be pursued in parallel and integrated into a systems perspective to meaningfully reduce existential and catastrophic risk from advanced AI.
Grants Received
No grants recorded.
Projects
No linked projects.
People
No linked people.
Discussion
Sign in to join the discussion.
No comments yet. Be the first to share your thoughts.
Details
- Last Updated
- Apr 2, 2026, 9:59 PM UTC
- Created
- Mar 19, 2026, 10:31 PM UTC