Germany’s talents are critical to the global effort of reducing catastrophic risks brought by artificial intelligence.
Germany’s talents are critical to the global effort of reducing catastrophic risks brought by artificial intelligence.
People
Updated 06/10/26By grantmaking.aiFounder
creator
Funding Details
- Start Date
- -
- End Date
- -
- Expected Duration
- -
- Funding Raised to Date
- -
- Annual Budget
- -
- Monthly Burn Rate
- -
- Current Runway
- -
- Funding Stage
- -
- Fiscal Sponsor
- -
Project Details
Updated 06/10/26By grantmaking.aiProject summary
Safe AI Germany (SAIGE, website: https://safeaigermany.org/ ) addresses an urgent inefficiency in the current landscape: the shortage of people from Germany positioned to positively influence the trajectory of advanced AI development. Germany is the European engine for technical talent: according to the Federal Statistical Office (Destatis), Germany holds the highest share of STEM Master’s degrees in the EU (35%), significantly outperforming the EU average of 25%. Moreover, Germany possesses a world-class engineering sector, together with an annual approx. 300,000 students in STEM (source), >110,000 students in Law (source); Yet global capacity in technical safety and governance remains critically limited. We see a massive structural bottleneck in the local ecosystem: virtually none of this top-percentile talent is funneled to AGI safety. Instead, this hidden reserve of industrial experts flows almost exclusively into traditional roles (e.g. mechanical engineering with 1.3 million employees), simply because they lack the context and infrastructure to apply their skills to AGI safety.
Our mission is to build the centralised infrastructure required to bridge this gap. We are moving beyond volatile student initiatives to create a stable national organisation that supports both groups through:
- Upskilling: We are scaling AIS Saarland's research incubator nationwide with its director (who now also works as Technical Lead for SAIGE), providing coverage for cities that currently lack local hubs. This ensures high-potential students and professionals have a clear path into the field. We also give the specific context needed to enter the field by organising hackathons (collaborating with Apart Research), technical deep-dives (with partners like Apollo Research). These serve as a direct entry point for both professionals and students. Details: https://safeaigermany.org/incubator
- Career advising: For professionals, we have confirmed collaboration with High Impact Professionals to provide network and guidance to career transitions. Currently settling on details with another two collaborators.\
Currently, the path of least resistance for high-potential German talents is to swarm into standard industry roles. Our theory of change is focused on expanding AI Safety talents by redirection:
Link to ToC Diagram\
Note that “Sufficient funding” is still pending at the current time of writing. SAIGE is currently entirely self-funded by its director (me).
We define a successful “AI Safety role” outcome to include either of the following:
- Employment: Full-time permanent positions, short-term fixed positions, or project-based contractor positions at established labs and organisations (e.g. MATS fellowship);
- Entrepreneurial roles: founding new AI Safety initiatives or non-profits;
- Civic & ecosystem contribution: High-impact pro-bono work such as advising policymakers or giving educational talks.Note: Since SAIGE is just starting its journey, although we have plenty of activities listed in our Theory of Change, it isnecessary to determine which ones we are prioritising first, according to our goal. See the following planned activities for more details.
Planned activities
-
Phase I (on our website already): We will focus immediately on connecting scattered local assets into a coherent national pipeline. This includes
-
Pipeline for mid/senior-career professionals
-
Incubator program for everyone (fit towards the typical German semester dates, which is unusual for most other countries. However professionals are more than welcome and encouraged to apply and join)
-
Basic infrastructure support for local groups
-
Low-budget online events to gain more outreach traction (e.g. confirmed first launch event with Joshua Landes on March 4th). E.g. Talks on technical/governance topics; Talks by referred contacts from HIP, "how did I transition as a mid/senior-career professional into AI Safety in Germany" etc.
-
Phase II: Scaling & institutionalisation, which will be contingent on funding. This means having events such as
-
SAIGE Day, i.e. An EAG-like event but for AI Safety, focused on the German ecosystem
-
In-person events/retreats, incl. national retreat for local leaderships every 6 months, to provide feedback to each other and to SAIGE; 2 in-person hackathons; 40-50 people career workshop with Successif
-
Establishing a formal legal entity (e.V.) and deploying a centralised tech stack to relieve local organisers of administrative burdens
Depending on capacity, in Phase II, we could also include events which would likely add to our outreach but are not currently in our priority list, such as an introductory course partnered with AIS Collab to fit into the German semester dates, and also establishing a weekend-intensive program for career professionals to suit more to their schedule and capacity for time commitment. They are currently not listed in Phase I, since the incubator program already aims to include an introductory course, and we currently do not know the exact, quantitative impact of such a program. However, if we gain positive results and receive sufficient funding, we will consider these as well in Phase II. \
Who is on your team? What's your track record on similar projects?
Core Team
Jessica Pu Wang****, Director
- Experience: Educational background in mathematics. Worked at Epoch AI to develop and later co-organised the FrontierMath project. Specifically, as their Outreach Coordinator to source talents to Tier 4, and co-organised the 2025 FrontierMath Symposium. Top 9 global contributor to Humanity's Last Exam. Previously worked as Global Operations Analyst at Calastone, the largest global funds network. Worked at the International Mathematical Olympiad (IMO) as the sole official photographer, with 1300+ attendees. Also was the President of the Durham University Maths Society, and the Ambassador for the Institute of Physics.
- Responsibilities: Oversees the overall progress, design, and execution of activities. Communicates with existing and potential collaborators to ensure activities are carried out smoothly. Also responsible for outreach and fundraising.
Tzu Kit Chan****, Executive Advisor
- Experience: Educational background in philosophy, comparative literature, and cognitive science. Has been actively involved for 3+ years in the AGI preparedness community, having done operations for MATS, cofounded Caltech AI Alignment, ran Stanford AI Alignment, advising as a board member for Berkeley’s AI Safety, as well as 25 other top universities across the world. He is also the youngest advisor to Malaysia's National AI Office (NAIO) AI Safety and Malaysian Technical Standards Forum (MTSFB) working groups.
- Responsibilities: Advises the core team on organisational strategy and program architecture in a more high-touch role. Leverages his experience building MATS and Atlas Computing to help design effective fellowship models and programs. Provides executive mentorship to the Director and facilitates strategic connections to the international AGI preparedness research ecosystem.
Manon Kempermann****, Technical Program Lead
- Experience: Educational background in data science and artificial intelligence. Founder of AI Safety Saarland. Currently writing a thesis at Max Planck Institute for Software Systems on red-teaming for misalignment in AI agents. Also a Pathfinder mentor at Kairos. Organised AI Safety events including a talk with Anthropic containing 300+ attendees.
- Responsibilities: Works with the Director on the nationwide rollout of the Interdisciplinary Research Incubator model, adapting the successful AIS Saarland framework for a broader German context. Helps with the acquisition of technical mentors across Germany. Oversees the strategic pairing of technical mentors with participants to maximise research output.
Leadership advisors
The following individuals have been providing regular, valuable and critical feedback to the planning of SAIGE. They would continue to have monthly or bi-monthly meetings with the director to ensure our goals align with the broader AI Safety ecosystem. Their involvement ensures that SAIGE's actions are continuously shaped by diverse expert perspectives.
-
Experience: Educational background in cognitive psychology. Director of Effective Altruism (EA) UK. Previously director of the European Network for AI Safety, after having founded AI Safety Hungary. Also founded EA Hungary, which has provided support to +300 students and professionals to achieve their career goals.Marcel Steimke
-
Experience: Educational background in mechanical engineering. Director of EA Switzerland. Previously a key organiser for EA Aachen. 7+ years of active fieldbuilding experience.**Callum Hinchcliffe**** **
-
Experience: Educational background in philosophy. Worked as program manager at Arcadia Impact. Ran and project-managed the Orion AI Governance Initiative for the 2024/25 academic year. Previously an operations and community manager at Pivotal Research, as well as being a Facilitator in AI Governance for both Bluedot Impact and Safe AI London.Nico Hillbrand
-
Experience: Educational background in computer science. Founder of AI Safety Aachen and co-organiser of EU AI Safety Forum. Also an organiser for EA Aachen. Given the Pathfinder support grant and previously the Open Philanthropy (now Coefficient Giving)'s community builder grant.
What are the most likely causes and outcomes if this project fails?
1. Founder Burnout
-
Cause: Currently, the organisation relies heavily on the high-intensity output of the Director (me). If I burn out or have to step back for health reasons, the momentum could collapse before the institution is self-sustaining.
-
Outcome: The project stalls, accumulated momentum lost.
-
Mitigation: The budget includes salary for tech lead, governance lead, communications manager, and an ops specialist to distribute the workload.2. Low Conversion Rate
-
Cause: We successfully run the Incubator, but the participants are not quite "top tier" enough to get hired by major AI Safety labs or admitted to MATS.
-
Outcome: Participants eventually return to standard capabilities tech jobs. The counterfactual impact is near zero (money wasted).
-
Mitigation: We will implement a rigorous filter for the Incubator (both ensuring technical capabilities and interviewing on value alignment) to ensure we only accept high-potential, aligned candidates.3. Marketing Failure
-
Cause: In Germany, safety ("sicherheit") usually means Industrial Safety (ISO 26262, TÜV) or Data Privacy (GDPR). Maybe "AI Safety" will be difficult to land with the pragmatic German engineering culture. In this case, there is a risk that technical talent misinterprets "AI Safety" as boring compliance work or standard cybersecurity, rather than alignment and control of advanced systems.
-
Outcome: Wasting talents. Fail to redirect people to AI Safety since the starting motivation is not aligned.
-
Mitigation: Need to get people's attention to AGI safety. We will frame problems in the language ofreliability engineering andformal verification (i.e. concepts that resonate with the German "TÜV mindset") but point toward existential security.
The Ask and Related Goals
See budget sheet for details.
I will be very happy to be contacted and share more details about this project, if anyone has any feedback or questions!
Email: info@safeaigermany.org
Grants Received
Updated 06/10/26By grantmaking.aiDiscussion
I have been really impressed with the strategic thinking and level of agency Jessica brings to the fieldbuilding space! Looking forward to seeing SAIGE grow!
@gergo having your support and feedback from Day 1 (December, it's only been a month since our first call / when I knew that I was going to start AIS Germany 😆) has meant a lot for me. Looking forward to seeing you again in EAG SF!
I do community building in Aachen, Germany and I'm both excited for local group support and coordination beyond what's currently happening through Kairos and the EA network as well as having someone taking the initiative to engage more senior people and provide a strong network for people form Germany that want to go into impactful AI Safety roles
@Nico-Hillbrand thank you! Last week's field-builders' weekend with AIS Aachen and AIS Saarland was very helpful in pinpointing what local group leaders & Germany need the most. We should do that on a larger scale at some point (+ AIS Tübingen, Berlin, and the future Kassel) to get more feedback for local leaders, and also to make sure that SAIGE continuously addresses the AIS needs&gaps in Germany.
I have known Jessica Wang, the director, for some time. I know that she thinks clearly, takes initiative, sets and achieves goals, responds well to feedback and is continuously adapting. I know that she has applied these successfully in a range of domains. With her now directing SAIGE, I am excited for everyone in Germany who is interested in a career in AI safety and governance!
Thank you @callum-hinchcliffe for all your support, including being the reason why I'm working for AI Safety in the first place.
I've contributed to AI Safety field-building in Germany over the past few years (ML4Good bootcamps, AI Safety Collab). The idea of centralized German AIS infrastructure has been discussed many times over the years - SAIGE is the most well-prepared and sensible attempt I've seen so far.
I've reviewed their planning documents and I'm impressed: thorough failure modes analysis, smart partnerships with existing orgs rather than reinventing the wheel, strong team with good connections to the international ecosystem. Jessica seems like a good leader for this.
No guarantees of success, but definitely worth a try - high expected value :)
Thank you @Evander ! Means a lot to have the feedback and support from someone experienced in the German AIS ecosystem.
I have a high expectation of good outcomes from this project if it is funded. Partnering cleverly with other actors in the ecosystem is a big green flag in my eyes.
This is a well prepared proposal, and the core team seem very well positioned to execute on this.
Disclosures: I helped with the budget a bit, and I know Tzu Kit Chan socially
Thanks @PipFoweraker ! It is great to have your support and hope we meet in person someday :)
I know Jessica Wang personally and I’m optimistic about SAIGE’s potential impact if funded. The proposal is thoughtful and well prepared, and the team appears well positioned to execute, especially given Germany’s leverage as a talent hub within Europe.
Thanks @Bernhard-Albach ! It's been good to see you taking an interest in AI Safety and looking forward to seeing you at the launch event XD
Speaking with Jessica about SAIGE makes me very excited and hopeful about the potential impact it might have. The description and ToC seem very well thought out, and I'm fully supporting this and hoping it gets the funding it needs. I'm also excited to see Manon be involved in this, who I've spoken to and think her track record in AI Safety Saarland (which was very impressive) is likely to transfer over well to SAIGE.
@Alexander thank you very much, I equally enjoyed our chat! And yes, having the impressive Manon on board with SAIGE is a big de-risker for our project. Looking forward to coordinating closer with the Dutch ecosystem :)
Update 02/02/2026: 1. Our designated tech lead has committed to working voluntarily for the start of SAIGE. I have rewritten the**[BASE] budget** accordingly. 2. We have confirmed collaboration with Impact Academy as well as HIP, and the Pivot Track (for career professionals) is live today. 3. As part of our incubator program (of which the call for mentors is also live), we are hosting biweekly talks aimed at incubator participants and also to a wider audience, provided there are spaces left. We have so far confirmed four speakers: Teun van der Weij, Ari Brill, Guillaume Corlouer and Naci Cankaya. 4. Our launch event with BlueDot has so far had 148 registrations.
Jessica is highly capable and has the energy to make this work!
The whole team is very capable and thank you for joining the team of advisors!!
I am bullish on increased field-building efforts within Germany. In my limited interactions with Jessica she seems conscientious and agentic, and I know Tzu more personally as someone being very high-energy, ambitious, and conscientious!
Thanks a bunch @anders_e 🙏
In my opinion we very much need a better network and more effective coordination in Germany! And this is likely the best German AI Safety fieldbuilding project right now, and one of the best in general that I know of.
Writing as a local group organizer: SAIGE would provide what the ecosystem needs so that we can address this problem (and approach people) at scale. Running a local group is good, but very often there's a gap between a reading group and actually connecting someone to the right people and changing their career. (And local university groups also just don't appeal to everyone.)
Germany/DACH has enough raw talent (top-tier engineering & STEM people) and also political relevance (EU AI Act), but often very much lacks execution and ecosystem coordination to channel this into AI Safety. Local groups can only do so much, and having a wider network is absurdly important & extremely high EV.
(Jessica is also really great and I fully support her as much as I can. Have not heard a single not-great thing about her.)
Fully agree with Jonathan. Writing as organizer of AI Safety Camp and having talked with Jessica, this is the most promising fieldbuilding project for AI Safety in Germany that I have seen to date.
I absolutely buy their assessment about the untapped STEM talent pool that Germany has to offer to technical AI Safety work. Since German culture disincentivizes risk taking in one's career, it is all the more important to have a strong and central organisation capable of connecting national talent into a community and offering them a clear perspective into career prospects in the field.
It also strikes me as an excellent platform for outreach about AI Safety topics to the general public in Germany.
After looking through SAIGE's plans and their theory of change, talking to Jessica, and reading the other comments here, I strongly recommend this project for funding.
SAIGE looks like a promising way to improve Germany’s AI safety talent pipeline. After talking with Jessica, I’m optimistic about the team and the overall approach.
Thank you so much @Joschka for your support and for volunteering to be a speaker and mentor! I look forward to our collaborations and more discussions with you about the German/EU AI Safety space + your MATS experience :)
Background: I'm a community builder in Berlin contracting with AI Safety organizations and had a call with Jessica about SAIGE.
Various local groups exist across Germany that could benefit from a national entity. E.g. A German AI Safety day is hard to realize without an organization behind them.
Beyond this proposal, I'd also like to see German-language resources and outreach.
A national organization that understands local idiosyncrasies and opportunities could also make the AI Safety pipeline in Germany more efficient.
Thanks @Milli ! It was really helpful to discuss with you and to know your perspective from the Berlin ecosystem. I do agree that while technical research often happens in English, we'll also need the German-language aspect to perform outreach most effectively. We currently have a volunteer translation team of 12 people, but we would need the central operations staff to really leverage this energy for larger projects like a German AI Safety Day/career fair!
Seems valuable. Lots of talent in Germany and few ways to get them engaged thus far.
Thank you @Finn-Metz !! Looking forward to seeing you at EAG this weekend :)
Making a personal donation in support of this initiative. While I haven't spoken with Jessica, her track record seems solid, and I'm familiar with a couple of the folks who will be involved. Moreover, I'm impressed with the breadth of people who have come to express support on this project, which also provides some evidence that Jessica and SAIGE will do well at fieldbuilding. Best of luck!
Thank you so much, @Austin , it means a lot to have your personal support ❤️ Actually, I am landing in SF today. If you're around, I'd love to say hi and thank you in person.
@Austin raising an issue: I've received messages from people (who wanted to upvote and comment on this post) since 5 days ago, that they have trouble creating an account on Manifund. Seems to be a system error. Please could you look into it?
Also Update: 1. 5 more speakers confirmed: Joschka Braun (MATS), Alan Chan (GovAI), Cristian Trout (Artificial Intelligence Underwriting Company), Robert Kralisch (AI Safety Camp), Simon Skade (indep. researcher supported by LTFF);
2. We have so far received:
- 194 registrations for our Launch event
- 43 Pivot Track applications for career professionals
- 22 mentorship applications (deadline: 26th Feb) to the SAIGE Incubator Program
3. Three more city chapters are getting the support to start their initiatives: Frankfurt (which is great for transitioning career professionals), Bonn, and Kassel.
4. A new resources tab (Feedback welcome!)
(^ The registration issue also implies that they cannot donate, either)
@jessicapwang Hey Jessica, thanks for flagging and apologies for the issue -- this should now be fixed. Please let me know (here, or via austin@manifund.org) if this is still causing problems!
Yes seems to work fine now, much appreciated @Austin ! 😇
Willing to donate a lot more if this helps get AIS in Germany off the ground. About time as well! Brain drain has been massive lately.
And this seems to be a pure funding issue, the talent is there!
Thank you so much @Naci ❤️
This is a great initiative, the website is epic, and Jessica is a powerhouse of energy that makes me watch this space with excitement! \o/
Thank you @mk_lao ! It was great seeing you at Mox, and let's keep in touch ;)
I've been incredibly impressed by Jessica's agentiness and drive. The team she has on board is great and she is quite well coordinated with the relevant other stakeholders in Germany and Europe. Given the clear plan for the future, I would be quite excited if we could get this off the ground.
Thanks a bunch @Yannick-Muehlhaeuser 😇
Great to finally see such a national organization forming. Germany really needs a platform helping STEM researchers organize, learn and build.
This project has potential for enabling copius amounts of AI safety research that counterfactually wouldn't happen. The current lack of infrastructure around the field in Germany causes some to move away to pursue work abroad. However, there are many others who simply "move on" to other work they can do where they already live, or are never informed that AI safety or alignment is an option. SAIGE could help address those issues.
In the short term, I'm optimistic about the incubator program both introducing new people to AI alignment work and eventually enabling them to continue it. I have applied to the program as a mentor for projects in agent foundations related to my research at MATS.
Thank you @Ashe ! SAIGE is exactly trying to fix the issue you have described. The incubator is a first step (and so excited to look through your project proposal!). We also *just* confirmed with Successif that the first career workshop is happening, on March 11th. It'll be added to the SAIGE calendar very soon.
This is filling a gap in the German market and needs to succeed!
AI safety is a rapidly growing global concern, especially with the rapid commercial development of models with seemingly little concern for safeguarding; however, I believe that with good guardrails, AI holds immense potential for innovation. This proposal identifies a clear gap: a mismatch between potential talent in Germany and a lack of infrastructure to encourage this talent towards this emerging and important field of AI safety. I have faith in Jess, I sincerely hope that SAIGE succeeds because it would be a shame otherwise, as the statement of risk makes clear.
Full disclosure: I know Jess personally and she's always shown a relentless drive and immense conscientiousness.
Germany needs a stronger AI safety community and this is the strongest effort I'm currently aware of!
Germany has several local AI safety groups, but AI safety lacks a national presence. SAIGE could be a key organization in tying these groups together to create a more coordinated German approach to making AI safer.
Germany has raw resources that could be used to make an impact in AI safety, but needs more field building efforts like these to tap into that potential.
Fantastic initiative — donating a small amount to show support. I know Gergő really well and trust his judgement, and it was great meeting Jessica in SF recently. Go SAIGE!
Approving this project! (And per Jessica's request, I've lowered the minimum funding bar from $50k to $5k.)
I've been doing fieldbuilding in the EA/AI safety space for 7+ years, and imo the team behind a project is one of the strongest predictors of whether it will work. Jessica who is leading SAIGE has consistently impressed me — with execution and with the ability to learn and adapt rapidly. In roughly two months, she has assembled a team of volunteers that launched an incubator with a strong mentor lineup for a first-time unfunded program, secured notable experts on AI safety as speakers, and hit nearly 200 registrations for a launch event. All of this while the project is entirely self-funded and volunteer-run.
SAIGE is still figuring out exactly what role it should play. But what I've seen so far is a team that iterates fast, partners smartly, and builds real momentum.
The underlying thesis is strong: Germany has an enormous pool of STEM and engineering talent that is almost entirely disconnected from AI safety work. There's no national infrastructure to change that. SAIGE is the most serious attempt I've seen to build it.
In my mind, this Manifund round isn't about fully funding a mature organisation. It's about giving SAIGE the runway to show other grantmakers that this team can deliver. From what I've seen so far, they can.
i chose to mentor Jessica’s group to make AIS germany happen and i am in-the-trenches informing with battle-tested experiences / make tricky judgement calls.
Thank you @tzukitchan, I'm very glad to have you on board :) your experience in helping AIS groups start has been vital to the initial development of SAIGE. Looking forward to our weekly call tmr!
Also, really valued working with you at Epoch AI last year and learnt a lot from you there. Definitely aiming for that bar with SAIGE.