Some AI Governance Research Ideas

post by MarkusAnderljung, Alexis Carlier · 2021-06-03T10:51:09.777Z · EA · GW · 2 comments

Compiled by Markus Anderljung and Alexis Carlier

Junior researchers are often wondering what they should work on. To potentially help, we asked people at the Centre for the Governance of AI for research ideas related to longtermist AI governance. The compiled ideas are developed to varying degrees, including not just questions, but also some concrete research approaches, arguments, and thoughts on why the questions matter. They differ in scope: while some could be explored over a few months, others could be a productive use of a PhD or several years of research. 

We do not make strong claims about these questions, e.g. that they are the absolute top priority at current margins. Each idea only represents the views of the person who wrote it. The ideas aren’t necessarily original. Where we think someone is already working on or has done thinking about the topic before, we've tried to point to them in the text and reach out to them before publishing this post.

If you are interested in pursuing any of these projects, please let us know by filling out this form. We may be able to help you find mentorship, advice, or collaborators. You can also fill out the form if you’re intending to work on the project independently, so that we can help avoid duplication of effort. If you have feedback on the ideas, feel free to email

You can find the ideas here. Our colleagues at the FHI AI Safety team put together a corresponding post with AI safety research project suggestions here [LW · GW].

Other Sources

Other sources of AI governance research projects include: 

A list of the ideas in the document:


Comments sorted by top scores.

comment by MichaelA · 2021-06-06T14:20:43.734Z · EA(p) · GW(p)

Thanks for compiling this! I like the way you've approached this (e.g., the google form you've linked to), and most of these ideas do seem interesting and important to me. 

I'd be interested to hear later on how many people filled in the form and how much good stuff came from that.

Also, I've now added this to my central directory for open research questions [EA · GW] (in the section for non-technical AI focused stuff), to hopefully make it a little more likely people looking for research projects in future can find it.

Replies from: MarkusAnderljung
comment by MarkusAnderljung · 2021-06-07T09:17:45.819Z · EA(p) · GW(p)

Thanks Michael! Yeah, I hope it ends up being helpful.