Decreasing populism and improving democracy, evidence-based policy, and rationality 2021-07-27T18:14:51.484Z
An evaluation of Mind Ease, an anti-anxiety app 2021-07-26T11:35:30.500Z
Let's Fund Living review: 2020 update 2021-02-12T18:49:52.075Z
Int'l agreements to spend % of GDP on global public goods 2020-11-22T10:33:39.039Z
HaukeHillebrandt's Shortform 2020-04-17T10:13:42.853Z
Growth and the case against randomista development 2020-01-16T10:11:51.136Z
Dataset of Trillion Dollar figures 2020-01-13T13:33:25.067Z
Let’s Fund: annual review / fundraising / hiring / AMA 2019-12-31T14:54:35.968Z
[updated] Global development interventions are generally more effective than climate change interventions 2019-10-02T08:36:27.444Z
New popular science book on x-risks: "End Times" 2019-10-01T07:18:10.789Z
Corporate Global Catastrophic Risks (C-GCRs) 2019-06-30T16:53:31.350Z
Crowdfunding for Effective Climate Policy 2019-05-25T18:17:05.070Z
Nick Bostrom on Sam Harris' podcast 2019-03-19T11:21:09.483Z
[EAGx Talk] Considerations for Fundraising in Effective Altruism 2019-01-15T11:20:46.237Z
EA orgs are trying to fundraise ~$10m - $16m 2019-01-06T13:51:03.483Z
New web app for calibration training funded by the Open Philanthropy Project 2018-12-15T15:18:54.905Z
Impact investing is only a good idea in specific circumstances 2018-12-06T12:13:46.544Z
Effective Altruism in non-high-income countries 2018-11-15T17:18:42.761Z
“The Vulnerable World Hypothesis” (Nick Bostrom’s new paper) 2018-11-09T11:20:42.330Z
Why donate to meta-research? 2018-11-08T09:29:58.740Z
[link] Why donate to (scientific) research? 2018-10-29T11:13:25.026Z
Announcing: " High-Impact Crowdfunding campaigns" & "Let's Fund #1: A (small) scientific Revolution" 2018-10-25T21:22:14.605Z
A generalized strategy of ‘mission hedging’: investing in 'evil' to do more good 2018-02-18T17:41:31.873Z
69 things that might be pretty effective to fund 2018-01-21T22:47:32.094Z
Some objections and counter arguments against global poverty/health interventions 2015-08-05T09:44:11.863Z
Giving What We Can's response to recent deworming studies 2015-07-23T18:19:59.535Z
Long-lasting insecticide treated nets: $3,340 per life saved, $100 per DALY averted. How is this calculated? 2015-07-13T16:08:20.169Z
An update on Project Healthy Children 2015-06-08T13:36:16.414Z
Room for more funding: Why doesn’t the Gates foundation just close the funding gap of AMF and SCI? 2015-06-03T14:48:07.317Z
Feedback and $2k in funding needed for EA essay competition 2015-05-13T15:13:29.362Z


Comment by HaukeHillebrandt on A generalized strategy of ‘mission hedging’: investing in 'evil' to do more good · 2021-07-31T10:36:50.908Z · EA · GW

Very cool - thanks for doing this. 

I agree that EA-related resources  are skewed towards the US tech sector (see Ben Todd's recent post) and that should definitely be taken into account.

Comment by HaukeHillebrandt on An evaluation of Mind Ease, an anti-anxiety app · 2021-07-30T12:50:16.129Z · EA · GW

Cheers- thanks for the comment!

I'm using the term zero marginal cost colloquially as is common parlance in the tech sector. 

Your app might spread through word of mouth, the server costs are trivial and then you can scale at ~zero marginal cost.

As you say in practise tech firms often spend a few dollars on acquiring new users/customers.

Comment by HaukeHillebrandt on An evaluation of Mind Ease, an anti-anxiety app · 2021-07-30T08:40:25.113Z · EA · GW

Yes, excellent point- I go into more detail about this in the full report:

"Anxiety is a highly prevalent condition, with lifetime rates for its derived mental disorders between 14.5% and 33.7% in Western countries (Alonso and Lepine, 2007; Kessler et al., 2012), and global estimates across countries between 3.8% to 25.0% (Remes et al., 2016). 

Many more might have trait social anxiety which is not quite clinical yet still causes suffering. Indeed, trait social anxiety may have evolved to protect our ancestors from social threat. Similarly, generalized anxiety might have evolved to protect us from other threats. Thus, anxiety might be natural and very widespread."

Comment by HaukeHillebrandt on A generalized strategy of ‘mission hedging’: investing in 'evil' to do more good · 2021-07-29T12:34:44.638Z · EA · GW

Very interesting- thanks for elaborating!

Comment by HaukeHillebrandt on A generalized strategy of ‘mission hedging’: investing in 'evil' to do more good · 2021-07-28T16:17:34.293Z · EA · GW

I can't follow this either but a study cited in Radical Markets suggests that a randomly chosen portfolio of as few as fifty stocks achieves 90% of the diversification benefits available from full diversification across the entire market.

Given that FAANG's market cap  alone is already $3 trillion and for almost 10% of the U.S. stock market's total market capitalization of $31 trillion, AND you could further diversify then this, wouldn't you get quite a lot of the diversification benefits?

Comment by HaukeHillebrandt on A generalized strategy of ‘mission hedging’: investing in 'evil' to do more good · 2021-07-28T15:58:20.111Z · EA · GW

@Jonas: I think your model is interesting, but if we define transformative AI like OpenPhil does (" AI that precipitates a transition comparable to (or more significant than) the agricultural or industrial revolution."), and you invest for mission hedging in a diversified portfolio of AI companies (and perhaps other inputs such as hardware) , then it seems conceivable to me to have much higher returns - perhaps 100x of crypto? This is the basic idea for mission hedging for AI, and in line with my prior, and I think this difference in returns might be why I find the results of your model, that Mission hedging wouldn't have a bigger effect, surprising. 

Comment by HaukeHillebrandt on Decreasing populism and improving democracy, evidence-based policy, and rationality · 2021-07-28T15:44:07.634Z · EA · GW

Excellent point.

I think there's a continuum going from highly educated to those that are most at risk of populism.

I haven't researched this carefully but my hunch is there are actually lots of translation of civic education memes to people who are at risk of populism (not only from experts). It seems to me that on the margin,  high-quality, easily -accessible information for educated people is more neglected.

related citation: IQ of the top 5% better at predicting GDP - does that suggest that increasing the epistemics of the TOP 5% is better than combating fake news? Cognitive Capitalism: The Effect of Cognitive Ability on Wealth, as Mediated Through Scientific Achievement and Economic Freedom

Stefan Schubert also thinks about this this sometimes:



Comment by HaukeHillebrandt on Decreasing populism and improving democracy, evidence-based policy, and rationality · 2021-07-28T15:30:09.132Z · EA · GW

Yes, excellent point.

Comment by HaukeHillebrandt on Decreasing populism and improving democracy, evidence-based policy, and rationality · 2021-07-28T15:29:23.961Z · EA · GW

Yes, agree that there are some low-hanging fruit for economic reform and progress can be made. I actually cite OPP's macroeconomic stabilization policy efforts in the post that Alex Berger refers to. But as he says impact is hard to attribute, and given that their funding of this area seems somewhat small, I'd be surprised if you could lower interest rates of central banks significantly with only a few million dollars in advocacy funding. 

I agree that there's some progress on '"free-market progressive" policies on zoning reform, occupational licensing, and non-competes', and that there maybe is room for more progress.

But do you think it has  already translated into meaningful consumption increases in the lower income deciles?

There are some interesting numbers e.g. on land use reform in an FP report on zoning reform:

that suggest that the effects might be non-trivial if you can get them through. But I think one would have to do quite a bit of advocacy. For things like occupational licensing and zoning and non-compete, trade, macroeconomic policy you get quite strong push-back from vested interests and rent-seekers. 

As I say in the next sentence: "Economic policy is also not very neglected by various stakeholders (e.g. political parties have very strong opinions on trade policy).

This contrasts with other things like preventing misinformation, which it seems to me you can often make more progress on, with less backlash.

Comment by HaukeHillebrandt on What are some skills useful for EA that one could learn in ~6 months? · 2021-06-30T15:36:53.036Z · EA · GW

Cheers- edited the original :)

Comment by HaukeHillebrandt on What are some skills useful for EA that one could learn in ~6 months? · 2021-06-29T14:10:33.333Z · EA · GW

Writing - especially this course:

and this book:

Comment by HaukeHillebrandt on US bill limiting patient philanthropy? · 2021-06-25T14:57:57.523Z · EA · GW

If we were to increase annual percentage of the endowment foundations need to to payout from 5% to 10%, then endowments would be spent down because it exceeds usual investment returns.

Comment by HaukeHillebrandt on What are some key numbers that (almost) every EA should know? · 2021-06-18T10:01:07.596Z · EA · GW

World population: ~7bn (India, China, Africa, Europe, the Americas, all have populations of ~1bn)

World GDP: ~$100trn (the EU, US, China all have GDPs of ~$20trn)

Comment by HaukeHillebrandt on What are some high-impact paths for a young person in the developing world? · 2021-06-14T13:24:32.248Z · EA · GW

This old post of mine on "Effective altruism in non-high-income countries" and the links in the comments might be helpful.

Comment by HaukeHillebrandt on What are your favorite examples of moral heroism/altruism in movies and books? · 2021-04-27T18:40:39.252Z · EA · GW

Haven't watched it yet, but there's also a new documentary called "Hilleman" who was a leading American microbiologist who and developed over 40 vaccines, estimated to save 8 million lives each year. There's a biography as well.  He grew up in poverty on a farm in Montana, one of 8 children  and apparently had an "interesting" personality:  "Hilleman was a forceful man who was at the same time modest in his claims. None of his vaccines or discoveries are named after him. He ran his laboratory like a military unit, and he was the one in command. For a time, he kept a row of "shrunken heads" (actually fakes made by one of his children) in his office as trophies that represented each of his fired employees. He used profanity and tirades freely to drive his arguments home, and once, famously, refused to attend a mandatory "charm school" course intended to make Merck middle managers more civil. His subordinates were fiercely loyal to him." [source: wikipedia].

Comment by HaukeHillebrandt on What are the highest impact questions in the behavioral sciences? · 2021-04-07T21:28:16.379Z · EA · GW

My brain dump "Potential priority areas within cognitive sciences (psychology, neuroscience, and philosophy of mind)":

Comment by HaukeHillebrandt on HaukeHillebrandt's Shortform · 2021-04-06T16:29:36.474Z · EA · GW

Working on human rights were just an example, because of the comparison you raised,  it could also be CSET type work.

Comment by HaukeHillebrandt on Resources on the expected value of founding a for-profit start-up? · 2021-04-06T16:09:23.829Z · EA · GW

This report on Impact investing might also be helpful (I'm a co-author).

Comment by HaukeHillebrandt on HaukeHillebrandt's Shortform · 2021-04-06T16:00:21.970Z · EA · GW

That was precisely my point actually—just like Hirsi Ali might be well-placed to advocate for women's rights within Islam, people from Hong Kong might be well placed to highlight e.g. human rights issues in China. 

Comment by HaukeHillebrandt on HaukeHillebrandt's Shortform · 2021-04-06T12:58:15.051Z · EA · GW

~140,000 people from Hong Kong might move to the UK this year (~322k in total over the next 5 years [source]).  

Are they particularly well placed to work on Sino-Western relations? (Because they're better at bridging cultural (and linguistic) gap and are likely highly determined). Should we prioritize helping them somehow?

Comment by HaukeHillebrandt on Want to alleviate developing world poverty? Alleviate price risk.​ (2018) · 2021-03-23T12:01:39.433Z · EA · GW

Could there be a market inefficiency because financial speculation with agricultural commodities is perceived to be bad?

See for instance: 

Comment by HaukeHillebrandt on Law school vs MPP in Australia for those who have strong verbal skills but are weak at maths · 2021-03-23T11:31:46.017Z · EA · GW

I am told that quantitative analysis is an important part of an MPP


I recently heard of an MPA at Columbia that has a non-quantitative economics stream: 

Comment by HaukeHillebrandt on Please stand with the Asian diaspora · 2021-03-20T18:26:52.052Z · EA · GW

I agree that LAAUNCH seems quite high upside because they do research which I feel is often more neglected and can be quite high impact (e.g. they conduct "A comprehensive, national assessment of attitudes and stereotypes towards Asian Americans in the US – one of the few such studies in the last 20 years").

Comment by HaukeHillebrandt on Please stand with the Asian diaspora · 2021-03-20T12:33:32.334Z · EA · GW

JPAL had some links to some orgs here:

Asian Americans Advancing Justice--Atlanta 

Edit: I also found Asian Americans Advancing Justice - this seems to be one of the biggest civil rights charities focusing on low income Asian Americans. They seem to have a good track record.  One can donate without paying any fees via PayPal Giving Fund here. 

Might also be worth to ask @chloecockburn who had some BLM recommendations.

Comment by HaukeHillebrandt on What do you make of the doomsday argument? · 2021-03-19T12:15:28.763Z · EA · GW

Related LessWrong discussion / paper

Comment by HaukeHillebrandt on What do you make of the doomsday argument? · 2021-03-19T12:13:50.658Z · EA · GW
  1. The distinction between humans and other lifeforms is arbitrary.
  2. ~10^30 lifeforms have ever lived.
  3. Thus, there'll likely be another ~10^30 lifeforms.
  4. But it's equally likely that this will be:
    1. ~10^30 non-human animals, if we do go extinct (life originated ~5bn years ago and life will end in ~5bn years when the sun dies).
    2. ~10^30 (post-) humans, if we don't go extinct (as per Bostrom's calculation).
  5. And so the doomsday argument doesn't tell us anything about x-risk or the far future.
Comment by HaukeHillebrandt on jushy's Shortform · 2021-03-07T21:33:28.419Z · EA · GW

Slate Star Codex had an interesting review on the Fabian Society and how advocacy can backfire.

Open Philanthropy Project has an interesting review of the Center for Global Development.

Comment by HaukeHillebrandt on A ranked list of all EA-relevant (audio)books I've read · 2021-02-22T12:54:25.282Z · EA · GW

Obama's memoir [... ] won't end up seeming as useful for me as [...] The Hungry Brain

I agree what's most useful to a person is to an extent a function of their background. I agree that there are edge cases (Moral Mazes vs. Obama). But I'm standing by my strong claim that Obama's memoir and some of my other recommendations as clearly more useful than the Hungry Brain and some others on your list. It is implied that this holds true for the average reader. One of the reasons for this is that some of these recommendations are based on arbitrary personal recommendations of audiobooks specifically (from a few years ago when there weren't even that many good things on Audible). It would be suspicious convergence if the Jobs biography recommendation, which is likely based on an 8-year-old  recommendation by Muehlhauser, should still be ranked highly for EAs to read. 

it isn't the case that Consider the Lobster "is now recommended here"

I agree that you've emphasized that your list should not be taken as authoritative in several places. Yet I stand by my claim that one can reasonably interpret Foster Wallace and other titles further down the list as recommended reading.

Comment by HaukeHillebrandt on A ranked list of all EA-relevant (audio)books I've read · 2021-02-22T09:08:41.528Z · EA · GW

Thanks -I think this is a good point and something to watch out for people not feeling tokenized. Also, again, I'm not necessarily advocacting for "strong community norms" - I was not saying we always need to have complete diversity everywhere.

In this specific case I was not very worried about this because:

  • There are 50+ books here including those linked to (as opposed to say 10), so there's a bunch of reading by non-white men that clearly dominates this reading list. I'm not recommending people read the Obama's memoirs or Thinking in Bets over David Foster Wallace, the Hungry Brain, or Moral Mazes etc. for the sake of more representation - they're just clearly more valuable to read from a EA point of view.
  • Relatedly, some of the books are  arbitrary because they're personal choices by Beckstead etc. - based also lists that are old recommendations from their personal websites. For instance, I suspect 'Consider the Lobster' etc is only on there because Nick Beckstead recommended it years ago to read "for fun", which Wiblin then recommended, which is now recommended here... it's just a bit echo chamber-y.
Comment by HaukeHillebrandt on A ranked list of all EA-relevant (audio)books I've read · 2021-02-20T08:51:46.050Z · EA · GW

Another way would be writing relatively low-effort commentaries, criticism, analysis, original thoughts, etc. as EA Forum posts, without doing proper literature reviews. 


I agree that active learning and writing doesn't have to be a literature review-and all these formats actually also work. Perhaps we're coming full circle and it does actually connect to the point in the other thread: we need to encourage people to write more commentaries.

Comment by HaukeHillebrandt on A ranked list of all EA-relevant (audio)books I've read · 2021-02-19T12:28:15.744Z · EA · GW

Thanks for the courteous reply. Agree with much of this! 

To be clear, I didn't mean to criticize you or anyone personally. Though judging by the downvotes I got, people might think that I'm EA's wokest and hardest virtue-signalling SJW, but I actually only realized and was able to flag this issue because I'm guilty of recommending a very similar set of male authors too much myself. So this is something that should be improved more generally (in the community). Also, I agree that we shouldn't spend much time on finding a precise 'quota' and I'm not saying that we should have 50% of women on AI safety syllabi (which would probably leave people scrambling and is more a society-wide issue) or cancel Toby Ord, but on current margin, we should probably err on the side of having a little more diversity in what we recommend. Not upvoting a list with 50 white males trending on the front page and implicitly endorse this as the EA cannon seems a really low bar. Hence the initial downvote, which I've now changed to an upvote, given that there's a productive discussion in the comments, in particular thanks to Michael.

Comment by HaukeHillebrandt on A ranked list of all EA-relevant (audio)books I've read · 2021-02-19T11:14:29.660Z · EA · GW

Yes agree with much of this!

Also, that comment seems to presume that most or all readers of this list will want to be researchers? I think a lot of EAs should be doing things other than research. 

I see your point and agree to an extent. My point was that I recommend people to focus more on active learning is often better than passively consuming content, even if they do not want to be a researcher. Just like at university you do not merely read things but also write essays. 

I think the best way to learn things is roughly:

  1. write a review of something yourself
  2. read papers
  3. read (popular) non-fiction books
  4. listen to podcasts

But I agree that podcasts and non-fiction books can be more entertaining and not as cognitively demand especially when you have some time to while doing chores etc.

Comment by HaukeHillebrandt on A ranked list of all EA-relevant (audio)books I've read · 2021-02-19T10:45:40.437Z · EA · GW

Yes, I was referring to Aaron's comment, but not saying that anyone wanted to intentionally canonize this list, but rather take on a life of its own. I agree with much of your comment (though still think the central point of my criticism is a valid and as a community we need to be more mindful about this).

Comment by HaukeHillebrandt on Charges against BitMEX and cofounders · 2021-02-18T13:42:11.883Z · EA · GW

Justifying potentially bad stuff with "the stakes of the work EA does" feels like a slippery slope and a bit fanatic.  There should be principled reasons that holds true for all charities, the cost-benefit approach you use the second part of your comment is better. Related: this thread on whether it's okay to work in the Tobacco industry.

Comment by HaukeHillebrandt on A ranked list of all EA-relevant (audio)books I've read · 2021-02-18T13:01:58.917Z · EA · GW

Thanks for your reply, I really appreciate this and your other contributions!

Sorry that I've been unclear. There are actually two separate issues here: 

  1. You only list male authors and lists that only feature male authors: all of them are WEIRD (Western, Educated, Industrialized, Rich, and Democratic). Sometimes it's fine for a reading list to only feature male authors. I vote on the margin: If you had gotten downvoted, I might even have upvoted. But on the margin, if this particular long general list became another canonical one as had been suggested, I think that'd be robustly bad. The previous Wiblin, etc. lists are already pretty canonical in the community.
  2. The issue of the EA canon: This is related but ultimately separate issue to 1). I actually agree with much of what you and Max say here. Everyone should read the Precipice and perhaps a few others. But I think when prioritizing their reading lists people should add a "neglectedness in the EA community score" to avoid echo chambers. Consider how much original insight and valuable disentanglement research you can really add if you spend years reading the same 50 pop non-fiction books that everyone else has read. Generally, people should read more papers and write more literature reviews themselves than reading more popular non-fiction.
Comment by HaukeHillebrandt on A ranked list of all EA-relevant (audio)books I've read · 2021-02-17T12:22:09.271Z · EA · GW

Thanks, I appreciate the effort, but downvoted because this reading list and those you link to are not diverse enough (edit to clarify: e.g. they skew heavily towards male authors) and also, relatedly, these titles should not become even more canonical in the EA community than they already are (I fear this might lead to an echo chamber). This is something my reading list tends to be guilty of as well, so I'd love for people to post reading lists with more diversity.

Some recommendations:

Comment by HaukeHillebrandt on Let's Fund Living review: 2020 update · 2021-02-14T17:36:07.824Z · EA · GW

That's a great question.

Does this mean you're considering fading out the fundraising aspect of your work?

I'm currently deprioritizing the fundraising, and eventually, it's very likely that it'll be faded out. And the research wouldn't be funding oriented anymore either and less applied - not unlike the piece on growth.

There are many reasons- I want to write more about the role of philanthropy in EA in the future. 

In brief, the crucial consideration is that multiobjective optimization is generally less effective than single objective optimization and the current model tries to optimize for both money moved and doing research. But if you want to optimize for money moved, then you need to focus on high networth philanthropy, which is way more effective, because of wealth inequality. That's why I think it's best to focus on research.

Comment by HaukeHillebrandt on Let's Fund Living review: 2020 update · 2021-02-14T17:12:18.585Z · EA · GW
  • How many total donors did you have for each grantee?


For we had about 50 donors with the majority of the funding being bigger donors and the Longterm future fund. Many of them were from the EA community.

For we had about 1000 small donors, mostly from outside of the EA community, the biggest donations were $75k and $50k.

  • What marketing strategies did you engage in?
  • What were the top ways donors found out about the giving opportunities? I know you mentioned the Vox article & Bill Gates' tweet, but I'd be interested to know how much traffic was driven through there, vs other sources

I contacted journalists about my research and then also people to retweet the coverage of the research. I write a little bit more about the strategy in a comment on the old thread if you're interested. Most donors found out about Let's Fund through, New York Times and Slate Star Codex (when it still had ads).

Comment by HaukeHillebrandt on Let's Fund Living review: 2020 update · 2021-02-13T12:45:51.872Z · EA · GW

The Case Against Randomista Development was exceptionally well received. Do you know of any direct impact it had? (say in terms of money moved or follow-up research done). Generally, how do you think about the impact it has?

Inside EA: The post was the most commented on research post on the EA forum, and roughly 10k in views. It also had 26 "citations" (see'pingback' on the post). 

I talked to an analyst at Charity Entrepreneurship last year who considered the growth arguments  charity incubation program. Founders pledge also did some research on it.

A few EA student groups discussed the piece.

Outside EA there was not much of a response on social media, perhaps because within economics the ideas are not that novel. Tyler Cowen linked to it, Pritchett discussed it on his blog, but not that much apart from that. Someone wrote he ran for New Hampshire state senate on a republican ticket partly because the post convinced him of the importance of policy, but lost by narrow margin. Republicans still flipped the state senate by four seats. Still, cluelessness is a bit scary.

How much do you think crowdfunding can grow? Do you think that "donations available through crowdfunding" is a limiting factor for expanding your work?

I'm deprioritizing the crowdfunding to focus more on research, but the global crowdfunding market is ~$15bn and forecast to triple in the next 5 years.  

I have a few more thoughts on donations in EA, that I hope to write up at some point.

Comment by HaukeHillebrandt on Let's Fund Living review: 2020 update · 2021-02-13T11:43:29.608Z · EA · GW

Thanks for the comment!

Quick clarification: we're not crowdfunding for global health. The best place to donate to hits-based global health initiatives is Givewell's maximum impact fund.

Comment by HaukeHillebrandt on Why I'm concerned about Giving Green · 2021-02-01T13:19:47.017Z · EA · GW

Thank you for great comment - I agree with a lot of this and a lot of the criticism in this thread. 

Some more related general thoughts: 

  • I think the marginal vs. average impact is one of the most frequently misunderstood aspects of EA and should be highlighted even more.
  • The value of grassroots advocacy (vs. grass tops / top down policy advocacy) is an under-explored research topic.
Comment by HaukeHillebrandt on What are the most common objections to “multiplier” organizations that raise funds for other effective charities? · 2020-12-08T18:18:00.940Z · EA · GW

There's a good talk on this - Considerations for fundraising in Effective Altruism.

Comment by HaukeHillebrandt on HaukeHillebrandt's Shortform · 2020-12-07T16:42:40.955Z · EA · GW

"RCTs in the Field of Development - A Critical Perspective" is a book that was recently published. Description below.

We cite one the chapters extensively in our "Growth and the case against randomista development" piece. 

The individual chapters seem all available for free in preprint version (e.g. ).


In October 2019, Abhijit Banerjee, Esther Duflo, and Michael Kremer jointly won the 51st Sveriges Riksbank Prize in Economic Sciences in Memory of Alfred Nobel "for their experimental approach to alleviating global poverty." But what is the exact scope of their experimental method, known as randomized control trials (RCTs)? Which sorts of questions are RCTs able to address and which do they fail to answer? The first of its kind, Randomized Control Trials in the Field of Development: A Critical Perspective provides answers to these questions, explaining how RCTs work, what they can achieve, why they sometimes fail, how they can be improved and why other methods are both useful and necessary. Bringing together leading specialists in the field from a range of backgrounds and disciplines (economics, econometrics, mathematics, statistics, political economy, socioeconomics, anthropology, philosophy, global health, epidemiology, and medicine), it presents a full and coherent picture of the main strengths and weaknesses of RCTs in the field of development. Looking beyond the epistemological, political, and ethical differences underlying many of the disagreements surrounding RCTs, it explores the implementation of RCTs on the ground, outside of their ideal theoretical conditions and reveals some unsuspected uses and effects, their disruptive potential, but also their political uses. The contributions uncover the implicit worldview that many RCTs draw on and disseminate, and probe the gap between the method's narrow scope and its success, while also proposing improvements and alternatives.

Without disputing the contribution of RCTs to scientific knowledge, Randomized Control Trials in the Field of Development warns against the potential dangers of their excessive use, arguing that the best use for RCTs is not necessarily that which immediately springs to mind. Written in plain language, this book offers experts and laypeople alike a unique opportunity to come to an informed and reasoned judgement on RCTs and what they can bring to development.

Table of Contents

General Introduction, Florent Bédécarrats, Isabelle Guérin, and François Roubaud
0:Randomization in the Tropics Revisited: A Theme and Eleven Variations, Sir Angus Deaton
1:Should the Randomistas (Continue to) Rule?, Martin Ravallion
2:Randomizing Development: Method or Madness?, Lant Pritchett
3:The Disruptive Power of RCTs, Jonathan Morduch
4:RCTs in Development Economics, Their Critics, and Their Evolution, Timothy Ogden
5:Reducing the Knowledge Gap in Global Health Delivery: Contributions and Limitations of Randomized Controlled trials, Andres Garchitorena, Megan Murray, Bethany Hedt-Gauthier, Paul Farmer, and Matthew Bonds
6:Trials and Tribulations: The Rise and Fall of the RCT in the WASH Sector, Dean Spears, Radu Ban, and Oliver Cumming
7:Microfinance RCTs in Development: Miracle or Mirage?, Florent Bédécarrats, Isabelle Guérin, and François Roubaud
8:The Rhetorical Superiority of Poor Economics, Agnès Labrousse
9:Are the 'Randomistas' Evaluators?, Robert Picciotto
10:Ethics of RCTs: Should Economists Care about Equipoise?, Michel Abramowicz and Ariane Szafarz
11:Using Priors in Experimental Design: How Much Are We Leaving on the Table?, Eva Vivalt
12:Epilogue: Randomization and Social Policy Evaluation Revisited, James J. Heckman

Comment by HaukeHillebrandt on Clean technology innovation as the most cost-effective climate action · 2020-12-07T11:51:50.307Z · EA · GW

Excellent post - strong upvote!

Your analysis of the climate impacts of clean protein is really interesting and the dual benefits of clean protein R&D on the environment and animal welfare are definitely worth highlighting, but I agree that in the long-term it's unlikely to be competitive with clean energy R&D.

However, I think what's more interesting is: 

  1. That there are just so many similarities in modelling the problem of climate change and factory farming  i.e. benefits of clean energy R&D and clean protein R&D.
  2. The resulting "Extreme cost-effectiveness of clean protein R&D"

Put simplistically, if you were to take the Let's Fund clean energy analysis ( and replace the negative externalities (i.e. "emissions" with "farm animal suffering") and solution the "clean energy R&D" with "clean protein R&D" - I think you might still get a lot of mileage out it. 

For instance, in the climate change report I had the following crucial considerations:

  1. The focus of advanced economies like EU countries to prioritize reducing their own domestic emissions is a natural impulse ('clean up your own backyard first'). But 75% of all emissions will come from emerging economies such as China and India by 2040. Only if advanced economies' climate policies reduce emissions in all countries, will we prevent dangerous climate change.
  2. For this reason, the best climate policies are those that stimulate clean energy innovation. Advanced economies need to provide the global public good of cheaper clean energy technology. Only technology spillovers help all countries reduce their emissions, because they lower the cost of low-carbon energy and make carbon taxes more likely.
  3. Many policies stimulate clean energy innovation and create global technology spillovers (e.g. carbon taxes, subsidies for renewable energy, phasing out fossil fuel subsidies). But the most effective policy is increasing government budgets for public clean energy research and development (R&D).
  4. Public clean energy R&D is neglected: only $22 billion is spent per year globally. Many advanced economies such as the US could unilaterally increase this substantially i.e. even without international coordination.

Clean protein R&D's effect on farm animal welfare is similar, where a lot of demand for meat will come from emerging economies, and, because of the global technology spillover, if we were to make clean protein cheaper for all countries, it would reduce factory farming globally, and thus dominate interventions like corporate campaigns, vegan advocacy, meat taxes, etc.

As you write, it's often good to use leverage through policy advocacy for more clean protein R&D. 

Here I feel like the Good Food Institute is most similar to the effective clean energy R&D advocacy interventions:

One of the The Good Food Institute missions is “educate grant-making institutions, corporations, and governmental bodies about plant-based and clean meat R&D as a critical component of endeavors related to sustainability, climate change, and global health.“ 

“Following GFI lobbying, Congress registered its support for alternative protein research in the fiscal 2020 Senate Agriculture Appropriations Report, and it included new language providing extra funding for the Agricultural Research Service to conduct research on pulses. GFI also launched GFI-Israel, now a team of four, and expanded the size of their affiliates in Brazil, India, Asia Pacific, and Europe (now ~25 total across the five offices).” 

Similarly, one of New Harvest’s missions is to “educate and inform stakeholders and the public at large of what cellular agriculture research is, and why it is necessary, in an honest, transparent, science-based manner.” Increasing neglected basic government R&D e.g. on tissue engineering might have very large leverage. For instance, in the US, the National Institutes of Health funds most tissue-engineering research, but focuses on biomedical applications; the Department of Agriculture funds most food-science studies, but spends little on clean meat. Advocacy to increase interdisciplinary research on this might be very effective to increase overall R&D budgets.

Further links: 

  1. Protein Industries Canada | Unleashing the Potential of Canadian Crops
  2. Japan is investing in protein research.
  3. How Government-Funded Research on Alternative Proteins Can Grow the Bioeconomy
Comment by HaukeHillebrandt on AMA: Jason Crawford, The Roots of Progress · 2020-12-03T17:25:52.341Z · EA · GW

Are ideas getting harder to find?

Comment by HaukeHillebrandt on BenMillwood's Shortform · 2020-10-24T08:37:31.518Z · EA · GW

I'm sure if I thought about it for a bit I could figure out when these two mutually contradictory strategies look better or worse than each other. But mostly I don't take either of them very seriously most of the time anyway :)

I think these strategies can actually be combined:

A patient philanthropist sets up their endowment according to mission hedging principles.

For instance, someone wanting to hedge against AI risks could invest in (leveraged) AI FAANG+ ETF (, then when AI seems more capable and risky and the market is up, they sell and buy shorts, then donate the appreciated assets to fund advocacy to regulate AI.

I think this might work better for bigger donors.

Like this got me thinking:

“We can push the odds of victory up significantly—from 23% to 35-55%—by blitzing the airwaves in the final two weeks.”

Comment by HaukeHillebrandt on BenMillwood's Shortform · 2020-10-24T08:20:55.891Z · EA · GW

it's possible to make money this way

Agreed, but I don't think there's a big market inefficiency here with risk-adjusted above market rate returns. Of course, if you do research to create private information then there should be a return to that research.

Trading based on private information is sometimes illegal, but sometimes not, depending on what the information is and why you have it, and which jurisdiction you're in. [...[

True, but I've heard that in the US, normally, if I lobby in the U.S. for an outcome and I short the stock about which I am lobbying, I have not violated any law unless I am a fiduciary or agent of the company in question. Also see

I have my own counterargument

I really like this, but...

it can be made to look bad

This seems to be why people have a knee jerk reaction against it.

Comment by HaukeHillebrandt on Michael_Wiebe's Shortform · 2020-10-16T16:55:34.041Z · EA · GW


Related: "Some programs have received strong hints that they will be killed off entirely. The Oxford Policy Fellowship, a technical advisory program that embeds lawyers with governments that require support for two years, will have to withdraw fellows from their postings, according to Kari Selander, who founded the program."

Comment by HaukeHillebrandt on We estimate GiveWell donors’ $15.3 million to the Against Malaria Foundation will save over 3,000 lives · 2020-10-16T10:39:21.493Z · EA · GW

What do you think of the worst case WHO model that suggest that  COVID will disrupt malaria prevention and lead to additional ~350,000 deaths?


Comment by HaukeHillebrandt on Can my self-worth compare to my instrumental value? · 2020-10-14T12:12:52.845Z · EA · GW

most of the impact is achieved by a few, very impactful people could also make the people who perceive themselves as having potential for high impact particularly vulnerable, since the gap between their intrinsic value or self-worth and their instrumental value would seem even wider.


Not sure if relevant to what you're saying, but there's this very interesting paper that shows:

Suppose that all people in the world are allocated only two characteristics over which they have (almost) no control: country of residence and income distribution within that country. Assume further that there is no migration. We show that more than one-half of variability in income of world population classified according to their household per capita in 1% income groups (by country) is accounted for by these two characteristics. The role of effort or luck cannot play a large role in explaining the global distribution of income.

This has obvious implications how much people can realistically earn to give, but also suggests that other forms of impact, like social impact, might be mostly outside people's control. This is good reason to not be too hard on oneself for not achieving more, and not compare yourself to people like Bill Gates.

This blog post "Why not give 90%?" also seems relevant.