EA Forum Prize: Winners for October 2019

post by Aaron Gertler (aarongertler) · 2019-12-11T10:37:12.132Z · EA · GW · 4 comments


  What is the EA Forum Prize?
  About the winning posts and comments
    is often underpowered
    AGI safety research outside AI
    values: Better than counterfactuals
    winning comments
  The voting process

CEA is pleased to announce the winners of the October 2019 EA Forum Prize!

In first place (for a prize of $750): “Reality is often underpowered [EA · GW],” by Gregory Lewis [EA · GW].

In second place (for a prize of $500): “Technical AGI safety research outside AI [EA · GW],” by Richard Ngo [EA · GW].

In third place (for a prize of $250): “Shapley values: Better than counterfactuals [EA · GW],” by Nuno Sempere [EA · GW].

The following users were each awarded a Comment Prize ($50):


See this post [EA · GW] for the previous round of prizes.

What is the EA Forum Prize?

Certain posts and comments exemplify the kind of content we most want to see [? · GW] on the EA Forum. They are well-researched and well-organized; they care about informing readers, not just persuading them.

The Prize is an incentive to create content like this. But more importantly, we see it as an opportunity to showcase excellent work as an example and inspiration to the Forum's users.

About the winning posts and comments

Note: I write this section in first person based on my own thoughts, rather than by attempting to summarize the views of the other judges.

Reality is often underpowered [EA · GW]

In this post, Lewis makes a powerful argument that we ought to pay more attention when we find ourselves working with whatever data we can scrounge from data-poor environments, and consider other ways of developing our judgments and predictions. 

Some elements of this post I especially appreciated:

Technical AGI safety research outside AI [EA · GW]

To quote one commenter, “I think posts of this type (which list options for people who want to work in a cause area) are valuable”. I have a sense that fields of research are more likely to thrive when they can present scholars with interesting open problems, and Ngo takes the extra step of identifying problems that might appeal to people who might not otherwise consider working on AGI safety. This post is a good idea, executed well, and I don’t have much else to say — but I will note the abundant hyperlinks to sources inside and outside of EA.

Shapley values: Better than counterfactuals [EA · GW]

To be honest, my favorite part of this post may be the very honest epistemic status (“enthusiasm on the verge of partisanship”).

...but the rest of the post was also quite good: many, many examples, plus a helpful link to a calculator that readers could use to try applying Shapley values themselves. As with “Reality is often underpowered”, the advice here could be used in many different situations (the examples help to lay out how Shapley values might help us understand the impact of giving, hiring, direct work, public communication…).

I was also pleased to see the author’s replies to commenters (and the fact that they edited their epistemic status after one exchange).

The winning comments

I won’t write up an analysis of each comment. Instead, here are my thoughts on selecting comments for the prize [EA · GW]. 

The voting process

The winning posts were chosen by five people:

All posts published in the titular month qualified for voting, save for those in the following categories: 

Voters recused themselves from voting on posts written by themselves or their colleagues. Otherwise, they used their own individual criteria for choosing posts, though they broadly agree with the goals outlined above.

Judges each had ten votes to distribute between the month’s posts. They also had a number of “extra” votes equal to [10 - the number of votes made last month]. For example, a judge who cast 7 votes last month would have 13 this month. No judge could cast more than three votes for any single post.


The winning comments were chosen by Aaron Gertler, though the other judges had the chance to evaluate the winners beforehand and veto comments they didn’t think should win.


If you have thoughts on how the Prize has changed the way you read or write on the Forum, or ideas for ways we should change the current format, please write a comment or contact Aaron Gertler.


Comments sorted by top scores.

comment by Pablo_Stafforini · 2019-12-11T12:42:13.668Z · EA(p) · GW(p)

Max Daniel is listed as one of the four recipients of a Comment Prize, but no comment is listed.

comment by Aaron Gertler (aarongertler) · 2019-12-12T01:06:46.006Z · EA(p) · GW(p)

The prize was meant to refer to his full set of comments on that thread, rather than any particular comment. But to reduce possible confusion, I've linked to a particular comment.

comment by Pablo_Stafforini · 2019-12-12T02:13:47.809Z · EA(p) · GW(p)

Thanks. Just to be clear: before your edit, there was no thread linked, or at least no link showed up on my browser. I mention this in case it reflects a bug with the site rather than an oversight.

comment by Aaron Gertler (aarongertler) · 2019-12-12T18:01:07.050Z · EA(p) · GW(p)

Sounds like a bug; I'll keep an eye out for other instances. What browser were you using?