An update on Operations Camp 2019

post by Jorgen_Ljones, jahying, eirine · 2019-09-19T07:59:59.793Z · score: 50 (32 votes) · EA · GW · 3 comments

Contents

    Executive summary:
  What is this post about?
  Where we started
  Exploration of bottleneck candidates
  Identifying top bottlenecks
  What are we going to do now?
None
3 comments

Jah Ying Chung [EA · GW], Project lead

Eirin M. Evjen [EA · GW], Exec. Dir. EA Norway

Jørgen R. Ljønes [EA · GW], Ass. Exec. Dir. EA Norway

In a forum post in February [EA · GW], we posted our plans for organizing an operations camp aimed at improving recruitment of operations talent for EA organizations. The EA Meta Fund gave us a grant for the project in March. This is an update on this project, our reasoning for changing course, and what we have found so far.

Executive summary:

What is this post about?

In this post we will explain our shift away from an operations camp to our new approach for increasing operations capacity at organizations in the EA space (from here on referred to somewhat loosely as “EA organizations”). We identified twelve operations bottlenecks (including those related to hiring) and researched what the most pressing challenges at EA organizations are, according to their operations staff. Then we narrowed these down to the five top challenges, namely:

From our analysis, the first two challenges seem significantly more pressing than the next three, and all five stand out from the rest.

We plan next to explore possible solutions to one or more of these top challenges. Here our skills and experience are lacking and we aim to recruit new project contributors with more relevant experience than us to take the project forward. We intend to present our findings and tentative results at EAG London and write a third forum post on this soon after.

Where we started

Eirin and Jørgen at EA Norway researched operations recruitment questions during the fall of 2018 to better understand operations challenges in the EA sphere and how we could help mitigate these. We focused on the recruitment challenge in the wake of 80,000 Hours’ call for more interest in operations-type roles and on the discussions on coordination problems [EA · GW] between orgs and potential candidates.

Given what we learned and that we understood the recruitment challenge as mainly one of coordination and information asymmetry, we came up with the idea of an operations camp to lower these barriers and find operations talent for EA orgs. 80,000 Hours and operations staff at EA organizations confirmed in January this year that this was still a significant challenge. This was the basis we had for applying for and receiving a grant from EA Meta Fund in March for this project.

As a next step in our preparations we reached out to other people in the movement with more domain expertise. These conversations led us to take a step back and ask: What are we fundamentally trying to achieve here? Our answer is that in essence, we want to increase the total operations capacity of EA organizations, which is a broader target than helping with the hiring challenge. We realized that we were not certain that an operations camp was the best way to achieve this broader goal.

Our project changed significantly from organizing an event, with content developed in collaboration with domain level experts, to more fundamental research into all operations challenges of EA organizations. This also demanded a different set of skills and experience than Eirin and Jørgen assessed they had, so they engaged Jah Ying Chung to lead the research. Jah Ying has been a leading contributor to the project since April this year. We updated the Meta EA Fund management team on our plan changes in June for transparency and expectation management.

Exploration of bottleneck candidates

To gain a better understanding of the challenges operations staff at EA organizations face, we interviewed multiple people at various EA organizations in Europe. Nine interviews were conducted across eight organizations within our loose categorization of Funding, Meta EA and Far Future. In addition to these structured interviews, we strengthened our understanding of the challenges through more informal conversations with various people in operations roles, leaders, and other longtime EAs.

We analyzed the interviews and identified a set of twelve clusters of challenges, which we have organized under the following short descriptions (in no particular order):

  1. Seeking professional mentorship and coaching for operations staff at EA organizations
  2. Professional skill development
  3. Networking among operations staff
  4. Sharing best practices between organizations
  5. Making time for strategic thinking
  6. Hiring and developing junior associates to build internal capacity
  7. Effective internal communication and feedback loops
  8. Talent retention
  9. Standardization and documentation of internal policies
  10. Accessing external networks, e.g. for talent recruitment
  11. Cultural challenges in orgs and EA community
  12. Accurate expectations of operations and organization

Each challenge was mentioned by at least one interviewee, but we had little information about the relative importance and prevalence of these challenges across multiple organizations.

At EAG San Francisco in June we organised a workshop with 14 operations staff across eight organizations. Some of these had previously contributed as interviewees in the previous stage of our project, but most of them had not. First we presented our work so far and the challenges we had identified, and then we had the participants vote on which challenges they thought are most pressing for their organization.

Because it was easy to do, and to mitigate selection bias, we sent an email with an online form to organizations that didn’t participate at the workshop. Through the form we we got four more responses from three additional organizations.

Identifying top bottlenecks

The data showed a robust result, even when we tried different weights of the votes in our analysis. Five challenges stood out from the rest, and the first two in particular:

An important update is that we no longer think recruitment is the most important challenge for increasing the operations capacity at EA organizations. We don’t think it is much less important or tractable than we had thought; rather, we think other challenges are even more important and urgent. Therefore we will not be hosting an operations camp as initially planned.

What are we going to do now?

We are currently discussing our next steps and the timeline until EAG London. This project has morphed and increased in complexity, and the continuing research on these challenges and possible solutions to overcome them require experience and expertise we feel we are lacking. We are now expanding our team to counter this limitation. If you are interested in helping out as a volunteer or making your domain expertise available, we would like to hear from you in the comments or by email to post@effektivaltruisme.no

In broad strokes we imagine that in the time leading up to EAG London we will be onboarding new team members to the project, continue researching the top challenges and start planning for how we may explore and test possible solutions. At EAG London we intend to run a workshop or seminar for operations staff and managers to present our findings and suggestions. After EAG London we will summarize our work and most likely also share this in another forum post like this one.

3 comments

Comments sorted by top scores.

comment by HaydnBelfield · 2019-09-19T10:36:59.536Z · score: 9 (5 votes) · EA(p) · GW(p)

Great stuff! Looking forward to more

comment by Khorton · 2019-09-19T08:26:52.876Z · score: 8 (3 votes) · EA(p) · GW(p)

I strongly upvoted this post. I'm glad to see you changing your plans based on feedback and research, and for sharing those with the rest of the EA community.

comment by AllAmericanBreakfast · 2019-09-20T22:26:32.880Z · score: 2 (2 votes) · EA(p) · GW(p)

Same. Keep up the good work. I'm looking forward to hearing more.