Announcing Epoch: A research organization investigating the road to Transformative AI 2022-06-27T13:39:16.475Z
Information security considerations for AI and the long term future 2022-05-02T20:53:56.389Z
Compute Research Questions and Metrics - Transformative AI and Compute [4/4] 2021-11-28T22:18:13.960Z
Compute Governance and Conclusions - Transformative AI and Compute [3/4] 2021-10-14T07:55:49.544Z
Forecasting Compute - Transformative AI and Compute [2/4] 2021-10-01T08:25:50.524Z
What is Compute? - Transformative AI and Compute [1/4] 2021-09-23T13:54:33.045Z
Transformative AI and Compute [Summary] 2021-09-23T13:53:17.477Z


Comment by lennart on Announcing: EA Engineers · 2022-07-04T17:50:53.333Z · EA · GW

Just came here to comment the same. :)

See this profile by 80k, this post, and my sequence for more.

Also, don't hesitate to reach out if you want to hear more about roles for AI hardware experts or if someone is interested.

Comment by lennart on Effektiv Spenden - Review of the Year 2021 · 2022-06-01T21:49:49.285Z · EA · GW

donations from Switzerland accounting for 48% of our total donation volume last year.

Wow! Again, thanks for enabling this. :) So glad to hear that it worked out.

Comment by lennart on Help us make civilizational refuges happen · 2022-04-13T18:37:39.238Z · EA · GW

We got plenty of bunkers, oh I mean refuges, in Switzerland - as Luisa Rodriguez pointed out. Happy to help if this moves forward.

We also got a small one in my basement, happy to co-host a trial run. :)

Comment by lennart on EA Forum's interest in cause-areas over time and other statistics · 2022-04-10T16:41:48.284Z · EA · GW

That's a cool idea! Thanks for sharing and crunching those numbers.

I'd note that we also have the Alignment Forum and LessWrong where the majority of AI-related posts end up. So AI causes might be underrepresented and we could have missed the change over time there (and I'd guess that we have seen an increase over time). Maybe quickly running an analysis on their dataset?

Comment by lennart on Making Community Building a more attractive career path · 2022-04-09T14:10:45.267Z · EA · GW

Thanks for the update and the concise summary. I enjoyed the bullet point format and sharing the insights of this survey publicly. Great job!

For context, CEA used to pay $70,000 annually to community builders in San Francisco, with lower salaries in areas with lower costs of living.

During which period was this the practice?

Also, now the update is:

Now CEA have updated their payment policy, with salaries baselined to $90,000 in San Francisco, with a cost of living adjustment for other locations, ...

That's starting when?

Comment by lennart on Making Community Building a more attractive career path · 2022-04-09T14:06:37.572Z · EA · GW

Indeed. Given that the payment is a grant and you're working for [name of your local org], what's stopping you from using an appropriate title? Be it CEO, director, strategy, program director, etc. Most nationwide EA groups do so and also a handful of local groups.

Comment by lennart on University Groups Should Do More Retreats · 2022-04-06T19:57:13.760Z · EA · GW

Great post Trevor! I share your message. :)


The retreat features lots of people who are already “on board” with EA. At least a few should be at least moderately charismatic people for whom EA is a major consideration in how they make decisions.

That's also my experience. While "some buy-in" already helps a lot, people with more experience provide in my experience even "more value" - sharing their EA story, their connected struggles, and maybe how they managed to work on EA-adjacent stuff.
You bring something along these lines up later by saying "The retreat includes “professional EAs.”".

Therefore, I'd also encourage the more "senior people" to join retreats from time to time. You can provide an enormous value. And to all the organizers, reach out to them!

Comment by lennart on New forum feature: preview & embed Our World in Data charts · 2022-04-05T16:58:57.262Z · EA · GW

You can implement them easily in Ghost by using the HTML embed. You find this when you click on the bottom right corner the share button and click "embed".

Comment by lennart on What I learnt from attending EAGx Oxford (as someone who's new to EA) · 2022-04-03T09:11:48.759Z · EA · GW

Glad to hear you're now more excited. :)


I know there were a few meet-ups for other groups such as religious EA's, it would be great if there had been something like 'lonely and new meetup'?

I remember that at EAG London 2021 there was an event for newcomers and you were even matched with a mentor. Maybe we should copy this or make it a group effort for all the conferences.

Comment by lennart on Time-Time Tradeoffs · 2022-04-01T17:46:22.442Z · EA · GW

Thanks for writing this, Akash! :) I’ve been following a similar paradigm for quite a while, some things I did:

  • Meetings only in the afternoon - the less important/demanding the further into the evening
  • Focused work time is scarce and, therefore my morning time is a resource to protect
  • Taking my location into consideration. As you outline, when I'm already somewhere I should make use of it.
  • Stopping to work when I feel like I don't make progress. Trading this time against my future "leisure time" where I'll hopefully be more energetic.
Comment by lennart on The longtermist AI governance landscape: a basic overview · 2022-03-25T14:20:00.633Z · EA · GW

The Cooperative AI Foundation works on an agenda relevant to s-risks.

Comment by lennart on Compute Governance and Conclusions - Transformative AI and Compute [3/4] · 2022-01-04T11:40:30.770Z · EA · GW

I'm still holding the same view that (a) we will probably see a switch in funding distribution and (b) if this does not happen those groups won't be able to compete with SOTA models.

we will and should see a switch in funding distribution at publicly funded AI research groups

I would change my mind if we find more evidence towards algorithmic innovation being a stronger or the significant driver.

Some recent updates in regards to providing more funding for infrastructure include The National AI Research Cloud which is currently being investigated by the US government or Compute Canada.

Comment by lennart on Forecasting Compute - Transformative AI and Compute [2/4] · 2021-11-02T13:45:30.045Z · EA · GW

Thanks, Nuño.

Comment by lennart on What is Compute? - Transformative AI and Compute [1/4] · 2021-10-07T19:17:53.006Z · EA · GW

The described doubling time of 6.2 months is the result when the outliers are excluded. If one includes all our models, the doubling time was around ≈7 months. However, the number of efficient ML models was only one or two.

Comment by lennart on Forecasting Compute - Transformative AI and Compute [2/4] · 2021-10-07T19:13:51.656Z · EA · GW

For "Semiconductor industry amortize their R&D cost due to slower improvements" the decreased price comes from the longer innovation cycles, so the R&D investments spread out over a longer time period. Competition should then drive the price down.

While in contrast "Sale price amortization when improvements are slower" describes the idea that the sale price within the company will be amortized over a longer time period given that obsolescence will be achieved later.

Those ideas stem from Cotra's appendices: "Room for improvements to silicon chips in the medium term".

Comment by lennart on Forecasting Compute - Transformative AI and Compute [2/4] · 2021-10-07T19:03:37.559Z · EA · GW

Thanks, Sammy. Indeed this is related and very interesting!

Comment by lennart on Transformative AI and Compute [Summary] · 2021-09-30T07:58:29.777Z · EA · GW

Thanks, I've edited it.

Comment by lennart on Transformative AI and Compute [Summary] · 2021-09-30T07:40:03.836Z · EA · GW

Thanks, Michael.

  1. n is counting the number of ML systems in the analysis at the point of writing. (We have added more systems in the meantime). An example for such a system is GPT-3, AlphaFold, etc. - basically a row in our dataset.
  2. Right, good point. I'll add the number of systems for the given time period.
  3. That's hard to answer. I don't think OpenAI misinterpreted anything. For the moment, I think it's probably a mixture of:
    • the inclusion criteria for the systems on which we base this trend
    • actual slower doubling times for reasons which we should figure out Nonetheless, as outlined in Part 1 - Section 2.3, I did not interpret those trends yet but I'm interested in a discussion and trying to write up my thoughts on this in the future.
Comment by lennart on What is Compute? - Transformative AI and Compute [1/4] · 2021-09-27T07:39:31.240Z · EA · GW

I have been wondering the same. However, given that OpenAI's "AI and Compute" inclusion criteria are also a bit vague, I'm having a hard time which of our data points would fulfill their criteria.

In general, I would describe our dataset matching the same criteria because:

  1. "relatively well known" equals our "lots of citations".
  2. "used a lot of compute for their time" equals our dataset if we exclude outliers from efficient ML models.
    • There's a recent trend in efficient ML models that achieve similar performance by using less compute for inference and training (those models are then used for e.g., deployment on embedded systems or smartphones).
  3. "gave enough information to estimate the compute": We also rely on estimates from us or the community based on the information available in the paper. For a source of the estimate see the note on the cell in our dataset.
    • We're working on gathering more compute data by directly asking researchers (next target n=100) .

I'd be interested in discussing more precise inclusion criteria. As I say in the post:

Also, it is unclear on which models we should base this trend. The piece AI and Compute also quickly discusses this in the appendix. Given the recent trend of efficient ML models due to emerging fields such as Machine Learning on the Edge, I think it might be worthwhile discussing how to integrate and interpret such models in analyses like this — ignoring them cannot be the answer.

Comment by lennart on Careers Questions Open Thread · 2020-12-25T10:54:02.807Z · EA · GW

Also happy to help on a more local level:

If you're not already in contact with EA Zürich, just sent us a mail and we will get back to you:

Comment by lennart on Berkeley REACH EA Weekend Workshop · 2019-04-29T14:40:50.855Z · EA · GW

Is there any chance to get a hold of the material which you used for this workshop?