I'm interviewing Nova Das Sarma about AI safety and information security. What shouId I ask her?

post by Robert_Wiblin · 2022-03-25T15:38:04.361Z · EA · GW · 15 comments

This is a question post.

Next week for The 80,000 Hours Podcast I'll be interviewing Nova Das Sarma.

She works to improve computer and information security at Anthropic, a recently founded AI safety and research company.

She's also helping to find ways to provide more compute for AI alignment work in general.

Here's an (outdated) LinkedIn and in-progress personal website, and an old EA Forum post [EA · GW] from Claire Zabel and Luke Muehlhauser about the potential EA relevance of information security.

What should I ask her?

Answers

answer by Jaime Sevilla · 2022-03-25T17:58:06.315Z · EA(p) · GW(p)

What are the key companies Nova would like to help strenghten their computer security?

answer by Jaime Sevilla · 2022-03-25T18:06:50.515Z · EA(p) · GW(p)

Any hot takes on the recent NVIDIA hack? Was it preventable? Was it expected? Any AI Safety implications?

answer by Jaime Sevilla · 2022-03-25T18:00:03.507Z · EA(p) · GW(p)

Why is Anthropic working on computer security? What are the key computer security problems she thinks is prioritary to solve?

answer by Jaime Sevilla · 2022-03-25T17:56:52.393Z · EA(p) · GW(p)

How worried is she about dual use of https://hofvarpnir.ai/  for capability development?

answer by Jaime Sevilla · 2022-03-25T17:56:09.115Z · EA(p) · GW(p)

What AI Safety research lines are most bottlenecked on compute?

answer by Jaime Sevilla · 2022-03-26T15:01:43.597Z · EA(p) · GW(p)

Is there any work on historical studies of leaks in the ML field? 

Would you like such a project to exist? What sources of information are there?

answer by Erich_Grunewald · 2022-03-25T20:29:37.095Z · EA(p) · GW(p)

How large a portion of infosec risk is due to software/hardware issues and how large due to social engineering?

answer by JulianHazell · 2022-03-25T19:39:59.705Z · EA(p) · GW(p)

How important is compute for AI development relative to other inputs? How certain are you of this?

answer by JulianHazell · 2022-03-25T19:37:42.106Z · EA(p) · GW(p)

There have been estimates that there are around 100 AI researchers & engineers focused on AI alignment. This seems quite small given the scale of the problem. What are some of the bottlenecks for scaling up, and what is being done to alleviate this?

answer by Jide · 2022-03-26T11:40:42.800Z · EA(p) · GW(p)

I've heard that there could be a trade-off between robust info security measures and hiring top talent for AI research. (I think the reasoning was something like: If state of the art AI research is a seller’s market and improving info security is inconvenient, some employees may be unwilling to comply with these measures and just take their talent elsewhere.) How accurate is this in your experience?

answer by Erich_Grunewald · 2022-03-25T20:30:29.619Z · EA(p) · GW(p)

To what extent if any is centralisation/decentralisation useful in improving infosec?

answer by Erich_Grunewald · 2022-03-25T20:30:11.448Z · EA(p) · GW(p)

The obvious way to reduce infosec risk is to beef up security. Another is to disincentivise actors from attacking in the first place. Are there any good ways of doing that (other than maybe criminal justice)?

answer by JulianHazell · 2022-03-25T19:36:10.401Z · EA(p) · GW(p)

What opportunities, if any at all, do individual donors (or people who might not have suitable backgrounds for safety/governance careers) have to positively shape the development of AI?

15 comments

Comments sorted by top scores.

comment by MathiasKB (MathiasKirkBonde) · 2022-03-25T19:46:51.127Z · EA(p) · GW(p)

Thank you for asking this question on the forum! 

It has been somewhat frustrating to follow you on Facebook and seeing all these great people you were about to interview, without being able to contribute with anything.

comment by JulianHazell (julianhazell) · 2022-03-25T19:35:36.260Z · EA(p) · GW(p)

What opportunities, if any at all, do individual donors (or people who might not have suitable backgrounds for safety/governance careers) have to positively shape the development of AI?