Posts

Posit: Most AI safety people should work on alignment/safety challenges for AI tools that already have users (Stable Diffusion, GPT) 2022-12-20T17:23:03.728Z
Is there a good web app for doing the "equivalent bet test" from "How To Measure Anything"? 2022-11-10T14:17:57.649Z
What are some current, already present challenges from AI? 2022-06-30T15:44:09.266Z
What are current smaller problems related to top EA cause areas (eg deepfake policies for AI risk, ongoing covid variants for bio risk) and would it be beneficial for these small and not-catastrophic challenges to get more EA resources, as a way of developing capacity to prevent the catastrophic versions? 2022-06-13T17:32:47.071Z
Thought experiment: If you had 3 months to turn a stressed and unhappy person into a calm and happy one, what meta approach would you take? 2022-05-09T13:41:25.151Z
COVID Project idea: Transcription, translation, content reformatting, and summarization 2020-04-26T21:23:54.907Z
Which person-person introductions could be highly impactful, COVID related and otherwise? 2020-04-26T21:18:13.670Z
What are you working on, and how could people help? 2020-04-26T19:10:30.372Z
Which people and institutions are currently making influential decisions related to COVID response, and how could they be helped to have a better decision making process? 2020-04-25T19:36:01.891Z
What do you believe are the most critical open questions/hypotheses that could inform a more effective COVID response? 2020-04-25T19:33:01.489Z
What are some tractable approaches for figuring out if COVID causes long term damage to those who recover? 2020-04-25T19:27:57.797Z
If you had $10-100mm and a skilled team to improve the COVID response to minimize economic and human damage, what would you do? Or, how would you decide what to do? 2020-04-25T19:22:50.314Z
If it's true that Coronavirus is "close to pathologically misaligned with some of our information distribution and decisionmaking rituals", then what things would help the response? 2020-04-24T21:04:54.859Z
Covid Philanthropy Idea - Building Software Solutions for People Impacted 2020-04-17T22:25:40.767Z
What metrics may be useful to measure the health of the EA community? 2019-11-14T02:49:51.633Z
[Link] A Future for Neuroscience 2019-09-12T22:17:28.445Z
Who would you like to see do an AMA on this forum? 2019-08-25T16:58:14.283Z
How urgent are extreme climate change risks? 2019-08-01T01:32:23.400Z
If a psychedelic journey has influenced your life priorities, how so? 2019-07-13T18:40:08.851Z
In what ways and in what areas might it make sense for EA to adopt more a more bottoms-up approach? 2019-07-12T20:10:46.005Z
Who are the people that most publicly predicted we'd have AGI by now? Have they published any kind of retrospective, and updated their views? 2019-06-28T21:01:10.476Z
[Link] Seed stage philanthropy 2019-06-22T19:08:10.648Z
How would you define "disentanglement research"? 2019-06-22T02:13:44.472Z
Philanthropic moonshot idea: creating positive group identities 2019-06-21T23:11:48.756Z
Pros/cons of funding more research on whether psychedelics increase altruism? 2019-06-21T23:07:10.118Z
Becoming the person who would start a project 2019-06-21T17:34:59.155Z
Might the EA community be undervaluing "meta-research on how to make progress on causes?" 2019-06-16T04:38:34.239Z
Is trauma a potential EA cause area? 2019-05-31T22:04:17.690Z
Are there groups of medical symptoms that could be impactful to be turned into a specific diagnosis? I learned that PTSD was created as a result of lobbying, previously it was just disparate symptoms. 2019-05-16T01:07:23.603Z
Book recommendation: Loonshots 2019-05-03T18:30:12.254Z
Sharing my experience on the EA forum 2019-03-19T00:00:32.716Z
Concept: EA Donor List. To enable EAs that are starting new projects to find seed donors, especially for people that aren’t well connected 2019-03-16T21:12:48.865Z
An easy way for charities to increase revenue: Add Apple Pay and Google Pay to donation checkout 2018-03-18T20:25:12.232Z
Where can I donate to support insect welfare? 2017-12-31T01:40:17.518Z
Has someone migrated/exported the .impact HackPad? 2017-11-05T20:25:58.054Z
Note: Jeff Bezos posted on Twitter today asking for philanthropy ideas 2017-06-15T19:38:25.106Z

Comments

Comment by nonzerosum on What are some tractable approaches for figuring out if COVID causes long term damage to those who recover? · 2020-04-27T20:05:09.301Z · EA · GW

What makes you say it's low on neglectedness?

Comment by nonzerosum on What do you believe are the most critical open questions/hypotheses that could inform a more effective COVID response? · 2020-04-26T21:42:17.905Z · EA · GW

What best practices exist for responding to situations like COVID-19 (global, dynamic, hard to gather information around, etc) and how might they be applied?

Comment by nonzerosum on What do you believe are the most critical open questions/hypotheses that could inform a more effective COVID response? · 2020-04-26T21:41:18.726Z · EA · GW

How are decision makers and leaders deciding today? Based on what, what things could be built that would give them better inputs to their decisions in a way that they'd actually be likely to use and listen to?

Comment by nonzerosum on What do you believe are the most critical open questions/hypotheses that could inform a more effective COVID response? · 2020-04-26T21:40:26.730Z · EA · GW

Will this http://paulbuchheit.blogspot.com/2020/04/a-third-solution.html work?

Comment by nonzerosum on What do you believe are the most critical open questions/hypotheses that could inform a more effective COVID response? · 2020-04-26T21:39:52.042Z · EA · GW

Who/which type of people most need help right now related to the COVID response that most people are generally unaware of?

Comment by nonzerosum on What do you believe are the most critical open questions/hypotheses that could inform a more effective COVID response? · 2020-04-26T21:38:50.259Z · EA · GW

Based on human psychological biases, are there certain things that will almost always be handled irrationally in short-term urgent situations? If so, what potentially impactful project ideas does that imply?

Comment by nonzerosum on What do you believe are the most critical open questions/hypotheses that could inform a more effective COVID response? · 2020-04-26T21:36:51.954Z · EA · GW

Does the COVID pandemic present an opportunity for citizens to pressure leaders into using more effective decision making processes to decide what to do? And could some of those more effective decision making processes persist post-COVID, such that we end up with a lasting improvement in decision making at various levels of government?

Comment by nonzerosum on What do you believe are the most critical open questions/hypotheses that could inform a more effective COVID response? · 2020-04-26T21:35:21.872Z · EA · GW

Does the COVID pandemic present an opportunity to get around bureaucratic processes and make better software solutions for interfacing with government things - like PPP loans, unemployment, etc?

Comment by nonzerosum on What do you believe are the most critical open questions/hypotheses that could inform a more effective COVID response? · 2020-04-26T21:34:15.384Z · EA · GW

Who should be connected and collaborating where both parties would mutually want to, but they aren't?

Comment by nonzerosum on What do you believe are the most critical open questions/hypotheses that could inform a more effective COVID response? · 2020-04-26T21:33:43.004Z · EA · GW

From a subjective well being and psychological perspective, are there "free" things we can do that reduce the quality adjusted life years lost for people, without actually changing the literal response? For example, changes in ways things are framed, messaged, etc?

Comment by nonzerosum on What do you believe are the most critical open questions/hypotheses that could inform a more effective COVID response? · 2020-04-26T21:32:46.764Z · EA · GW

How can we most effectively collect, organize, summarize, and generally manage all of the real time information so that people can benefit from the best available information rather than just the information that they've otherwise seen? e.g. I believe some Chinese pre-print papers extolled the benefits of proning patients a month before I started hearing about it on US-centric Twitter circles

Comment by nonzerosum on What do you believe are the most critical open questions/hypotheses that could inform a more effective COVID response? · 2020-04-26T21:31:41.843Z · EA · GW

How can we connect individuals that are solving the same problems separately so that they can learn from each other and find camaraderie? e.g. factory owners, small business owners, etc

Comment by nonzerosum on What do you believe are the most critical open questions/hypotheses that could inform a more effective COVID response? · 2020-04-26T21:31:00.749Z · EA · GW

Is Sweden's approach working well and will it be working well in 1 month, and in 3 months?

Comment by nonzerosum on What do you believe are the most critical open questions/hypotheses that could inform a more effective COVID response? · 2020-04-26T21:30:06.485Z · EA · GW

Does COVID cause serious damage to people that recover?

Comment by nonzerosum on Which person-person introductions could be highly impactful, COVID related and otherwise? · 2020-04-26T21:29:22.939Z · EA · GW
  • Crisis leadership experts with mayors, governors, and other leaders
  • Psychologists/marketers with mayors, governors, and other leaders
  • Open Phil with mayors, governors and other leaders
  • Struggling business owners with each other
  • Doctors from different countries with each other (with translators to mediate perhaps)
  • Bill Gates with the prime minister of Israel
  • The heads of all major hospitals with each other, and with the President of the US
  • Factory owners with each other
Comment by nonzerosum on What are some tractable approaches for figuring out if COVID causes long term damage to those who recover? · 2020-04-26T21:17:49.859Z · EA · GW

It seems that if COVID causes long term fatigue (has been speculated but no strong evidence that I'm aware of) this could be negative for the EA community - i.e. if leaders of EA related orgs or key employees or other key EA contributors had fatigue issues and lower personal output, that seems bad.

Comment by nonzerosum on If it's true that Coronavirus is "close to pathologically misaligned with some of our information distribution and decisionmaking rituals", then what things would help the response? · 2020-04-25T19:19:30.258Z · EA · GW

A rough summary:

  • COVID response benefits from good information - and lots of the needed information is spread over many institutions, people, etc. It is beneficial to have up to date, accurate, and local data - this is hard.
  • COVID responses often involve/benefit from coordination across many different institutions/people/domains. This is hard.
  • COVID responses may benefit from extreme measures long after "corona fatigue" has set in and people and decision makers are sick of hearing about it, and just want things to "go back to normal"
  • Many people will need to make decisions about what to do as a result of / to respond to COVID. "Can you imagine conducting planning for an urban school district? A company with offices in multiple time zones? A company with a supply chain? A person responsible for industrial safety of a facility whose physical footprint includes one or more enclosed pockets of air?"
    • Many/most of these people don't have training or experience in making decisions like this.
  • There will be lots of contexts where decisions are made related to COVID where the expected value delta between a great decision and a bad one will be big, which gives big opportunity for positive impact in helping all the people who will be making COVID related/influenced decisions and response plans make *better* decisions/response plans
Comment by nonzerosum on How to Make Billions of Dollars Reducing Loneliness · 2019-08-31T20:10:04.058Z · EA · GW

See also: Bungalow, HubHaus, Common.

I wish someone would do shared living for people who want private living units (not just bedrooms) + shared common spaces, e.g. multiple houses on one block and a shared common space on that block. Makes co-living work for families or people who want a bit more privacy.

Comment by nonzerosum on Campaign finance reform as an EA priority? · 2019-08-30T18:14:51.832Z · EA · GW

See also https://act.represent.us/sign/our-strategy/

Comment by nonzerosum on Who would you like to see do an AMA on this forum? · 2019-08-27T16:01:06.281Z · EA · GW

is anonymous_ea one person's username, or is it a catch all username for some kind of anonymity feature on this forum? I've long wondered if anonymous_ea is a regular username or not

Comment by nonzerosum on How urgent are extreme climate change risks? · 2019-08-03T01:45:01.165Z · EA · GW

Please do link it!

Comment by nonzerosum on Ingredients for creating disruptive research teams · 2019-07-22T18:00:41.881Z · EA · GW

The book "Loonshots" also has useful lessons for anyone running/starting a research team or research lab.

Comment by nonzerosum on Raemon's EA Shortform Feed · 2019-06-27T05:10:47.147Z · EA · GW

Gotcha. I wonder whether it could create substantially more impact from doing over the long term yourself, or setting it up well for someone else to run long term. Obviously I have no context and your goals on the project but I've seen things where people do a short term project aiming for impact creation and where in the end they feel that they could've created much more impact by doing the thing in a more ongoing manner. So this note may or may not be relevant depending on the project and your goals :)

Comment by nonzerosum on Raemon's EA Shortform Feed · 2019-06-26T23:23:22.814Z · EA · GW

I'd offer that whatever you can do to make it possible to iterate on your grantmaking loop quickly will be useful. Perhaps starting with smaller grants on a month or even week cycle, running a few rounds there, and then scaling up. Don't try and make it near-perfect from the start, instead try and make it something that can become near-perfect because of iterations and improvements.

Comment by nonzerosum on What new EA project or org would you like to see created in the next 3 years? · 2019-06-24T20:53:34.199Z · EA · GW

This fiscal sponsor org would get to learn a lot about what different EA aligned donors do and don't like donating to, so you could imagine it providing a helpful service to donors (and EA orgs) of suggesting them orgs that they may be interested in checking out, based on their donation patterns. I could imagine this being appreciated by the donors given that it could have enough data points to make genuinely useful recommendations when those opportunities arise.

Comment by nonzerosum on [deleted post] 2019-06-24T18:48:35.758Z

Oops - thanks!

Comment by nonzerosum on How would you define "disentanglement research"? · 2019-06-22T02:19:33.164Z · EA · GW

A comment to add to my OP: It seems like a really useful concept and I can imagine that having a central place that defines what disentanglement research is may be useful, and the concept generally becoming more known may also be useful, so that then people can easily reference that, and others will understand what someone means when they say a field needs disentanglement research or they're doing disentanglement research, people can share advice or host events focused on disentanglement research, funders can self-identify as funders interested in supporting disentanglement research in specific or various fields, etc.

Comment by nonzerosum on How would you define "disentanglement research"? · 2019-06-22T02:17:54.406Z · EA · GW

Another possible answer (and an example of where the term is being used!): "What is needed in an early stage is disentanglement- structuring the research field, identifying the central questions, and clarifying concepts." https://forum.effectivealtruism.org/posts/oovy5XXdCL3TPwgLE/a-case-for-strategy-research-what-it-is-and-why-we-need-more

Comment by nonzerosum on How would you define "disentanglement research"? · 2019-06-22T02:16:37.566Z · EA · GW

Answer from Helen Toner: "structuring concrete agendas out of an amorphous blob of worries" https://twitter.com/Effect_Altruism/status/927219486201085957

Comment by nonzerosum on How would you define "disentanglement research"? · 2019-06-22T02:16:18.696Z · EA · GW

Answer from carrickflynn who originally used the term: "This is a squishy made-up term I am using only for this post that is sort of trying to gesture at a type of research that involves disentangling ideas and questions in a “pre-paradigmatic” area where the core concepts, questions, and methodologies are under-defined. (Nick Bostrom is a fantastic example of someone who is excellent at this type of research.)" https://forum.effectivealtruism.org/posts/RCvetzfDnBNFX7pLH/personal-thoughts-on-careers-in-ai-policy-and-strategy#rxAi3ssD8DtSHJtMG

Comment by nonzerosum on How would you define "disentanglement research"? · 2019-06-22T02:15:05.971Z · EA · GW

Possible answer: It's taking a space and answering questions like – what's possible, what could & what should our goals be, main hypotheses and things that would inform what the best directions are, etc.

Comment by nonzerosum on Becoming the person who would start a project · 2019-06-21T19:36:34.743Z · EA · GW

Other thoughts:

Benefit of people writing public posts on their topics of interest is that it forces thoughts to be clarified and to "come face to face with reality"

Downside of public writing is that it could lead to consistency bias / ossification of opinions

Another upside of public writing on things is that it builds momentum, provides positive feedback and rewards. Which is probably very beneficial and may seem small but the power of positive feedback loops seems important to not underestimate.

Comment by nonzerosum on A case for strategy research: what it is and why we need more of it · 2019-06-21T19:34:32.032Z · EA · GW

I'm really glad to see this post – it's what I was thinking of when I asked this question on the forum: https://forum.effectivealtruism.org/posts/icTEffSCdtLSoSrqi/might-the-ea-community-be-undervaluing-meta-research-on-how

Comment by nonzerosum on Becoming the person who would start a project · 2019-06-21T17:36:36.343Z · EA · GW

This is a very unstructured thought that came into my head this morning. Normally I might avoid posting it until it's more polished, but comments on this forum have given me the sense that it can actually be good to err on the side of sharing even if unpolished, contributing to the community zeitgeist where someone else may then be able to polish or remix or make use of the thought.

Comment by nonzerosum on Is trauma a potential EA cause area? · 2019-06-11T19:15:55.228Z · EA · GW

And I'm also very interested in the direct impact, too.

Comment by nonzerosum on Is trauma a potential EA cause area? · 2019-06-11T19:15:30.667Z · EA · GW

Thanks for that question! Weakly held. Some sense that we're under-invested in "improving coordination" (see: http://www.existential-risk.org/concept.pdf).

But it's a good point that it would be hard! And I agree that tightly knit groups may be a better approach for this.

e.g. trauma reduction for a group of AI safety researchers to help them better coordinate, or something like that.

Comment by nonzerosum on Is trauma a potential EA cause area? · 2019-06-05T23:29:06.086Z · EA · GW

I mean EA impact of reducing trauma, not impact of MDMA therapy on trauma (which I agree seems large).

Similar to how 80000hours gives a ranking of the 'impact' of different causes, I wonder how "reducing trauma" would compare on their impact assessment.

Comment by nonzerosum on Is trauma a potential EA cause area? · 2019-06-04T19:09:50.300Z · EA · GW

Yes, agreed. In particular though I'm wondering about the "impact" piece and separate of possible interventions/tractability, how trauma might rate on the "impact" and "neglectedness" pieces.

Comment by nonzerosum on Is trauma a potential EA cause area? · 2019-06-04T19:08:16.439Z · EA · GW
more than as something which "improves coordination"

What makes you say that? I have the sense that the less trauma people have, the easier they'll find it, and the more desire they'll have, to co-operate and coordinate.

Comment by nonzerosum on Is trauma a potential EA cause area? · 2019-05-31T22:04:45.440Z · EA · GW

Related but separate: https://forum.effectivealtruism.org/posts/C5diBK7sJmoYWdrCs/is-preventing-child-abuse-a-plausible-cause-x

Comment by nonzerosum on Considering people’s hidden motives in EA outreach · 2019-05-31T19:34:20.273Z · EA · GW

This is an excellent post. I agree that status is a ridiculously powerful driver of human behavior. Based on your section of how EA can help increase status, what do you think is the single most promising strategy that EA could implement to make joining EA higher status? (Also a side note I'd add is that status *from who* is important. People outside EA don't care about within-EA status currency, yet, they care about status currency from their existing peers and people they respect. So they'd need to believe that joining EA makes them higher status outside of EA.)

Also, has anyone looked at whether EA is at the right time for scaling? In startups there's the framework that you want to solve your value hypothesis first, and then once you've done that, and only then, you should focus on your growth hypothesis. Basically get it working just how you like it with a small number of customers/users and then focus on scaling up. Is EA at the point where people want to focus on scaling? I think it probably is, but I still wanted to ask the obvious question.

Comment by nonzerosum on Cash prizes for the best arguments against psychedelics being an EA cause area · 2019-05-22T06:45:36.642Z · EA · GW

What makes you conclude that there's a lot of money to be made in it? My prior is the opposite. MDMA and psilocybin themselves aren't patentable at this point. Yes, delivery mechanisms could be and new or related unpatented compounds could be. But any for profit company will likely be competing against at least a non profit or two. And my research on pricing is that having a single competitor massively reduces margins and profitability. Also dosing will be highly infrequent which should also reduce the profits for any psychedelic pharma companies.

Given the risk in pharma r&d, potential profits presumably need to be very large to justify investment. My sense is that the expected rate of return may be lower than other similarly risky projects and therefore it won't be particularly suited to for profits. But maybe it'll be somewhat profitable and the reward of positive impact will make up the difference. Or maybe thanks to many years of use, these compounds have much lower risk and therefore make sense from a risk reward perspective to be pursued by pharma investors/companies.

But I'm skeptical of that and I expect that we'll need altruistically motivated people to make progress, and if it's left to for profits the industry would stagnate. (One piece of evidence is that the for profit pharma world has seemingly made no progress in the psychedelic field since about the 1970s with the exception of compass pathways a few years ago)

Comment by nonzerosum on Cash prizes for the best arguments against psychedelics being an EA cause area · 2019-05-13T17:09:21.922Z · EA · GW

For anyone worried their comment won't get attention vs the existing ones, I'm enjoying this thread and am watching for and voting where relevant on new ones, FYI.

Comment by nonzerosum on Cash prizes for the best arguments against psychedelics being an EA cause area · 2019-05-10T23:18:15.539Z · EA · GW

Tangentially related and perhaps of interest to some readers of this thread, though not a prize submission comment:

My nomination for the "three books" for psychedelic therapy would be

The "Why" Book: Pollan's How to Change Your Mind

The "What" Book: MAPS's A Manual for MDMA-Assisted Psychotherapy in the Treatment of PTSD (alternatives would be this treatment protocol from Phase 2 MDMA trials and Grof's LSD Psychotherapy)

The "How" Book: R. Coleman's Psychedelic Psychotherapy: A User-friendly Guide for Psychedelic Drug-assisted Psychotherapy (the runner up would be Fadiman's The Psychedelic Explorer's Guide)

Comment by nonzerosum on Concept: EA Donor List. To enable EAs that are starting new projects to find seed donors, especially for people that aren’t well connected · 2019-04-17T20:47:18.464Z · EA · GW

Thanks, and I'll look forward to reading your upcoming post!

Comment by nonzerosum on Concept: EA Donor List. To enable EAs that are starting new projects to find seed donors, especially for people that aren’t well connected · 2019-03-20T19:49:51.568Z · EA · GW

Ok, the project is now on indefinite hiatus. I'll seek to deeply understand all the critiques of it first if I come back with another attempt in the future.

I hope other groups will try and address the problem that this concept was designed to address, in a way that is highly net +EV.

Jan or others, what ideas might you suggest for addressing the challenge of an EA without a strong donor network to get a super early stage grant, in a way that avoids significant potential downsides?

Comment by nonzerosum on Concept: EA Donor List. To enable EAs that are starting new projects to find seed donors, especially for people that aren’t well connected · 2019-03-17T20:08:13.031Z · EA · GW

Thanks Michael!

My understanding is that EA grants and this are both working towards addressing roughly the same problem: the difficulty of getting seed or "pre-seed" grants for new EA organizations, especially for people who are not well connected.

When someone is seeking grants, the more possible grantors the better – the startup analogy would be that EA grants is an individual angel investor (and, it seems, one that isn't currently accepting pitches), and this concept is analogous a list of active angel investors – they are complementary.

So EA grants would be listed on this site as one of the sources of grants.

Comment by nonzerosum on Concept: EA Donor List. To enable EAs that are starting new projects to find seed donors, especially for people that aren’t well connected · 2019-03-17T20:04:45.102Z · EA · GW

Thank you Brendon, I've sent you a PM now!

One thought, some funders may be uncomfortable with being publicly listed (perhaps due to concerns about lots of people contacting them), but a certain subset of funders could be pretty on board with the idea.

Agreed. One thought I've had is that donors that have concerns like this but that are still interested could set up an anonymous email address that forwards to their main inbox, and list themselves as that. This way if it ever becomes too much for them, they can be removed from the site and it's somewhat more separate/compartmentalized from their real name. I'm open to additional community input on other ways to allow donors to be listed in a way that is semi-anonymous and preserves much of the upside for donors and potential grantees, while reducing concerns from donors like that.

Comment by nonzerosum on SHOW: A framework for shaping your talent for direct work · 2019-03-17T01:06:02.657Z · EA · GW

Yes. This makes me think of investor Keith Rabois' notion of "barrels" vs "ammunition":

If you think about people, there are two categories of high-quality people: there is the ammunition, and then there are the barrels. You can add all the ammunition you want, but if you have only five barrels in your company, you can literally do only five things simultaneously. If you add one more barrel, you can now do six things simultaneously. If you add another one, you can do seven, and so on. Finding those barrels that you can shoot through — someone who can take an idea from conception to live and it’s almost perfect — are incredibly difficult to find. This kind of person can pull people with them. They can charge up the hill. They can motivate their team, and they can edit themselves autonomously. Whenever you find a barrel, you should hire them instantly, regardless of whether you have money for them or whether you have a role for them. Just close them.
https://firstround.com/review/Keith-Rabois-on-the-role-of-a-COO-how-to-hire-and-why-transparency-matters/

The attitude you're describing reminds me of the attitude that Keith Rabois refers to as a "barrel."

Comment by nonzerosum on Animal Charity Evaluators Introduces the Recommended Charity Quiz · 2018-03-24T18:54:51.203Z · EA · GW

Got it, thanks for passing it along and understood!