How to become more agentic, by GPT-EA-Forum-v1 2022-06-20T06:50:14.914Z
Training a GPT model on EA texts: what data? 2022-06-04T05:59:49.785Z


Comment by JoyOptimizer on How to become more agentic, by GPT-EA-Forum-v1 · 2022-06-20T08:59:18.519Z · EA · GW

One goal is to make it easier to understand Effective Altruism through an interactive model.

I'm sick with COVID right now. I might respond in greater depth when I'm not sick.

Comment by JoyOptimizer on Digital people could make AI safer · 2022-06-11T02:37:26.341Z · EA · GW

Digital humans would be much cheaper to query than biological humans. This is because:

An efficient general intelligence on a biological substrate uses a brain structure. It's unclear if that same structure would be efficient on silicon or photonic processors.

Comment by JoyOptimizer on Training a GPT model on EA texts: what data? · 2022-06-11T01:01:04.804Z · EA · GW


Comment by JoyOptimizer on Training a GPT model on EA texts: what data? · 2022-06-05T01:38:21.770Z · EA · GW
  • A book on ethics seems worth considering. Can you tell me more about how the ideas relate to EA? Nonetheless, these are useful sources for future projects regarding AI alignment.
  • Is only about utilitarianism? If so, the rest of the training set should already have a sufficient degree of utilitarian bias.
  • How influential is FHI's texts on the EA community?
  • This seems like a good text to make the model more generally coherent.
Comment by JoyOptimizer on Training a GPT model on EA texts: what data? · 2022-06-05T01:31:49.981Z · EA · GW

Thanks for your thoughts.

Comment by JoyOptimizer on Training a GPT model on EA texts: what data? · 2022-06-04T18:29:14.459Z · EA · GW

The goal is not to create a model to create the most good. While aligning an AI with values and principles could be a potentially interesting project, the goal of this project is to create a descriptive model of the EA community, not a normative one of the idealized EA community.

I believe GPT-3 can do more than memorizing specific objectives like malaria nets. Infusing principles deeply would need to happen using more sophisticated techniques, probably post-finetuning. 

upbias (-1, 1) is the Forum editors' or users' perspective on the fraction of upvotes that happened due to fear, other negative emotions, or limited critical thinking that the post motivated otherwise

How do I calculate upbias?

Thank you for the books to use in the dataset. I will review each of them.

The original GPT-3 was trained largely on a web crawl known as Common Crawl. Users on the internet, especially tend to optimize for attention. Unlike GPT-3, GPT-J's training set is around a third academic sources.

SSC blog includes posts like Meditations on Moloch or the review of Seeing Like a State. These seem like perspectives important to the EA community. Are you suggesting I include posts based on if they're linked from the EA Forum frequently?

I'll try to crawl the EA Funds' grant program as well.

Comment by JoyOptimizer on Training a GPT model on EA texts: what data? · 2022-06-04T17:04:28.525Z · EA · GW

How much % of the training mix should be the GiveWell blog and how much should be the 80,000 hours blog? In other words, how many bytes of blog posts should be used from each, relative to the entire dataset?

What kinds of posts are on each blog, and which best reflects the wider EA community, and which reflects the professional EA community? How can this be used to create a dataset?

I also checked and neither blog has a direct view count measure-- some other proxy metric would need to be used.

Comment by JoyOptimizer on Training a GPT model on EA texts: what data? · 2022-06-04T16:24:55.153Z · EA · GW

Thanks for these sources.

How should GiveWell blog and 80,000 hours blog weighted against each other? My instinct is to weight by the number of views.

Posts/comments in Facebook groups, slack groups, and discord groups?

Does the EA community have the norm that these comments are public? I want to make sure the consent of participants is obtained.

Comment by JoyOptimizer on New Harvest, the nonprofit nucleus of cellular agriculture, is in crisis. Emergency town hall on 6/10. · 2022-06-04T15:07:12.606Z · EA · GW

What is your budget spent on? I want to help you be run more efficiently.

Comment by JoyOptimizer on Unflattering reasons why I'm attracted to EA · 2022-06-04T08:02:36.098Z · EA · GW

This is a list of EA biases to be aware of and account for.

Comment by JoyOptimizer on Global health is important for the epistemic foundations of EA, even for longtermists · 2022-06-04T07:59:27.848Z · EA · GW

The definition of health here should include mental and socioemotional health, since they affect how people reason and relate to each other, respectively.