Posts

[Event] Join Metaculus for Forecast Friday on March 24th! 2023-03-17T22:47:01.657Z
Metaculus's Climate Tipping Points Tournament Enters Round 2 2023-03-16T18:48:45.133Z
Metaculus Introduces New 'Conditional Pair' Forecast Questions for Making Conditional Predictions 2023-02-20T13:36:19.504Z
christian's Shortform 2023-02-14T21:44:31.159Z
Metaculus Launches Climate Tipping Points Tournament With The Federation of American Scientists 2023-01-27T19:33:18.317Z
Metaculus Year in Review: 2022 2023-01-06T01:23:07.029Z
Metaculus Announces The Million Predictions Hackathon 2022-11-10T20:00:00.349Z
Metaculus Launches FluSight Challenge 2022/23 2022-10-24T17:10:51.361Z
Announcing Metaculus's 'Red Lines in Ukraine' Forecasting Project 2022-10-21T22:13:05.610Z
Metaculus is building a team dedicated to AI forecasting 2022-10-18T16:08:10.848Z
Metaculus Launches the 'Forecasting Our World In Data' Project to Probe the Long-Term Future 2022-10-14T17:00:31.130Z
Metaculus is seeking experienced leaders, researchers & operators for high-impact roles 2022-07-10T14:29:59.282Z
Metaculus seeking Analytical Storytellers to write essays fortified with testable predictions 2021-10-06T04:39:42.874Z
[Event] A Metaculus Open Panel Discussion: How Forecasts Inform COVID-19 Policy 2021-10-04T18:17:54.960Z

Comments

Comment by christian (christianM) on christian's Shortform · 2023-03-21T21:37:50.492Z · EA · GW

🔎 Discover More Questions Relevant to You With Metaculus's New Filter & Sort Tools

Where do you disagree with other forecasters? Which community predictions have shifted the most? And what was that nanotech forecast you meant to update? Metaculus has introduced new filter & sort tools that provide more control over the forecast feed so you can find the questions that matter to you.

Learn more

Comment by christian (christianM) on christian's Shortform · 2023-03-13T18:25:16.224Z · EA · GW

🕛 New Metaculus Feature: Now You Can Set Custom Forecast Notifications

Metaculus has upgraded its forecast notifications to make it easier to follow the questions you care about so you can keep your predictions fresh and stay up to date as stories develop. Set a single notification that alerts you whenever the Metaculus community's prediction shifts, when new comments are made, when a question nears its close date, or at regular intervals over a question's life. Learn more about forecast notifications and how you can use them here

 

Comment by christian (christianM) on christian's Shortform · 2023-02-25T01:16:39.130Z · EA · GW

Metaculus is conducting its first user survey in nearly three years. If you have read analyses, consumed forecasts, or made predictions on Metaculus, we want to hear from you! Your feedback helps us better meet the needs of the forecasting community and is incredibly important to us. 


Take the short survey here — we truly appreciate it! (We'll be sure to share what we learn.) 

Comment by christian (christianM) on christian's Shortform · 2023-02-16T05:11:03.374Z · EA · GW

🔬 Metaculus Officially Launches API
Metaculus has officially launched the Metaculus API, providing access to a rich, quantitative database of aggregate forecasts on 7000+ questions. Start exploring, analyzing, and building here.

Comment by christian (christianM) on christian's Shortform · 2023-02-14T21:44:31.570Z · EA · GW

New Metaculus Feature: Reaffirming Predictions
Now you can more easily find predictions that need updating and reaffirm those you stand by. Learn more about this new feature here.

Comment by christian (christianM) on Metaculus Launches Climate Tipping Points Tournament With The Federation of American Scientists · 2023-01-29T18:15:50.251Z · EA · GW

Hey @jackva, are you asking about adding more questions to this tournament or about creating a prize pool for some other set of questions of your choosing? If the latter, you can email us at hello@metaculus.com to discuss developing a new initiative!

Comment by christian (christianM) on Metaculus Year in Review: 2022 · 2023-01-06T17:02:41.071Z · EA · GW

It's a great idea, and I like how you've fleshed it out. I'll pass this along to our Product team. 

For your calibration plot, you can actually use the 'evaluated at' dropdown and watch your plot adjust on the fly. 

 

Comment by christian (christianM) on Metaculus Launches the 'Forecasting Our World In Data' Project to Probe the Long-Term Future · 2022-10-19T16:24:58.453Z · EA · GW

Hey Nathan — currently, there are only plans to publish the forecasts on Metaculus. We'll let you know if that changes, however. 

Comment by christian (christianM) on Who's hiring? (May-September 2022) [closed] · 2022-10-18T16:00:36.510Z · EA · GW

Metaculus is building a team dedicated to AI forecasting

The speed, sophistication, and impacts of AI technology development together comprise some of the most astonishing and significant events of our lifetimes. AI development promises both enormous risks and opportunities for society. Join our AI forecasting team and help humankind better navigate this crucial period. 

Open roles include:

Machine Learning Engineer - AI Forecasting

You’ll work to enhance the organization and searchability of our AI analyses, ensure that the AI-related data and thinking that we rely on is up-to-date, comprehensive, and well organized, and deliver (via modeling) forecasts on an enormous set of questions concerning the trajectory of AI.

Research Analyst - AI Forecasting

You’ll engage deeply with ideas about the future of AI and its potential impacts, and share insights with the AI research and forecasting communities and with key decision makers. You’ll use crowd forecasting to help generate these insights, writing forecasting questions that are informative and revealing, facilitating forecasting tournaments, and coordinating with Pro Forecasters.

Quantitative Research Analyst - AI Forecasting

You’ll use quantitative modeling to improve our ability to anticipate the future of AI and its impact on the world, enhance our AI-related decision making capabilities, and enable quantitative evaluation of ideas about the dynamics governing AI progress.

You can learn about our other high-impact, open positions here.

Comment by christian (christianM) on Who's hiring? (May-September 2022) [closed] · 2022-08-08T18:36:08.647Z · EA · GW

At Metaculus, our aim is to improve human decision-making and coordination at scale by increasing analytic capacity, reasoning, and judgment. With the unique capabilities of the Metaculus forecasting platform, our innovative programs, and our long-term partnerships, we enable a range of stakeholders and contributors to engage in a process of collective reasoning, forecasting, and ultimately, more informed action. 

We are hiring for a number of roles, including the following: 

Backend Engineer

Full-Stack Engineer

Front-End Engineer

Data Scientist (Causality)

AI Forecasting Lead

CTO (Chief Technology Officer)

Forecasting Program Director

Comment by christian (christianM) on Metaculus seeking Analytical Storytellers to write essays fortified with testable predictions · 2022-01-27T03:52:43.108Z · EA · GW

We've recently received some excellent applications saying "I wasn't sure if you were still hiring for this position." If you're reading this, know that we are! 

Comment by christian (christianM) on Metaculus seeking Analytical Storytellers to write essays fortified with testable predictions · 2021-10-20T05:00:08.828Z · EA · GW

Hi Pablo, we're accepting new writers on a rolling basis and we don't have a planned date for when we'll stop.

Comment by christian (christianM) on Some global catastrophic risk estimates · 2021-05-14T21:37:21.673Z · EA · GW

Hi Benjamin, these are great questions! I work with Metaculus and wanted to add a bit of color here: 

To your question about how to see the Metaculus Prediction, that's located: https://www.metaculus.com/help/faq/#tachyon-costs

—basically one has to be of a sufficient "level", and then pay out some tachyons (the coin of the realm) to unlock the Metaculus Prediction for that question. That said, in this case, we're happy to share the current MP with you. (I'll message you here in a moment.)

And as to how the MP is calculated, the best resource there was written by one of the founders, and lives in this blog post: https://metaculus.medium.com/a-primer-on-the-metaculus-scoring-rule-eb9a974cd204

To your question about catastrophic risk from an unknown source, the table in the post doesn't include that bit, as it's only summing the %s of the different catastrophic risk questions, but you're right that you can get something like it from the question you link to:

Which just refers to that 10% decrease by any means, full stop. The Metaculus Prediction there is lower than the Community Prediction, FYI, but is indeed above the 14% you get from summing the other questions. So that makes some sense given that there are the other possibilities, however remote, that are not explicitly named. But it's also true that there are different predictors on each question, and also the linked to forecast is not explicitly pitched as "summing the other catastrophes up gives you 14% and so this linked to question is meant to produce a forecast of 14+X%, where X is the probability of unnamed catastrophes."

I hope that was useful. Please do reach out if you'd like to continue the conversation.