Ilya's Safe Superintelligence Inc. has raised $1B.

Thanks for doing this, Ben!

Regarding the Founding to Give program:

• Did you get many applicants?
• What are their backgrounds?
• What percentage of the selected candidates are technical?
• What kind of profiles would you have liked to see more of?

This made my day 💛

Excited to see if it can match or even surpass the most successful EA podcast of all time.

By becoming a nonprofit entrepreneur you will build robust career capital and reach an impact equivalent to $338,000-414,000 donated* to the best charities in the world every year (e.g., GiveWell top charities)! If you do exceptionally well, we estimate that your impact can grow to $1M in annual counterfactual donations. This makes nonprofit entrepreneurship one of the most impactful jobs you could take!
*This calculation represents our most accurate estimate as of June 2023. It is based on assessing the average impact of charities we have launched and considers the counterfactual contributions of our co-founders—how much additional impact they have compared to what they would have achieved in another impactful role.

Have you done this calculation for animal welfare founders?

John Schulman (OpenAI co-founder) has left OpenAI to work on AI alignment at Anthropic.

https://x.com/johnschulman2/status/1820610863499509855

Thanks for the post!

“Something must be done. This is something. Therefore this must be done.”

1. Have you seen grants that you are confident are not a good use of EA's money?

2. If so, do you think that if the grantmakers had asked for your input, you would have changed their minds about making the grant?

3. Do you think Open Philanthropy (and other grantmakers) should have external grant reviewers?

Meta has just released Llama 3.1 405B. It's open-source and in many benchmarks it beats GPT-4o and Claude 3.5 Sonnet:

Zuck's letter "Open Source AI Is the Path Forward".

Thanks again for the comment.

You think that the primary value of the paper is in its help with forecasting, right?

In that case, do you think it would be fair to ask expert forecasters if this paper is useful or not?

Thanks for the comment @aogara <3. I agree this paper seems very good from an academic point of view.

My main question: how does this research help in preventing existential risks from AI?

Other questions:

• What are the practical implications of this paper?
• What insights does this model provide regarding text-based task automation using LLMs?
• Looking into one of the main computer vision tasks: self-driving cars. What insights does their model provide? (Tesla is probably ~3 years away from self-driving cars and this won't require any hardware update, so no cost)