Yud tweets about fast takeoff due to regulation feel like backpedaling.
The whole idea of foom was "there's a true optimal simple algorithm for intelligence under constraints/embeddedness, which is going to be found relatively early by some proto-AGI mathematics program, and then, out of the blue, FOOM."
Were minds changed at MIRI?

Seriously, am I the only one who still thinks fast & discontinuous takeoff is actually pretty plausible?

Sign in to participate in the conversation
Mastodon

a Schelling point for those who seek one