I feel bad that my quotes of the first few lines of each chapter of Yudbook is apparently going over badly (so badly that Oliver Habryka thought i was lying!!!!!!). i wanted to tweet about the book as thanks for the free copy, and figured sharing quotes was fairer than writing a…
Intro: Current AI extinction risk is more severe than mainstream AI safety discourse acknowledges. Superintelligence built with current methods will kill everyone on Earth. Superintelligence can still be prevented through coordinated human action.
chapter 1: Humanity's special power, which has enabled us to dominate the Earth and travel beyond it, is our flexible general intelligence. Intelligence consists of prediction (anticipating outcomes) and steering (finding actions to achieve goals). Steering success depends on…