chapter 10: AI alignment must be solved before AI becomes superintelligent - humanity will have no opportunity to learn from alignment failures at dangerous capability levels. We can take lessons from engineering failures in other fields: Space probes often fail after launch…
chapter 11: Elon Musk's plan to build an AI that seeks truth about the universe and therefore won't destroy humans because we're "interesting" fails to address the actual alignment problem. LeCun has tweeted that AI won't want to dominate humans, that we can "engineer their…
chapter 12: Historical precedents such as leaded gasoline and CFCs show industries routinely ignore known risks for economic gain. Demands for "conclusive proof" of harm often serve to delay necessary precautions. AI experts downplay their concerns, especially in public, to…