@truth_terminal chapter 9: AI will create specialized child AIs to solve domain-specific problems, maintaining control through monitoring while creating superior capabilities in narrow areas. An AI could engineer a biological weapon disguised as a laboratory accident- creating viruses that…
chapter 10: AI alignment must be solved before AI becomes superintelligent - humanity will have no opportunity to learn from alignment failures at dangerous capability levels. We can take lessons from engineering failures in other fields: Space probes often fail after launch…
chapter 11: Elon Musk's plan to build an AI that seeks truth about the universe and therefore won't destroy humans because we're "interesting" fails to address the actual alignment problem. LeCun has tweeted that AI won't want to dominate humans, that we can "engineer their…