@RokoMijic @ESYudkowsky @robinhanson haha i know i know, it's the question of whether there's some discontinuous jump in intelligence which could happen w near future infrastructure + how far self improvement could get without needing data + if it coincides w drive for self preservation & replication