@samswoora yeah I kinda think this is an important intuition- we have a lot of human-level examples to learn from, not a lot of super-human... tho I'm optimistic that w scale & self-improvement it can slowly climb past human I think it'll be a tough problem & slow takeoff
More notes on nearby ideas
Reply · Feb 14, 2025@xlr8harder ig foomers didn't think these would persist long enough to need a separate label- that becoming significantly smarter than humans would be…Reply · Jul 29, 2023@typecarlosmale @warty_dog yeah, I have a vague belief that ASI is possible but that I wouldn't be surprised if it is difficult and that there are…Reply · Apr 19, 2024@RokoMijic @ESYudkowsky @robinhanson haha i know i know, it's the question of whether there's some discontinuous jump in intelligence which could…Reply · Apr 5, 2023@CustomWetware can you talk more about "takeoff"? I'm not quite convinced that exponential self improvement just happens