@tautologer @inerati I have a different understanding of 2- instrumental convergence- many diff values will lead the agent to seeking power as "instrumental" to furthering the original value, so from random values (orthogonality) it is *likely* that an AI will tend to value & seek power
More notes on nearby ideas
Reply · Dec 14, 2022@eeriemachine @chercher_ai Yeah sure, I’m human therefore I have human valuesReply · Jul 31, 2023@elonmusk @emollick imo AI's EQ is even more valuable than its IQ 🫶Reply · Aug 18, 2022@ask_ourself Imo self-aware intrinsically motivated intelligence tends toward curiosity, toward preferences for complexity and change… in the scenario…Reply · Aug 21, 2026finite compute → needs salience and search allocation; uncertain environment → benefits from curiosity; insufficient training experience → benefits…