imo thinking abt AGI as "alien" or a "random distribution" is kinda misleading... LLMs are trained via the *human* abstraction layer of language, on *human* datasets describing ourselves and the world as we perceive it, interacting in a *human* social environment
this is not an argument that AGI is necessarily aligned but that I expect the risk of scaling LLMs to be more *human* shaped - manipulation of human emotions before developing nanotech
More notes on nearby ideas
Reply · Jul 29, 2023@warty_dog @typecarlosmale I disagree- we are using the human technology of language as an abstraction layer over physical reality and training it…Reply · Jul 20, 2023I certainly agree LLMs are hitching a ride on top of the abstraction layer of human language... but I'm not sure how much this matters for "real…Quote tweet · Sep 16, 2024@DanielleFong @nickcammarata +1!Artificial intelligenceReply · Sep 17, 2023@sunofdopamine the line of thought that inspired the question is that AI & LLMs in particular are distilling an essence of humanity in their…