persuasive capabilities exceeding reasoning capabilities... thinking about this really upset me a few weeks ago, both wrt AI and wrt bio humans, including myself.... how do I know what I think I know? it's feelings, not just a logical chain of deduction, tho I can pick out big contributing factors and trace them back to big factors contributing to those feelings... the rationalization is lossy, and yet still too verbose & tedious for a conversation... when we argue and persuade we assume we understand each other's model, start from the conclusion and work backwards, pushing and pulling trying to line up their thoughts with our own, guessing at which factors have the most emotional salience & where we have agreement vs disagreement... imagine being good at this process of persuasion but bad at choosing which mental model & conclusion you're aiming to sell...