one thing I wish I understood better is the actual cost of inference and what it'll look like in the future as supply has time to catch up with demand and models are further optimized per use case... rn pricing is like early days of Uber or the scooter craze, who knows
More notes on nearby ideas
Reply · Jun 18, 2023@amix011 @smylkshmn @exitperfect 😏 we need more competition to drive down the prices of inferenceReply · Apr 2, 2025@RokoMijic why i should expect it to have a higher price in the futureReply · Aug 23, 2023@deepfates 😅 I don't wanna talk about it... but seriously it stresses me out to decide how much to optimize for cost vs just shrug and run it for the…Tweet · Aug 28, 2023where will most AI inference run in the future?