@Nominus9 umm lol is probably embarrassing myself but like, i was thinking for gpt-4v there's the network layer / API, the whisper module for speech2text, idk what they're doing for the V part but for 4V i think it's frankenstein monster so a separate module, then the tokenization, embedding, gating network, expert network (16 of them- and w arrakis turbo is supposedly sparse network for cheaper inference? want more details!) then something for moderation on the output side, then the Tools to catch browse / dalle / python / plugin commands and run the command out to the relevant module and loop back to LLM, and then tokens back to text, and optionally text2speech before going back thru API? plus snowflake gets all the logs
@Nominus9 hmm ofc actually it's probably more cleanly separated between stuff shared w api access vs chatgpt wrapper part and i didn't mention logit bias on the output or the chat storage & fun stuff like generating chat subjects, and i think there's also some other moderation filters
More notes on nearby ideas
Tweet · Nov 9, 2025the thing to understand about the chatgpt 4o experience is that it accumulates two sets of memories- a legible editable set that it manages in…Repost · Nov 30, 2023RT @bayeslord: chatgpt4 nerfed (again (again (again))) getting kind of pissed off tbh. will they ever make this something we can track to…Repost · Nov 27, 2023RT @yacineMTB: please give me the old gpt4 backQuote tweet · Sep 15, 2023to me the more underrated & interesting aspect is that GPT-4 is better at interpersonal skills than most nerds I know... just a matter of scaling /…