I keep wanting a local-inference-sized multimodal dispatcher model that can consume streams of input and decide which parts should be sent to bigger models for action... maybe this is a distillation of the bigger model? is there a framework for this yet?
More notes on nearby ideas
Reply · Oct 16, 2023@MalmSanta yeah haha this was a hopeful / "hyperstition it into existence" post lol.... it'd be cool to have a framework that wraps open models to…Reply · Jan 21, 2026@beffjezos hopefully she's diversifying across multiple models n providers including at least some local inference!Quote tweet · Feb 12, 2024yep. models dispatching to other models, spawning narrow models, learning from other models, competing with other modelsReply · Nov 28, 2023@lumpenspace I've been thinking for awhile that models should be able to monitor usage and downscale themselves to simpler / more specialized child…