idk if finetunes are the answer or not- if they are we need a better ux for choosing which interactions to train on & periodically auto-finetune again, while owning & porting our datasets between models as they become obsolete...
& ime models aren't innately that good at taking concise relationally-relevant notes so they can be re-inserted to context later... like, you want the texture, the vibe of a person as well as the right biographical details & recent history to inform your next tokens w them
also sigh wrt project i wanted to do a year ago but felt too burned out & lazy to write the code & gather the data ...... but i still think personality embeddings are underrated, Type Of Guy but like higher dimension