This archive copy may be incomplete. The original-source link is preserved in the card footer.

RT @georgejrjrjr: Mixtral 8x22B --if there is a way to productively downcycle MoEs to dense models, I suspect someone is about to figure ou…