This archive copy may be incomplete. The original-source link is preserved in the card footer.

RT @norabelrose: Idk if people noticed but Mixtral-Instruct was trained with Direct Preference Optimization (DPO) My prediction that a DPO…