Preference format
Data shaped as prompt / chosen / rejected, used for preference tuning.
Data shaped as prompt / chosen / rejected, used for preference tuning. (M04, M12)
Data shaped as prompt / chosen / rejected, used for preference tuning.
Data shaped as prompt / chosen / rejected, used for preference tuning. (M04, M12)