divyanshusingh's picture
Adds DPO fine-tuned Llama-3.1-8B-Instruct model
f3131bb verified