FeiYuan
FeYuan
AI & ML interests
Multilingual & Code Intelligence
Recent Activity
posted an update about 8 hours ago
Drift-Constrained Optimization: Only Direction Matters in Fine-Tuning Instruct Models
We usually ask:
How can we SFT an instruct model without behavioral drift?
We reverse the question:
Given a fixed drift budget, how should we SFT?
This predicts that changing *where* the model can move—not the supervision—can reverse fine-tuning failure.
On Qwen3-8B and Qwen3-14B, it does.
code: https://github.com/CONE-MT/DCO/tree/main/dco
models: https://huggingface.co/collections/LLaMAX/dco submitted a paper about 8 hours ago
Drift-Constrained Optimization: Only Direction Matters in Fine-Tuning Instruct Models submitted a paper about 8 hours ago
Training Specialist Models without Reasoning Trajectories for Domain Expert DistillationOrganizations
