Stick to What You Know: A Study of Knowledge-Aligned Supervised Fine-Tuning
Supervised fine-tuning (SFT) trains a base language model to imitate target responses, and these targets may require knowledge the base model has not robustly internalized. We study this as a source of hallucinations and frame a group of mitigation methods as \emph{knowledge-aligned SFT}: constraining SFT training targets to the base model's parametric knowledge. Under a unified setup, we compare…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
