Fusion Training for Mathematical Generalization in Large Language Models
Thinking Mode Fusion (TMF) enables large language models to support both concise responses and long-form reasoning by unifying a non-thinking mode and a thinking mode within a single model. However, its training dynamics, including the \emph{data ratio} and \emph{training schedule} between the two modes, remain underexplored. In this work, we present a systematic study of TMF by analyzing the…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
