What is Missing from AI Post-Training AI: An Empirical Analysis
Large language model (LLM) agents can now post-train an LLM end-to-end. They can write code, launch training, evaluate checkpoints, and improve downstream performance, raising the prospect of AI-for-AI. We argue that this picture conflates two distinct capabilities: execution-level capability, iterating within a selected training strategy; and strategy-level capability, revising the high-level…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
