Language Models Learn to Improve Language Models
Large language models (LLMs) are increasingly used to automate AI research, including language-model (LM) development, offering a potential path toward recursive self-improvement. However, turning experimental feedback into a learned ability to propose effective improvements across models faces two challenges. First, training such an ability with real feedback is expensive: reinforcement learning…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
