Policy Iteration with Human Feedback: Bringing Post-Training RL to In-context Learning
Generative pretraining established reusable task representations; later work on language-based task conditioning and in-context learning showed that a fixed model could adapt its behavior from instructions and demonstrations. Policy Iteration with Human Feedback (PIHF) builds on this development and the recurrent evaluate-and-improve structure of generalized policy iteration. PIHF uses a…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
