TRACE: Trajectory Return Attribution and Contrastive Erasure for Multi-Turn Safety
Safety-aligned large language models (LLMs) often refuse a harmful request but comply once the same goal is spread over several turns. Preference objectives score whole responses to single prompts, so their training loss alone cannot control risk on unseen histories. Our analysis gives sufficient conditions under which suppression at supervised single-turn contexts yields a bound on multi-turn…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
