GRACE:Gradient-guided Coreset Selection for LLM Unlearning
Machine Unlearning methods for Large Language Models typically assume pre-specified forget and retain sets. In realistic settings, however, requests may provide only a few examples of undesired behavior, requiring forget and retain sets to be inferred from heterogeneous corpora. We study this data-selection problem and propose GRACE , a gradient-guided coreset selection method that constructs…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.