MAxBench: A Multinomial Concept Recovery Benchmark
Fine-grained control of language model behaviors (e.g., steering) is among the more actionable outcomes of interpretability research. For binary concepts such as refusal, a single direction in activation space often suffices for steering. However, many concepts are not binary: Animals and Countries contain many subcategories, each with multiple instances. For these concepts, the search space over…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
