Flag Game: A Toy Model for Mechanistic Swarm Interpretability
Emergent coordinated behaviors of AI agents are starting to present critical safety risks. A key phenomenon driving these behaviors is the rapid formation and spread of beliefs about the world, and mechanistic understanding is crucial for collective alignment. To this end, we introduce the Flag Game, a toy model for studying the mechanisms of collective belief formation. Concretely, a hidden…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.