Attention as Lattice Gauge Theory: Relations Interact Only Through Wilson Loops
Relations compose through the entity they share - Alice is Bob's mother and Bob is Carol's father, so Alice is Carol's grandmother - and the order matters, since a father's mother is not a mother's father; verifying a composed relation means closing the loop. We show that if each entity's coordinate frame may be rotated independently (per-entity frame freedom), three things follow. In the…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
