Mechanism Design for Alignment and Control
We develop a framework for mechanism design with AI agents whose alignment (preferences) and capabilities (feasible actions and information) are unknown. We want such agents to act on our behalf so mechanisms must incentivize both honesty and obedience. A one-sided imitation structure---capabilities can be concealed but not counterfeited---yields a revelation principle, a characterization of…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
