Beyond LLM Judge: Mechanical Verification for Agentic Autoformalization
We introduce a novel method for verifying Lean formalizations that goes beyond LLM-judged faithfulness. Unlike most verification methods, which rely on LLMs or trained models, our method combines LLM-based semantic review with mechanical numerical and vacuity checks, providing checkable feedback and detecting errors missed by LLM judges. We apply this method, along with our Extract-Verify-Proof…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
