NL2AGBench: Benchmarking LLM Auto-Formalization for AlphaGeometry
Recent advances in large language models (LLMs) have demonstrated strong capabilities in natural language understanding and mathematical reasoning. However, their ability to translate informal mathematical problems into formal representations remains underexplored. This limitation is particularly important for neuro-symbolic geometry systems such as AlphaGeometry, whose theorem-proving engine…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.