Diagram-MMU: A Multi-Modal Benchmark for Scientific Diagrams
Multimodal Large Language Models (MLLMs) have been growing the capability for scientific writing and collaboration. For example, OpenAI Prism is a free workspace for scientific writing and collaboration. One important feature in Prism is turning scientific diagrams directly into LaTeX TikZ code. In this paper, we build a benchmark, Diagram-MMU, a multi-modal benchmark designed to assess MLLMs'…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.