ARCH-B: Architectural Representation, Comprehension and Hierarchy Benchmark
Multimodal models increasingly interpret visual environments, but their ability to recognize the same building across photographs, floor plans, elevations, sections, and renderings remains poorly characterized. We introduce ARCH-B, a benchmark of 354 four-choice questions across 11 cross-representational archetypes, constructed from a building-linked corpus of 3.9 million architectural images…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
