Do LiDAR Language Models Really Understand Spatio-temporal Relationships?
Recent 4D LiDAR language models aim to reason about objects and their evolving spatial relationships. Yet, in our evaluation, always selecting the same option nearly matches the multiple-choice accuracy of two B4DL-derived configurations. We introduce LiDAR-Hallu, a geometry-referenced benchmark and diagnostic protocol with 10,000 questions across 150 nuScenes scenes. It covers object existence,…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
