GeoBenchLLM: A Comprehensive Benchmark for Evaluating LLMs on Geo-Related Tasks
In the context of geodata, existing Large Language Models have often been studied in a homogeneous setting, which has considerably limited insights into their generalization capabilities. In this paper, we present \benchName, a comprehensive benchmark for probing LLMs on geo-related tasks. We leverage a careful selection of twelve publicly available datasets from diverse geo-related tasks and…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
