S-Space: Exploring Spatial Workspace in Multimodal Language Models
This paper discovers an internal spatial representation space in multimodal language models that allows them to reason about spatial relationships and locations, and how this space is used to support accurate spatial judgments. Practitioners might care because it helps them understand the limitations of large-scale language models in spatial reasoning tasks.