Accès ouvert · CC BY

Thinking with Novel Views: A Systematic Analysis of Generative-Augmented Spatial Intelligence

Article scientifique 2026 Sciences mathématiques et statistiques Autre

Résumé

Current Large Multimodal Models (LMMs) struggle with spatial reasoning tasks requiring viewpoint-dependent understanding, largely because they are confined to a single, static observation. We propose Thinking with Novel Views (TwNV), a paradigm that integrates generative novel-view synthesis into the reasoning loop: a Reasoner LMM identifies spatial ambiguity, instructs a Painter to synthesize an alternative viewpoint, and re-examines the scene with the additional evidence. Through systematic experiments we address three research questions. (1) Instruction format: numerical camera-pose specifications yield more reliable view control than free-form language. (2) Generation fidelity: synthesized view quality is tightly coupled with downstream spatial accuracy. (3) Inference-time visual scaling: iterative multi-turn view refinement further improves performance, echoing recent scaling trends in language reasoning. Across four spatial subtask categories and four LMM architectures (both closed- and open-source), TwNV consistently improves accuracy by +1.3 to +3.9 pp, with the largest gains on viewpoint-sensitive subtasks. These results establish novel-view generation as a practical lever for advancing spatial intelligence of LMMs.

Citer ce document

Zhang, Y., Wang, B., Liu, J., Jiang, N., Jiang, J., Sun, H., Yang, Y., Zheng, S., Song, L., Huang, H., Duan, N., & Li, W. (2026). Thinking with Novel Views: A Systematic Analysis of Generative-Augmented Spatial Intelligence. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2605.10588

Exporter : BibTeX · RIS (Zotero, Mendeley, EndNote)

Accès au document

Texte intégral archivé sur SPHAERO, en accès ouvert : lisible gratuitement en ligne après connexion. Le document reste aussi disponible à sa source. Se connecter

Voir l'article sur le site de la revue

Licence et provenance

Licence : CC BY

Notice moissonnée depuis OpenAlex le 30/09/2026. Le document reste hébergé par sa source.
Voir le document à la source →

Statistiques

Consultations (hors robots) : 8

Téléchargements (hors robots) : 0

Méthode de comptage