arXiv:2604.24300  (cs)
 



 

  Authors:  Yiming Zhang ,  Jiacheng Chen ,  Jiaqi Tan ,  Yongsen Mao ,  Wenhu Chen ,  Angel X. Chang               View a PDF of the paper titled ReVSI: Rebuilding Visual Spatial Intelligence Evaluation for Accurate Assessment of VLM 3D Reasoning, by Yiming Zhang and 5 other authors 
 View PDF 

 
         Abstract: Current evaluations of spatial intelligence can be systematically invalid under modern vision-language model (VLM) settings. First, many benchmarks derive question-answer (QA) pairs from point-cloud-based 3D annotations originally curated for traditional 3D perception. When such annotations are treated as ground truth for video-based evaluation, reconstruction and annotation artifacts can miss objects that are clearly visible in the video, mislabel object identities, or corrupt geometry-dependent answers (e.g., size), yielding incorrect or ambiguous QA pairs. Second, evaluations often assume full-scene access, while many VLMs operate on sparsely sampled frames (e.g., 16-64), making many questions effectively unanswerable under the actual model inputs. We improve evaluation validity by introducing ReVSI, a benchmark and protocol that ensures each QA pair is answerable and correct under the model's actual inputs. To this end, we re-annotate objects and geometry across 381 scenes from 5 datasets to improve data quality, and regenerate all QA pairs with rigorous bias mitigation and human verification using professional 3D annotation tools. We further enhance evaluation controllability by providing variants across multiple frame budgets (16/32/64/all) and fine-grained object visibility metadata, enabling controlled diagnostic analyses. Evaluations of general and domain-specific VLMs on ReVSI reveal systematic failure modes that are obscured by prior benchmarks, yielding a more reliable and diagnostic assessment of spatial intelligence.
 

 
 
            
       Comments: 
       Project Page:  this https URL  
     

       Subjects: 
       
         Computer Vision and Pattern Recognition (cs.CV)  
      
       Cite as: 
         arXiv:2604.24300  [cs.CV]  
     
     
         
       (or  
           arXiv:2604.24300v1  [cs.CV]  for this version)
       
     
     
         
                      https://doi.org/10.48550/arXiv.2604.24300  
           
             Focus to learn more 
           
           
           
                                arXiv-issued DOI via DataCite (pending registration) 
         
       
      
 


 
  

   Full-text links: 
  

       view license 
      
 
      

 new 
  |  
 recent 
  |   2026-04 

Change to browse by:
 
     cs  
 


 
   
    

        NASA ADS    Google Scholar  
        Semantic Scholar  
     
      
   


 export BibTeX citation 
 Loading... 



 
     
        

         × 
     
     
         loading... 
     
     
         Data provided by:  
          
     
 

 Bibliographic Tools 
 
  

           Bibliographic Explorer Toggle 
         
       
       
         Bibliographic Explorer   ( What is the Explorer? ) 
       
     
     
       
         
           
            
           Connected Papers Toggle 
         
       
       
         Connected Papers   ( What is Connected Papers? ) 
       
      
       
         
           
            
           Litmaps Toggle 
         
       
       
         Litmaps   ( What is Litmaps? ) 
       
     
     
       
         
           
            
           scite.ai Toggle 
         
       
       
         scite Smart Citations   ( What are Smart Citations? ) 
       
     
   
      
      
      
      
 

 
 Code, Data, Media 
 
  

           alphaXiv Toggle 
         
       
       
         alphaXiv   ( What is alphaXiv? ) 
       
     

     
       
         
           
            
           Links to Code Toggle 
         
       
       
         CatalyzeX Code Finder for Papers   ( What is CatalyzeX? ) 
       
     

     
       
         
           
            
           DagsHub Toggle 
         
       
       
         DagsHub   ( What is DagsHub? ) 
       
     

     
       
         
           
            
           GotitPub Toggle 
         
       
       
         Gotit.pub   ( What is GotitPub? ) 
       
     

     
       
         
           
            
           Huggingface Toggle 
         
       
       
         Hugging Face   ( What is Huggingface? ) 
       
     

     
       
         
           
            
           ScienceCast Toggle 
         
       
       
         ScienceCast   ( What is ScienceCast? ) 
       
     
   

    
    
    
    
    
    
 

   
   Demos 
   
    

             Replicate Toggle 
           
         
         
           Replicate   ( What is Replicate? ) 
         
       
       
         
           
             
              
             Spaces Toggle 
           
         
         
           Hugging Face Spaces   ( What is Spaces? ) 
         
       
       
         
           
             
              
             Spaces Toggle 
           
         
         
           TXYZ.AI   ( What is TXYZ.AI? ) 
         
       
     
      
      
      
   
   
   Related Papers 
   
    

             Link to Influence Flower 
           
         
         
           Influence Flower   ( What are Influence Flowers? ) 
         
       
       
         
           
             
              
             Core recommender toggle 
           
         
         
           CORE Recommender   ( What is CORE? ) 
         
        
      
     
       
          Author  
          Venue  
          Institution  
          Topic  
       
       
            
            
            
            
       
     
      
      
   

   
   
    About arXivLabs
   
   
     
       
        

         arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

        Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

        Have an idea for a project that will add value for arXiv's community?   Learn more about arXivLabs  .

       
       
        

       
     
   

 



 Which authors of this paper are endorsers?  |
 Disable MathJax  ( What is MathJax? )