arXiv:2605.04012  (cs)
 



 

  Authors:  Joseph Breda ,  Fadi Yousif ,  Beszel Hawkins ,  Marinela Cotoi ,  Miao Liu ,  Ray Luo ,  Po-Hsuan Cameron Chen ,  Mike Schaekermann ,  Samuel Schmidgall ,  Xin Liu ,  Girish Narayanswamy ,  Samuel Solomon ,  Maxwell A. Xu ,  Xiaoran Fan ,  Longfei Shangguan ,  Anran Wang ,  Bhavna Daryani ,  Buddy Herkenham ,  Cara Tan ,  Mark Malhotra ,  Shwetak Patel ,  John B. Hernandez ,  Quang Duong ,  Yun Liu ,  Zach Wasson ,  Dimitrios Antos ,  Bob Lou ,  Matthew Thompson ,  Jonathan Richina ,  Anupam Pathak ,  Nichole Young-Lin ,  Jake Sunshine ,  Daniel McDuff               View a PDF of the paper titled SymptomAI: Towards a Conversational AI Agent for Everyday Symptom Assessment, by Joseph Breda and 32 other authors 
 View PDF 

 
         Abstract: Language models excel at diagnostic assessments on currated medical case-studies and vignettes, performing on par with, or better than, clinical professionals. However, existing studies focus on complex scenarios with rich context making it difficult to draw conclusions about how these systems perform for patients reporting symptoms in everyday life. We deployed SymptomAI, a set of conversational AI agents for end-to-end patient interviewing and differential diagnosis (DDx), via the Fitbit app in a study that randomized participants (N=13,917) to interact with five AI agents. This corpus captures diverse communication and a realistic distribution of illnesses from a real world population. A subset of 1,228 participants reported a clinician-provided diagnosis, and 517 of these were further evaluated by a panel of clinicians during over 250 hours of annotation. SymptomAI DDx were significantly more accurate (OR = 2.47, p < 0.001) than those from independent clinicians given the same dialogue in a blinded randomized comparison. Moreover, agentic strategies which conduct a dedicated symptom interview that elicit additional symptom information before providing a diagnosis, perform substantially better than baseline, user-guided conversations (p < 0.001). An auxiliary analysis on 1,509 conversations from a general US population panel validated that these results generalize beyond wearable device users. We used SymptomAI diagnoses as labels for all 13,917 participants to analyze over 500,000 days of wearable metrics across nearly 400 unique conditions. We identified strong associations between acute infections and physiological shifts (e.g., OR > 7 for influenza). While limited by self-reported ground truth, these results demonstrate the benefits of a dedicated and complete symptom interview compared to a user-guided symptom discussion, which is the default of most consumer LLMs.
 

 
 
            
       Comments: 
       13 page main text, 54 pages total. 16 figures total 
     

       Subjects: 
       
         Artificial Intelligence (cs.AI)  
      
       Cite as: 
         arXiv:2605.04012  [cs.AI]  
     
     
         
       (or  
           arXiv:2605.04012v1  [cs.AI]  for this version)
       
     
     
         
                      https://doi.org/10.48550/arXiv.2605.04012  
           
             Focus to learn more 
           
           
           
                                arXiv-issued DOI via DataCite (pending registration) 
         
       
      
 


 
  

   Full-text links: 
  

    view license  
 
      

 new 
  |  
 recent 
  |   2026-05 

Change to browse by:
 
     cs  
 


 
   
    

        NASA ADS    Google Scholar  
        Semantic Scholar  
     
      
   


 export BibTeX citation 
 Loading... 



 
     
        

         × 
     
     
         loading... 
     
     
         Data provided by:  
          
     
 

 Bibliographic Tools 
 
  

           Bibliographic Explorer Toggle 
         
       
       
         Bibliographic Explorer   ( What is the Explorer? ) 
       
     
     
       
         
           
            
           Connected Papers Toggle 
         
       
       
         Connected Papers   ( What is Connected Papers? ) 
       
      
       
         
           
            
           Litmaps Toggle 
         
       
       
         Litmaps   ( What is Litmaps? ) 
       
     
     
       
         
           
            
           scite.ai Toggle 
         
       
       
         scite Smart Citations   ( What are Smart Citations? ) 
       
     
   
      
      
      
      
 

 
 Code, Data, Media 
 
  

           alphaXiv Toggle 
         
       
       
         alphaXiv   ( What is alphaXiv? ) 
       
     

     
       
         
           
            
           Links to Code Toggle 
         
       
       
         CatalyzeX Code Finder for Papers   ( What is CatalyzeX? ) 
       
     

     
       
         
           
            
           DagsHub Toggle 
         
       
       
         DagsHub   ( What is DagsHub? ) 
       
     

     
       
         
           
            
           GotitPub Toggle 
         
       
       
         Gotit.pub   ( What is GotitPub? ) 
       
     

     
       
         
           
            
           Huggingface Toggle 
         
       
       
         Hugging Face   ( What is Huggingface? ) 
       
     

     
       
         
           
            
           ScienceCast Toggle 
         
       
       
         ScienceCast   ( What is ScienceCast? ) 
       
     
   

    
    
    
    
    
    
 

   
   Demos 
   
    

             Replicate Toggle 
           
         
         
           Replicate   ( What is Replicate? ) 
         
       
       
         
           
             
              
             Spaces Toggle 
           
         
         
           Hugging Face Spaces   ( What is Spaces? ) 
         
       
       
         
           
             
              
             Spaces Toggle 
           
         
         
           TXYZ.AI   ( What is TXYZ.AI? ) 
         
       
     
      
      
      
   
   
   Related Papers 
   
    

             Link to Influence Flower 
           
         
         
           Influence Flower   ( What are Influence Flowers? ) 
         
       
       
         
           
             
              
             Core recommender toggle 
           
         
         
           CORE Recommender   ( What is CORE? ) 
         
        
      
     
       
          Author  
          Venue  
          Institution  
          Topic  
       
       
            
            
            
            
       
     
      
      
   

   
   
    About arXivLabs
   
   
     
       
        

         arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

        Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

        Have an idea for a project that will add value for arXiv's community?   Learn more about arXivLabs  .

       
       
        

       
     
   

 



 Which authors of this paper are endorsers?  |
 Disable MathJax  ( What is MathJax? )