Skip to main content
Medical professional using a tablet with a chatbot interface, symbolizing caution with AI health advice.

Editorial illustration for Experts caution against giving health info to chatbots as Google updates MedGemma

AI Health Chatbots Risk Dangerous Medical Misinformation

Experts caution against giving health info to chatbots as Google updates MedGemma

Updated: 3 min read

Google updated MedGemma this week. Its advanced medical AI remains a tool strictly for developers. Meanwhile, over at OpenAI?

The push is direct to consumers. The Verge reports the company is now asking users to feed personal health data—from lab results to Apple Health metrics—into its new ChatGPT Health tool. It promises locked-down privacy, separate storage, user-controlled memory.

Security experts call the very act of sharing such details with any large language model a serious risk.

(Notably absent is Google, whose Gemini chatbot is one of the world's most competent and widely used AI tools, though the company did announce an update to its MedGemma medical AI model for developers.) OpenAI actively encourages users to share sensitive information like medical records, lab results, and health and wellness data from apps like Apple Health, Peloton, Weight Watchers, and MyFitnessPal with ChatGPT Health in exchange for deeper insights. It explicitly states that users' health data will be kept confidential and won't be used to train AI models, and that steps have been taken to keep data secure and private. OpenAI says ChatGPT Health conversations will also be held in a separate part of the app, with users able to view or delete Health "memories" at any time. OpenAI's assurances that it will keep users' sensitive data safe have been helped in no small way by the company launching an identical-sounding product with tighter security protocols at almost the same time as ChatGPT Health.

One company holds back; another charges ahead. Google’s caution with Gemini contrasts sharply with OpenAI’s ChatGPT Health bet. That bet hinges on privacy promises.

The burden, however, shifts. It lands on the user. Once sensitive health data is shared—records, results, rhythms of life—it can never be fully pulled back from a corporate system.

Deletion tools offer an illusion of control. The data's ghost often remains.

Common Questions Answered

What is ChatGPT Health and what types of medical data can users upload?

[time.com](https://time.com/7344997/chatgpt-health-medical-records-privacy-open-ai/) reports that ChatGPT Health allows users to upload medical records including lab results, visit summaries, and clinical history. Users can also connect apps like Apple Health, Function, MyFitnessPal, and Weight Watchers to provide additional health data such as steps, sleep duration, blood test markers, and nutrition information.

What privacy concerns have experts raised about ChatGPT Health?

[bbc.com](https://www.bbc.com/news/articles/cpqy29d0yjgo) highlights that privacy advocates are worried about the sensitive nature of health data being shared with AI tools. Andrew Crawford from the Center for Democracy and Technology emphasized the crucial need for 'airtight' safeguards around users' health information, especially as AI companies explore new business models like potential advertising.

How many people are currently using ChatGPT for health-related questions?

[time.com](https://time.com/7344997/chatgpt-health-medical-records-privacy-open-ai/) indicates that over 40 million people ask ChatGPT health care-related questions every day, which represents more than 5% of all global messages on the platform. [bbc.com](https://www.bbc.com/news/articles/cpqy29d0yjgo) further notes that approximately 230 million people ask the chatbot questions about health and wellbeing every week.

LIVE11:52Anthropic expands voice mode to Gmail, Slack apps