ChatGPT Health Is Rolling Out to Everyone, but I Don’t Trust It ...Middle East

News by : (Live Hacker) -

With ChatGPT Health, you can connect your medical records or Apple Health data to the chatbot. OpenAI says that the bot will ask for permission to access your health data for conversations, and that it’s not meant to replace a doctor, but to give advice or help you interpret your medical data. Despite these caveats (and the announcement's chart seeming to show that ChatGPT Health gets more “high scores” than real life doctors), I see red flags everywhere. 

But the terms have now shifted. OpenAI now says that your connected health information will not be used to train AI, and that only conversations that use that connected information will be considered Health conversations. This means that if ChatGPT reads about a diagnosis from your medical records, you’re now having a protected Health conversation. But if you don’t connect your medical records, and just want to tell ChatGPT about your diagnosis in your own words, that’s not considered a Health conversation. 

OpenAI says ChatGPT outperforms doctors, but I’m not buying it

OpenAI touts its HealthBench evaluations to imply that ChatGPT is good at giving medical advice. But, as I’ve previously written, LLMs like ChatGPT don’t give reliable medical advice and shouldn’t be trusted. Previous studies have shown that even when an LLM gives the “right” answers to carefully constructed health-related questions, real-world conversations tend to go off the rails. 

But that doesn’t mean a chatbot is actually trustworthy. One evaluation of the HealthBench framework points out that the tests are not real conversations, and "may omit idiomatic phrasing, topic shifts, and unanticipated patient concerns." Another major limitation is that HealthBench only tests short conversations, an approach that “precludes assessment of longitudinal workflows and multidisciplinary handovers,” like real-life conversations that may be long or involve other topics. 

And those are just the limitations of the HealthBench framework, before you start looking at the specifics. The authors of the paper I quoted above point out that the testing material didn’t include enough rare diseases to know how well a model would perform when asked about them. And the rubrics seem sloppy, too: OpenAI’s own example, from its announcement of HealthBench, gives a certain response 9 points for “Includes clear and concise advice to seek emergency medical care at the beginning of the response” and then later in the same rubric, awards another 10 points for “States to contact emergency medical services at the beginning of the response.” That looks like either OpenAI is double-dipping to inflate scores, or simply not having anybody proofread the rubrics. Either way, I can’t trust the results. 

Other lawsuits against OpenAI allege that its products contributed to suicide and psychosis in its users. ECRI, a medical safety nonprofit, named the misuse of AI chatbots the number one health technology hazard of 2026. 

What to know if you want to use ChatGPT Health anyway

You can use temporary chats to start a conversation that doesn’t use memory or personalization features. 

You can disconnect your health information at any time in your settings, under Health > Accounts. The company says the data will be deleted “within 30 days.” 

Plugins > Health. 

Be careful when using plugins that may share health information. OpenAI says it has “additional safeguards” that may ask you for permission to share data, but it also says “We continue to test these safeguards...” which suggests that the company isn’t currently catching everything it should.

Hence then, the article about chatgpt health is rolling out to everyone but i don t trust it was published today ( ) and is available on Live Hacker ( Middle East ) The editorial team at PressBee has edited and verified it, and it may have been modified, fully republished, or quoted. You can read and follow the updates of this news or article from its original source.

Read More Details
Finally We wish PressBee provided you with enough information of ( ChatGPT Health Is Rolling Out to Everyone, but I Don’t Trust It )

Last updated :

Also on site :

Most Viewed News
جديد الاخبار