Showing posts with label evaluating quality of AI chatbots' health info. Show all posts
Showing posts with label evaluating quality of AI chatbots' health info. Show all posts

Monday, February 9, 2026

Health Advice From A.I. Chatbots Is Frequently Wrong, Study Shows; The New York Times, February 9, 2026

, The New York Times; Health Advice From A.I. Chatbots Is Frequently Wrong, Study Shows

"A new study published Monday provided a sobering look at whether A.I. chatbots, which have fast become a major source of health information, are, in fact, good at providing medical advice to the general public.

The experiment found that the chatbots were no better than Google — already a flawed source of health information — at guiding users toward the correct diagnoses or helping them determine what they should do next. And the technology posed unique risks, sometimes presenting false information or dramatically changing its advice depending on slight changes in the wording of the questions.

None of the models evaluated in experiment were “ready for deployment in direct patient care,” the researchers concluded in the paper, which is the first randomized study of its kind."