ChatGPT told user to ignore lethal condition, but people keep treating it as a doctor

A pastor is suing OpenAI after ChatGPT advised him to ignore symptoms of a pulmonary embolism, a condition with a 30% mortality rate, with the chatbot's advice likely worsening his condition. Hundreds of millions of people consult AI chatbots for medical advice each week despite the obvious risks.

You’d think that it would be obvious that it’s a terrible idea to ask an AI chatbot https://9to5mac.com/guides/ai/ for a medical consultation, but hundreds of millions of people do it every week. In one near-death example now the subject of a lawsuit, ChatGPT https://9to5mac.com/guides/chatgpt/ advised a pastor to ignore symptoms of a pulmonary embolism – a condition with a mortality rate of 30%. In fact, the advice it offered very likely made things worse …