What happens when automated clinical advice is wrong? This reviewed research on clinician responses to incorrect automated advice. Including ECG interpretation, rules-based clinical decision support, image-based AI, selective prediction, and LLMs/GenAI. 46 articles were included. Shared under an open access licence. PS. Check out my YouTube: https://youtube.com/@safe_as_pod?si=V2dbdmW–WbnhzA9 Shout a coffee: https://buymeacoffee.com/benhutchinson In all, they argue… Continue reading Human oversight of erroneous clinical AI and decision support a systematic review and meta analysis
Fraud-eval: an open benchmark for LLM fraud detectors, starting with a 20-case smoke test