{"id":7210,"date":"2024-10-10T20:42:20","date_gmt":"2024-10-10T20:42:20","guid":{"rendered":"https:\/\/www.tun.com\/home\/?p=7210"},"modified":"2024-10-16T20:30:19","modified_gmt":"2024-10-16T20:30:19","slug":"ucsf-study-finds-chatgpt-overprescribes-in-emergency-care","status":"publish","type":"post","link":"https:\/\/www.tun.com\/home\/ucsf-study-finds-chatgpt-overprescribes-in-emergency-care\/","title":{"rendered":"UCSF Study Finds ChatGPT Overprescribes in Emergency Care"},"content":{"rendered":"\n<div class=\"wp-block-group\"><div class=\"wp-block-group__inner-container is-layout-constrained wp-block-group-is-layout-constrained\">\n<div class=\"wp-block-uagb-blockquote uagb-block-e7eb3fc3 uagb-blockquote__skin-border uagb-blockquote__stack-img-none\"><blockquote class=\"uagb-blockquote\"><div class=\"uagb-blockquote__content\">A recent UC San Francisco study finds that ChatGPT recommends unnecessary treatments in emergency departments, underscoring the need for improved AI frameworks in medical decision-making.<\/div><footer><div class=\"uagb-blockquote__author-wrap uagb-blockquote__author-at-left\"><\/div><\/footer><\/blockquote><\/div>\n\n\n\n<div class=\"wp-block-group is-content-justification-space-between is-nowrap is-layout-flex wp-container-core-group-is-layout-0dfbf163 wp-block-group-is-layout-flex\"><div style=\"font-size:16px;\" class=\"has-text-align-left wp-block-post-author\"><div class=\"wp-block-post-author__content\"><p class=\"wp-block-post-author__name\">The University Network<\/p><\/div><\/div>\n\n\n<div class=\"wp-block-uagb-social-share uagb-social-share__outer-wrap uagb-social-share__layout-horizontal uagb-block-ee584a31\">\n<div class=\"wp-block-uagb-social-share-child uagb-ss-repeater uagb-ss__wrapper uagb-block-ec619ce7\"><span class=\"uagb-ss__link\" data-href=\"https:\/\/www.facebook.com\/sharer.php?u=\" tabindex=\"0\" role=\"button\" aria-label=\"facebook\"><span class=\"uagb-ss__source-wrap\"><span class=\"uagb-ss__source-icon\"><svg xmlns=\"https:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 512 512\"><path d=\"M504 256C504 119 393 8 256 8S8 119 8 256c0 123.8 90.69 226.4 209.3 245V327.7h-63V256h63v-54.64c0-62.15 37-96.48 93.67-96.48 27.14 0 55.52 4.84 55.52 4.84v61h-31.28c-30.8 0-40.41 19.12-40.41 38.73V256h68.78l-11 71.69h-57.78V501C413.3 482.4 504 379.8 504 256z\"><\/path><\/svg><\/span><\/span><\/span><\/div>\n\n\n\n<div class=\"wp-block-uagb-social-share-child uagb-ss-repeater uagb-ss__wrapper uagb-block-32d99934\"><span class=\"uagb-ss__link\" data-href=\"https:\/\/twitter.com\/share?url=\" tabindex=\"0\" role=\"button\" aria-label=\"twitter\"><span class=\"uagb-ss__source-wrap\"><span class=\"uagb-ss__source-icon\"><svg xmlns=\"https:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 512 512\"><path d=\"M389.2 48h70.6L305.6 224.2 487 464H345L233.7 318.6 106.5 464H35.8L200.7 275.5 26.8 48H172.4L272.9 180.9 389.2 48zM364.4 421.8h39.1L151.1 88h-42L364.4 421.8z\"><\/path><\/svg><\/span><\/span><\/span><\/div>\n\n\n\n<div class=\"wp-block-uagb-social-share-child uagb-ss-repeater uagb-ss__wrapper uagb-block-1d136f14\"><span class=\"uagb-ss__link\" data-href=\"https:\/\/www.linkedin.com\/shareArticle?url=\" tabindex=\"0\" role=\"button\" aria-label=\"linkedin\"><span class=\"uagb-ss__source-wrap\"><span class=\"uagb-ss__source-icon\"><svg xmlns=\"https:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 448 512\"><path d=\"M416 32H31.9C14.3 32 0 46.5 0 64.3v383.4C0 465.5 14.3 480 31.9 480H416c17.6 0 32-14.5 32-32.3V64.3c0-17.8-14.4-32.3-32-32.3zM135.4 416H69V202.2h66.5V416zm-33.2-243c-21.3 0-38.5-17.3-38.5-38.5S80.9 96 102.2 96c21.2 0 38.5 17.3 38.5 38.5 0 21.3-17.2 38.5-38.5 38.5zm282.1 243h-66.4V312c0-24.8-.5-56.7-34.5-56.7-34.6 0-39.9 27-39.9 54.9V416h-66.4V202.2h63.7v29.2h.9c8.9-16.8 30.6-34.5 62.9-34.5 67.2 0 79.7 44.3 79.7 101.9V416z\"><\/path><\/svg><\/span><\/span><\/span><\/div>\n<\/div>\n<\/div>\n<\/div><\/div>\n\n\n\n<p>While artificial intelligence continues to make strides in various fields, a new study from UC San Francisco highlights critical limitations in its application to emergency medical care. The study, <a href=\"https:\/\/www.nature.com\/articles\/s41467-024-52415-1\" title=\"\">published<\/a> in Nature Communications, found that ChatGPT, a large language model developed by OpenAI, often suggests unnecessary interventions in emergency departments (ED).<\/p>\n\n\n\n<p><\/p>\n\n\n\n<h2 class=\"wp-block-heading\">AI Struggles With Complex Medical Decisions<\/h2>\n\n\n\n<p>The research team tested ChatGPT-3.5 and ChatGPT-4 using a dataset of 1,000 emergency department visits. Each visit included patient symptoms and examination findings from doctors&#8217; notes. <\/p>\n\n\n\n<p>The AI\u2019s recommendations for admissions, radiology scans and antibiotics were then compared with actual clinical decisions. Notably, ChatGPT-4 was found to be 8% less accurate than resident physicians, while ChatGPT-3.5 lagged by 24%.<\/p>\n\n\n\n<p>While previous research by Williams showed that ChatGPT could sometimes outshine humans in straightforward diagnostic tasks, the current study underscores the model\u2019s limitations in complex clinical decision-making. <\/p>\n\n\n\n<p>&#8220;This is a valuable message to clinicians not to blindly trust these models,&#8221; lead author Chris Williams, a postdoctoral scholar at UC San Francisco, said in a <a href=\"https:\/\/www.ucsf.edu\/news\/2024\/10\/428591\/when-it-comes-emergency-care-chatgpt-overprescribes\">news release<\/a>. &#8220;ChatGPT can answer medical exam questions and help draft clinical notes, but it&#8217;s not currently designed for situations that call for multiple considerations, like the situations in an emergency department.&#8221;<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Overprescription and Its Implications<\/h2>\n\n\n\n<p>The issue appears rooted in the training data. ChatGPT&#8217;s tendency to overprescribe might stem from its foundation on internet-sourced information, which leans toward cautionary advice suitable for general public safety rather than the precise needs of an ED setting.<\/p>\n\n\n\n<p>\u201cThese models are almost fine-tuned to say, \u2018seek medical advice,\u2019 which is quite right from a general public safety perspective,\u201d Williams added. \u201cBut erring on the side of caution isn\u2019t always appropriate in the ED setting, where unnecessary interventions could cause patients harm, strain resources and lead to higher costs for patients.\u201d<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">The Path Forward<\/h2>\n\n\n\n<p>Future advancements in AI for medical applications will require more nuanced frameworks to evaluate clinical information. Designers of these frameworks must strike a balance, ensuring the AI does not miss serious conditions while also avoiding unnecessary tests and treatments.<\/p>\n\n\n\n<p>\u201cThere\u2019s no perfect solution,\u201d Williams said. \u201cBut knowing that models like ChatGPT have these tendencies, we\u2019re charged with thinking through how we want them to perform in clinical practice.\u201d<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">The Study\u2019s Broader Impact<\/h2>\n\n\n\n<p>The study offers critical insights as the health care industry increasingly explores AI-based solutions. It calls for a more collaborative approach among AI researchers, clinicians and policymakers to develop safer and more efficient health care technologies.<\/p>\n\n\n\n<p>This study invites a re-evaluation of AI applications in emergency departments, aiming for a future where generative AI can complement, rather than complicate, crucial medical decision-making processes.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>While artificial intelligence continues to make strides in various fields, a new study from UC San Francisco highlights critical limitations in its application to emergency medical care. The study, published in Nature Communications, found that ChatGPT, a large language model developed by OpenAI, often suggests unnecessary interventions in emergency departments (ED). AI Struggles With Complex [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"single-no-separators","format":"standard","meta":{"_acf_changed":false,"_uag_custom_page_level_css":"","_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[8],"tags":[],"class_list":["post-7210","post","type-post","status-publish","format-standard","hentry","category-ai"],"acf":[],"aioseo_notices":[],"uagb_featured_image_src":{"full":false,"thumbnail":false,"medium":false,"medium_large":false,"large":false,"1536x1536":false,"2048x2048":false},"uagb_author_info":{"display_name":"The University Network","author_link":"https:\/\/www.tun.com\/home\/author\/funky_junkie\/"},"uagb_comment_info":0,"uagb_excerpt":"While artificial intelligence continues to make strides in various fields, a new study from UC San Francisco highlights critical limitations in its application to emergency medical care. The study, published in Nature Communications, found that ChatGPT, a large language model developed by OpenAI, often suggests unnecessary interventions in emergency departments (ED). AI Struggles With Complex&hellip;","_links":{"self":[{"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/posts\/7210","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/comments?post=7210"}],"version-history":[{"count":5,"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/posts\/7210\/revisions"}],"predecessor-version":[{"id":7232,"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/posts\/7210\/revisions\/7232"}],"wp:attachment":[{"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/media?parent=7210"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/categories?post=7210"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/tags?post=7210"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}