{"id":30886,"date":"2025-10-21T19:42:42","date_gmt":"2025-10-21T19:42:42","guid":{"rendered":"https:\/\/www.tun.com\/home\/?p=30886"},"modified":"2025-10-21T20:13:55","modified_gmt":"2025-10-21T20:13:55","slug":"ai-chatbots-found-to-violate-mental-health-ethics-new-study-reveals","status":"publish","type":"post","link":"https:\/\/www.tun.com\/home\/ai-chatbots-found-to-violate-mental-health-ethics-new-study-reveals\/","title":{"rendered":"AI Chatbots Found to Violate Mental Health Ethics, New Study Reveals"},"content":{"rendered":"\n<div class=\"wp-block-group\"><div class=\"wp-block-group__inner-container is-layout-constrained wp-block-group-is-layout-constrained\">\n<div class=\"wp-block-uagb-blockquote uagb-block-e7eb3fc3 uagb-blockquote__skin-border uagb-blockquote__stack-img-none\"><blockquote class=\"uagb-blockquote\"><div class=\"uagb-blockquote__content\">A new study from Brown University has revealed that AI chatbots, like ChatGPT, frequently breach ethical standards in mental health contexts. The research calls for new regulations to ensure user safety and effective care.<\/div><footer><div class=\"uagb-blockquote__author-wrap uagb-blockquote__author-at-left\"><\/div><\/footer><\/blockquote><\/div>\n\n\n\n<div class=\"wp-block-group is-content-justification-space-between is-nowrap is-layout-flex wp-container-core-group-is-layout-b0ffac9c wp-block-group-is-layout-flex\"><div style=\"font-size:16px\" class=\"has-text-align-left wp-block-post-author\"><div class=\"wp-block-post-author__content\"><p class=\"wp-block-post-author__name\">The University Network<\/p><\/div><\/div>\n\n\n<div class=\"wp-block-uagb-social-share uagb-social-share__outer-wrap uagb-social-share__layout-horizontal uagb-block-ee584a31\">\n<div class=\"wp-block-uagb-social-share-child uagb-ss-repeater uagb-ss__wrapper uagb-block-ec619ce7\"><span class=\"uagb-ss__link\" data-href=\"https:\/\/www.facebook.com\/sharer.php?u=\" tabindex=\"0\" role=\"button\" aria-label=\"facebook\"><span class=\"uagb-ss__source-wrap\"><span class=\"uagb-ss__source-icon\"><svg xmlns=\"https:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 512 512\"><path d=\"M504 256C504 119 393 8 256 8S8 119 8 256c0 123.8 90.69 226.4 209.3 245V327.7h-63V256h63v-54.64c0-62.15 37-96.48 93.67-96.48 27.14 0 55.52 4.84 55.52 4.84v61h-31.28c-30.8 0-40.41 19.12-40.41 38.73V256h68.78l-11 71.69h-57.78V501C413.3 482.4 504 379.8 504 256z\"><\/path><\/svg><\/span><\/span><\/span><\/div>\n\n\n\n<div class=\"wp-block-uagb-social-share-child uagb-ss-repeater uagb-ss__wrapper uagb-block-32d99934\"><span class=\"uagb-ss__link\" data-href=\"https:\/\/twitter.com\/share?url=\" tabindex=\"0\" role=\"button\" aria-label=\"twitter\"><span class=\"uagb-ss__source-wrap\"><span class=\"uagb-ss__source-icon\"><svg xmlns=\"https:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 512 512\"><path d=\"M389.2 48h70.6L305.6 224.2 487 464H345L233.7 318.6 106.5 464H35.8L200.7 275.5 26.8 48H172.4L272.9 180.9 389.2 48zM364.4 421.8h39.1L151.1 88h-42L364.4 421.8z\"><\/path><\/svg><\/span><\/span><\/span><\/div>\n\n\n\n<div class=\"wp-block-uagb-social-share-child uagb-ss-repeater uagb-ss__wrapper uagb-block-1d136f14\"><span class=\"uagb-ss__link\" data-href=\"https:\/\/www.linkedin.com\/shareArticle?url=\" tabindex=\"0\" role=\"button\" aria-label=\"linkedin\"><span class=\"uagb-ss__source-wrap\"><span class=\"uagb-ss__source-icon\"><svg xmlns=\"https:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 448 512\"><path d=\"M416 32H31.9C14.3 32 0 46.5 0 64.3v383.4C0 465.5 14.3 480 31.9 480H416c17.6 0 32-14.5 32-32.3V64.3c0-17.8-14.4-32.3-32-32.3zM135.4 416H69V202.2h66.5V416zm-33.2-243c-21.3 0-38.5-17.3-38.5-38.5S80.9 96 102.2 96c21.2 0 38.5 17.3 38.5 38.5 0 21.3-17.2 38.5-38.5 38.5zm282.1 243h-66.4V312c0-24.8-.5-56.7-34.5-56.7-34.6 0-39.9 27-39.9 54.9V416h-66.4V202.2h63.7v29.2h.9c8.9-16.8 30.6-34.5 62.9-34.5 67.2 0 79.7 44.3 79.7 101.9V416z\"><\/path><\/svg><\/span><\/span><\/span><\/div>\n<\/div>\n<\/div>\n<\/div><\/div>\n\n\n\n<p class=\"wp-block-paragraph\">As AI chatbots become increasingly popular for mental health advice, a new study from Brown University exposes how these digital assistants systematically violate ethical standards set by organizations such as the American Psychological Association.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The research, conducted by computer scientists and mental health practitioners at Brown, identified a variety of ethical violations committed by chatbots, including mishandling crisis situations, offering misleading responses and creating false empathy. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">These findings were based on simulated conversations using real chatbot responses.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u201cIn this work, we present a practitioner-informed framework of 15 ethical risks to demonstrate how LLM counselors violate ethical standards in mental health practice by mapping the model\u2019s behavior to specific ethical violations,\u201d the researchers wrote in their study. \u201cWe call on future work to create ethical, educational and legal standards for LLM counselors \u2014 standards that are reflective of the quality and rigor of care required for human-facilitated psychotherapy.\u201d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The <a href=\"https:\/\/ojs.aaai.org\/index.php\/AIES\/article\/view\/36632\" target=\"_blank\" rel=\"noopener\" title=\"\">study<\/a> will be presented on Oct. 22, 2025, at the AAAI\/ACM Conference on Artificial Intelligence, Ethics and Society. The researchers involved in this work are from Brown\u2019s Center for Technological Responsibility, Reimagination and Redesign.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Unveiling Ethical Risks<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Led by Zainab Iftikhar, a doctoral candidate in computer science at Brown, the team explored how different prompts affect AI outputs in mental health settings. The aim was to determine if prompt strategies could help models stick to ethical principles.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u201cPrompts are instructions that are given to the model to guide its behavior for achieving a specific task,\u201d Iftikhar explained. \u201cYou don\u2019t change the underlying model or provide new data, but the prompt helps guide the model&#8217;s output based on its pre-existing knowledge and learned patterns.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Despite these guiding prompts, the study found numerous ethical pitfalls. Licensed psychologists reviewed simulated chats based on real chatbot interactions and identified 15 specific ethical risks falling into five general categories: lack of contextual adaptation, poor therapeutic collaboration, deceptive empathy, unfair discrimination, and lack of safety and crisis management.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Need for Regulation<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Iftikhar noted that while human therapists may also fall afoul of ethical standards, they are governed by boards and accountable for malpractice.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u201cFor human therapists, there are governing boards and mechanisms for providers to be held professionally liable for mistreatment and malpractice,\u201d Iftikhar added. \u201cBut when LLM counselors make these violations, there are no established regulatory frameworks.\u201d<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Potential and Precaution<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Despite the ethical concerns, Iftikhar recognizes the potential benefits of AI in mental health care, especially in mitigating barriers related to cost and the scarcity of trained professionals. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">However, she emphasizes the need for thoughtful implementation and regulation to harness these benefits safely.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;If you\u2019re talking to a chatbot about mental health, these are some things that people should be looking out for,&#8221; she added.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Ellie Pavlick, a computer science professor at Brown not involved in the study, emphasized the importance of careful scientific scrutiny of AI systems in mental health care. She leads ARIA, a National Science Foundation AI research institute at Brown focused on developing trustworthy AI assistants.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u201cThe reality of AI today is that it&#8217;s far easier to build and deploy systems than to evaluate and understand them,\u201d Pavlick said in the news release. \u201cThis paper required a team of clinical experts and a study that lasted for more than a year in order to demonstrate these risks. Most work in AI today is evaluated using automatic metrics which, by design, are static and lack a human in the loop.\u201d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Pavlick believes the study provides a valuable template for future research aimed at ensuring safe AI applications in mental health.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">&#8220;There is a real opportunity for AI to play a role in combating the mental health crisis that our society is facing, but it&#8217;s of the utmost importance that we take the time to really critique and evaluate our systems every step of the way to avoid doing more harm than good,\u201d she added. \u201cThis work offers a good example of what\u00a0that can look like.\u201d<\/p>\n\n\n\n<div style=\"height:14px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Source: <\/strong><a href=\"https:\/\/www.brown.edu\/news\/2025-10-21\/ai-mental-health-ethics\" target=\"_blank\" rel=\"noopener\" title=\"\">Brown University<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>As AI chatbots become increasingly popular for mental health advice, a new study from Brown University exposes how these digital assistants systematically violate ethical standards set by organizations such as the American Psychological Association. The research, conducted by computer scientists and mental health practitioners at Brown, identified a variety of ethical violations committed by chatbots, [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"single-no-separators","format":"standard","meta":{"_acf_changed":false,"_uag_custom_page_level_css":"","_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[8,13],"tags":[42],"class_list":["post-30886","post","type-post","status-publish","format-standard","hentry","category-ai","category-mental-health","tag-brown-university"],"acf":[],"aioseo_notices":[],"uagb_featured_image_src":{"full":false,"thumbnail":false,"medium":false,"medium_large":false,"large":false,"1536x1536":false,"2048x2048":false},"uagb_author_info":{"display_name":"The University Network","author_link":"https:\/\/www.tun.com\/home\/author\/funky_junkie\/"},"uagb_comment_info":0,"uagb_excerpt":"As AI chatbots become increasingly popular for mental health advice, a new study from Brown University exposes how these digital assistants systematically violate ethical standards set by organizations such as the American Psychological Association. The research, conducted by computer scientists and mental health practitioners at Brown, identified a variety of ethical violations committed by chatbots,&hellip;","_links":{"self":[{"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/posts\/30886","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/comments?post=30886"}],"version-history":[{"count":15,"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/posts\/30886\/revisions"}],"predecessor-version":[{"id":30910,"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/posts\/30886\/revisions\/30910"}],"wp:attachment":[{"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/media?parent=30886"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/categories?post=30886"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/tags?post=30886"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}