{"id":12534,"date":"2024-12-18T21:03:39","date_gmt":"2024-12-18T21:03:39","guid":{"rendered":"https:\/\/www.tun.com\/home\/?p=12534"},"modified":"2024-12-18T21:03:40","modified_gmt":"2024-12-18T21:03:40","slug":"study-reveals-limitations-in-chatgpts-capability-to-replace-finance-professionals","status":"publish","type":"post","link":"https:\/\/www.tun.com\/home\/study-reveals-limitations-in-chatgpts-capability-to-replace-finance-professionals\/","title":{"rendered":"Study Reveals Limitations in ChatGPT&#8217;s Capability to Replace Finance Professionals"},"content":{"rendered":"\n<div class=\"wp-block-group\"><div class=\"wp-block-group__inner-container is-layout-constrained wp-block-group-is-layout-constrained\">\n<div class=\"wp-block-uagb-blockquote uagb-block-e7eb3fc3 uagb-blockquote__skin-border uagb-blockquote__stack-img-none\"><blockquote class=\"uagb-blockquote\"><div class=\"uagb-blockquote__content\">A WSU-led study found that while AI like ChatGPT performs well on multiple-choice financial licensing exams, it struggles with complex, specific tasks. The findings suggest AI is better suited as an assistance tool rather than a replacement for finance professionals.<\/div><footer><div class=\"uagb-blockquote__author-wrap uagb-blockquote__author-at-left\"><\/div><\/footer><\/blockquote><\/div>\n\n\n\n<div class=\"wp-block-group is-content-justification-space-between is-nowrap is-layout-flex wp-container-core-group-is-layout-0dfbf163 wp-block-group-is-layout-flex\"><div style=\"font-size:16px;\" class=\"has-text-align-left wp-block-post-author\"><div class=\"wp-block-post-author__content\"><p class=\"wp-block-post-author__name\">The University Network<\/p><\/div><\/div>\n\n\n<div class=\"wp-block-uagb-social-share uagb-social-share__outer-wrap uagb-social-share__layout-horizontal uagb-block-ee584a31\">\n<div class=\"wp-block-uagb-social-share-child uagb-ss-repeater uagb-ss__wrapper uagb-block-ec619ce7\"><span class=\"uagb-ss__link\" data-href=\"https:\/\/www.facebook.com\/sharer.php?u=\" tabindex=\"0\" role=\"button\" aria-label=\"facebook\"><span class=\"uagb-ss__source-wrap\"><span class=\"uagb-ss__source-icon\"><svg xmlns=\"https:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 512 512\"><path d=\"M504 256C504 119 393 8 256 8S8 119 8 256c0 123.8 90.69 226.4 209.3 245V327.7h-63V256h63v-54.64c0-62.15 37-96.48 93.67-96.48 27.14 0 55.52 4.84 55.52 4.84v61h-31.28c-30.8 0-40.41 19.12-40.41 38.73V256h68.78l-11 71.69h-57.78V501C413.3 482.4 504 379.8 504 256z\"><\/path><\/svg><\/span><\/span><\/span><\/div>\n\n\n\n<div class=\"wp-block-uagb-social-share-child uagb-ss-repeater uagb-ss__wrapper uagb-block-32d99934\"><span class=\"uagb-ss__link\" data-href=\"https:\/\/twitter.com\/share?url=\" tabindex=\"0\" role=\"button\" aria-label=\"twitter\"><span class=\"uagb-ss__source-wrap\"><span class=\"uagb-ss__source-icon\"><svg xmlns=\"https:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 512 512\"><path d=\"M389.2 48h70.6L305.6 224.2 487 464H345L233.7 318.6 106.5 464H35.8L200.7 275.5 26.8 48H172.4L272.9 180.9 389.2 48zM364.4 421.8h39.1L151.1 88h-42L364.4 421.8z\"><\/path><\/svg><\/span><\/span><\/span><\/div>\n\n\n\n<div class=\"wp-block-uagb-social-share-child uagb-ss-repeater uagb-ss__wrapper uagb-block-1d136f14\"><span class=\"uagb-ss__link\" data-href=\"https:\/\/www.linkedin.com\/shareArticle?url=\" tabindex=\"0\" role=\"button\" aria-label=\"linkedin\"><span class=\"uagb-ss__source-wrap\"><span class=\"uagb-ss__source-icon\"><svg xmlns=\"https:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 448 512\"><path d=\"M416 32H31.9C14.3 32 0 46.5 0 64.3v383.4C0 465.5 14.3 480 31.9 480H416c17.6 0 32-14.5 32-32.3V64.3c0-17.8-14.4-32.3-32-32.3zM135.4 416H69V202.2h66.5V416zm-33.2-243c-21.3 0-38.5-17.3-38.5-38.5S80.9 96 102.2 96c21.2 0 38.5 17.3 38.5 38.5 0 21.3-17.2 38.5-38.5 38.5zm282.1 243h-66.4V312c0-24.8-.5-56.7-34.5-56.7-34.6 0-39.9 27-39.9 54.9V416h-66.4V202.2h63.7v29.2h.9c8.9-16.8 30.6-34.5 62.9-34.5 67.2 0 79.7 44.3 79.7 101.9V416z\"><\/path><\/svg><\/span><\/span><\/span><\/div>\n<\/div>\n<\/div>\n\n\n\n<p>As artificial intelligence systems like ChatGPT increasingly permeate various industries, a recent study led by Washington State University highlights significant limitations in AI&#8217;s capability to replace human financial professionals.<\/p>\n<\/div><\/div>\n\n\n\n<p>The study, <a href=\"https:\/\/www.tandfonline.com\/doi\/full\/10.1080\/0015198X.2024.2411941\" target=\"_blank\" rel=\"noopener\" title=\"\">published<\/a> in the Financial Analysts Journal, analyzed over 10,000 responses from AI language models BARD, Llama and ChatGPT to financial exam questions. <\/p>\n\n\n\n<p>The researchers &#8212; Donald (DJ) Fairhurst, an associate professor of finance at WSU&#8217;s Carson College of Business, and Daniel Greene, the Bill Short Associate Professor of Finance at Clemson&#8217;s Wilbur O. and Ann Powers College of Business &#8212; sought not just the right answers but also detailed explanations to gauge the AI&#8217;s comprehension and reasoning compared to human experts.<\/p>\n\n\n\n<p>&#8220;Passing certification exams is not enough. We really need to dig deeper to get to what these models can really do,&#8221; Fairhurst said in a <a href=\"https:\/\/news.wsu.edu\/press-release\/2024\/12\/18\/chatgpt-errors-show-it-cannot-replace-finance-professionals-yet\/\" target=\"_blank\" rel=\"noopener\" title=\"\">news release<\/a>.<\/p>\n\n\n\n<p>Although ChatGPT, particularly its paid version 4.0, demonstrated superior performance in providing accurate and human-like answers, it still fell short in more specialized scenarios. <\/p>\n\n\n\n<p>&#8220;For broad concepts where there have been good explanations on the internet for a long time, ChatGPT can do a very good job at synthesizing those concepts. If it\u2019s a specific, idiosyncratic issue, it\u2019s really going to struggle,&#8221; Fairhurst added.<\/p>\n\n\n\n<p>The study utilized questions from various licensing exams, including the Series 6, 7, 65 and 66, which mirror the real-world tasks performed by financial professionals. The AI models showed high accuracy in areas like securities transactions and market trend monitoring. However, they struggled with more complex issues, such as determining clients&#8217; insurance coverage and tax status.<\/p>\n\n\n\n<p>Fairhurst and Greene also experimented with fine-tuning ChatGPT 3.5 by providing it with examples of correct responses and explanations, which significantly improved its accuracy, rivaling that of ChatGPT 4.0.<\/p>\n\n\n\n<p>The research continues as the team, including WSU doctoral student Adam Bozman, explores other financial tasks such as evaluating potential merger deals. Given that ChatGPT&#8217;s training data only goes up to September 2021, they are testing it against known outcomes of deals made after that date. Early results suggest that the AI model underperforms in this domain, reaffirming the notion that AI is not yet ready for complex financial decision-making.<\/p>\n\n\n\n<p>The implications of these findings suggest that AI, while a powerful tool, is best utilized to assist experienced financial professionals rather than replace them. <\/p>\n\n\n\n<p>&#8220;It\u2019s far too early to be worried about ChatGPT taking finance jobs completely,&#8221; added Fairhurst. <\/p>\n\n\n\n<p>However, the rise of AI could transform the structure of entry-level roles in investment banks. <\/p>\n\n\n\n<p>&#8220;The practice of bringing a bunch of people on as junior analysts, letting them compete and keeping the winners \u2013 that becomes a lot more costly. So it may mean a downturn in those types of jobs, but it\u2019s not because ChatGPT is better than the analysts, it&#8217;s because we\u2019ve been asking junior analysts to do tasks that are more menial,&#8221; Fairhurst added.<\/p>\n\n\n\n<p>As AI continues to evolve, the conversation around its role in the financial sector will undoubtedly persist. This study marks a critical step in understanding both the potential and the limitations of AI technologies like ChatGPT in specialized professions.<\/p>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>As artificial intelligence systems like ChatGPT increasingly permeate various industries, a recent study led by Washington State University highlights significant limitations in AI&#8217;s capability to replace human financial professionals. The study, published in the Financial Analysts Journal, analyzed over 10,000 responses from AI language models BARD, Llama and ChatGPT to financial exam questions. The researchers [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"single-no-separators","format":"standard","meta":{"_acf_changed":false,"_uag_custom_page_level_css":"","_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[8,9],"tags":[],"class_list":["post-12534","post","type-post","status-publish","format-standard","hentry","category-ai","category-career"],"acf":[],"aioseo_notices":[],"uagb_featured_image_src":{"full":false,"thumbnail":false,"medium":false,"medium_large":false,"large":false,"1536x1536":false,"2048x2048":false},"uagb_author_info":{"display_name":"The University Network","author_link":"https:\/\/www.tun.com\/home\/author\/funky_junkie\/"},"uagb_comment_info":0,"uagb_excerpt":"As artificial intelligence systems like ChatGPT increasingly permeate various industries, a recent study led by Washington State University highlights significant limitations in AI&#8217;s capability to replace human financial professionals. The study, published in the Financial Analysts Journal, analyzed over 10,000 responses from AI language models BARD, Llama and ChatGPT to financial exam questions. The researchers&hellip;","_links":{"self":[{"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/posts\/12534","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/comments?post=12534"}],"version-history":[{"count":8,"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/posts\/12534\/revisions"}],"predecessor-version":[{"id":12593,"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/posts\/12534\/revisions\/12593"}],"wp:attachment":[{"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/media?parent=12534"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/categories?post=12534"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/tags?post=12534"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}