{"id":19713,"date":"2025-03-10T18:49:06","date_gmt":"2025-03-10T18:49:06","guid":{"rendered":"https:\/\/www.tun.com\/home\/?p=19713"},"modified":"2025-03-10T19:10:34","modified_gmt":"2025-03-10T19:10:34","slug":"new-ai-technique-overcomes-spurious-correlations-without-prior-knowledge","status":"publish","type":"post","link":"https:\/\/www.tun.com\/home\/new-ai-technique-overcomes-spurious-correlations-without-prior-knowledge\/","title":{"rendered":"New AI Technique Overcomes Spurious Correlations Without Prior Knowledge"},"content":{"rendered":"\n<div class=\"wp-block-group\"><div class=\"wp-block-group__inner-container is-layout-constrained wp-block-group-is-layout-constrained\">\n<div class=\"wp-block-uagb-blockquote uagb-block-e7eb3fc3 uagb-blockquote__skin-border uagb-blockquote__stack-img-none\"><blockquote class=\"uagb-blockquote\"><div class=\"uagb-blockquote__content\">Researchers at North Carolina State University have developed a novel AI technique to overcome spurious correlations, even if they are unknown. This breakthrough could significantly enhance AI model performance and reliability.<\/div><footer><div class=\"uagb-blockquote__author-wrap uagb-blockquote__author-at-left\"><\/div><\/footer><\/blockquote><\/div>\n\n\n\n<div class=\"wp-block-group is-content-justification-space-between is-nowrap is-layout-flex wp-container-core-group-is-layout-0dfbf163 wp-block-group-is-layout-flex\"><div style=\"font-size:16px;\" class=\"has-text-align-left wp-block-post-author\"><div class=\"wp-block-post-author__content\"><p class=\"wp-block-post-author__name\">The University Network<\/p><\/div><\/div>\n\n\n<div class=\"wp-block-uagb-social-share uagb-social-share__outer-wrap uagb-social-share__layout-horizontal uagb-block-ee584a31\">\n<div class=\"wp-block-uagb-social-share-child uagb-ss-repeater uagb-ss__wrapper uagb-block-ec619ce7\"><span class=\"uagb-ss__link\" data-href=\"https:\/\/www.facebook.com\/sharer.php?u=\" tabindex=\"0\" role=\"button\" aria-label=\"facebook\"><span class=\"uagb-ss__source-wrap\"><span class=\"uagb-ss__source-icon\"><svg xmlns=\"https:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 512 512\"><path d=\"M504 256C504 119 393 8 256 8S8 119 8 256c0 123.8 90.69 226.4 209.3 245V327.7h-63V256h63v-54.64c0-62.15 37-96.48 93.67-96.48 27.14 0 55.52 4.84 55.52 4.84v61h-31.28c-30.8 0-40.41 19.12-40.41 38.73V256h68.78l-11 71.69h-57.78V501C413.3 482.4 504 379.8 504 256z\"><\/path><\/svg><\/span><\/span><\/span><\/div>\n\n\n\n<div class=\"wp-block-uagb-social-share-child uagb-ss-repeater uagb-ss__wrapper uagb-block-32d99934\"><span class=\"uagb-ss__link\" data-href=\"https:\/\/twitter.com\/share?url=\" tabindex=\"0\" role=\"button\" aria-label=\"twitter\"><span class=\"uagb-ss__source-wrap\"><span class=\"uagb-ss__source-icon\"><svg xmlns=\"https:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 512 512\"><path d=\"M389.2 48h70.6L305.6 224.2 487 464H345L233.7 318.6 106.5 464H35.8L200.7 275.5 26.8 48H172.4L272.9 180.9 389.2 48zM364.4 421.8h39.1L151.1 88h-42L364.4 421.8z\"><\/path><\/svg><\/span><\/span><\/span><\/div>\n\n\n\n<div class=\"wp-block-uagb-social-share-child uagb-ss-repeater uagb-ss__wrapper uagb-block-1d136f14\"><span class=\"uagb-ss__link\" data-href=\"https:\/\/www.linkedin.com\/shareArticle?url=\" tabindex=\"0\" role=\"button\" aria-label=\"linkedin\"><span class=\"uagb-ss__source-wrap\"><span class=\"uagb-ss__source-icon\"><svg xmlns=\"https:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 448 512\"><path d=\"M416 32H31.9C14.3 32 0 46.5 0 64.3v383.4C0 465.5 14.3 480 31.9 480H416c17.6 0 32-14.5 32-32.3V64.3c0-17.8-14.4-32.3-32-32.3zM135.4 416H69V202.2h66.5V416zm-33.2-243c-21.3 0-38.5-17.3-38.5-38.5S80.9 96 102.2 96c21.2 0 38.5 17.3 38.5 38.5 0 21.3-17.2 38.5-38.5 38.5zm282.1 243h-66.4V312c0-24.8-.5-56.7-34.5-56.7-34.6 0-39.9 27-39.9 54.9V416h-66.4V202.2h63.7v29.2h.9c8.9-16.8 30.6-34.5 62.9-34.5 67.2 0 79.7 44.3 79.7 101.9V416z\"><\/path><\/svg><\/span><\/span><\/span><\/div>\n<\/div>\n<\/div>\n<\/div><\/div>\n\n\n\n<p>Researchers at North Carolina State University have unveiled a new technique to address one of the most persistent problems in artificial intelligence (AI) model training \u2014 spurious correlations. These correlations often cause AI systems to make decisions based on irrelevant or misleading information, hampering the accuracy and reliability of these models.<\/p>\n\n\n\n<p>&#8220;This technique is novel in that it can be used even when you have no idea what spurious correlations the AI is relying on,&#8221; corresponding author Jung-Eun Kim, an assistant professor of computer science at NC State, said in a news release.<\/p>\n\n\n\n<p>AI models, during their training phase, sometimes latch onto unimportant features due to what is known as simplicity bias. For example, an AI trained to identify dogs in photographs might use collars as the main identifying feature if many training images depict dogs with collars. This can lead to erroneous results, such as incorrectly identifying cats with collars as dogs.<\/p>\n\n\n\n<p>Conventional methods to counteract this problem involve identifying and adjusting the spurious features within the training data. However, in many cases, pinpointing these spurious features is neither straightforward nor even possible, rendering traditional approaches ineffective.<\/p>\n\n\n\n<p>&#8220;Our goal with this work was to develop a technique that allows us to sever spurious correlations even when we know nothing about those spurious features,&#8221; Kim added.<\/p>\n\n\n\n<p>The new method, termed &#8220;data pruning,&#8221; involves removing a small subset of the most difficult samples from the training data. These samples typically force the AI model to rely on irrelevant information that leads to spurious correlations.<\/p>\n\n\n\n<p>&#8220;There can be significant variation in the data samples included in training data sets,&#8221; added Kim. &#8220;Some of the samples can be very simple, while others may be very complex. And we can measure how \u2018difficult\u2019 each sample is based on how the model behaved during training.\u201d<\/p>\n\n\n\n<p>The hypothesis underlying this approach is that eliminating a small fraction of the most challenging data samples also removes those with spurious features, hence improving model performance without causing significant adverse effects.<\/p>\n\n\n\n<p>The researchers demonstrated that this novel technique produces state-of-the-art results, even outperforming existing methods that require identification of spurious features.<\/p>\n\n\n\n<p>The peer-reviewed paper, titled &#8220;<a href=\"https:\/\/openreview.net\/pdf?id=Bk13Qfu8Ru\" target=\"_blank\" rel=\"noopener\" title=\"\">Severing Spurious Correlations with Data Pruning<\/a>,&#8221; will be presented at the International Conference on Learning Representations (ICLR) to be held in Singapore from April 24 to 28. <\/p>\n\n\n\n<p>This breakthrough holds significant potential for the field of AI, promising greater accuracy and reliability in AI model outcomes without the exhaustive need to identify and correct spurious correlations individually.<\/p>\n\n\n\n<div style=\"height:8px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p><strong>Source:<\/strong> <a href=\"https:\/\/news.ncsu.edu\/2025\/03\/10\/ai-spurious-correlations\/\" target=\"_blank\" rel=\"noopener\" title=\"\">North Carolina State University<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Researchers at North Carolina State University have unveiled a new technique to address one of the most persistent problems in artificial intelligence (AI) model training \u2014 spurious correlations. These correlations often cause AI systems to make decisions based on irrelevant or misleading information, hampering the accuracy and reliability of these models. &#8220;This technique is novel [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"single-no-separators","format":"standard","meta":{"_acf_changed":false,"_uag_custom_page_level_css":"","_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[8],"tags":[69],"class_list":["post-19713","post","type-post","status-publish","format-standard","hentry","category-ai","tag-nc-state-university"],"acf":[],"aioseo_notices":[],"uagb_featured_image_src":{"full":false,"thumbnail":false,"medium":false,"medium_large":false,"large":false,"1536x1536":false,"2048x2048":false},"uagb_author_info":{"display_name":"The University Network","author_link":"https:\/\/www.tun.com\/home\/author\/funky_junkie\/"},"uagb_comment_info":0,"uagb_excerpt":"Researchers at North Carolina State University have unveiled a new technique to address one of the most persistent problems in artificial intelligence (AI) model training \u2014 spurious correlations. These correlations often cause AI systems to make decisions based on irrelevant or misleading information, hampering the accuracy and reliability of these models. &#8220;This technique is novel&hellip;","_links":{"self":[{"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/posts\/19713","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/comments?post=19713"}],"version-history":[{"count":7,"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/posts\/19713\/revisions"}],"predecessor-version":[{"id":19732,"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/posts\/19713\/revisions\/19732"}],"wp:attachment":[{"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/media?parent=19713"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/categories?post=19713"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/tags?post=19713"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}