{"id":27065,"date":"2018-10-10T15:13:28","date_gmt":"2018-10-10T19:13:28","guid":{"rendered":"https:\/\/www.tun.com\/blog\/?p=27065"},"modified":"2022-03-16T10:13:30","modified_gmt":"2022-03-16T14:13:30","slug":"fight-fake-news-target-source-not-story","status":"publish","type":"post","link":"https:\/\/www.tun.com\/blog\/fight-fake-news-target-source-not-story\/","title":{"rendered":"Fighting Fake News by Targeting the Source, Not the Story"},"content":{"rendered":"<p>The onslaught of media in the social media era has made it ever-more challenging to know what news to trust. The phrase \u201cfake news\u201d has become a part of common parlance as fabricated stories stating false or misleading claims spread misinformation to thousands, even millions, of readers each day.<\/p>\n<p>This has created a major problem for traditional fact-checkers like Snopes or Politifact, which simply cannot keep up with the massive amounts of news stories circulated around the internet.<\/p>\n<p>These fact-checkers have typically operated by debunking or verifying specific claims made by news outlets or prominent individuals. Because information spreads so quickly these days, this method has proven to be ineffective.<\/p>\n<p>A fake news story may be seen by thousands of people before a fact-checker has a chance to correct it. The damage is already done by then.<\/p>\n<p>Now, a team of researchers from MIT\u2019s Computer Science and Artificial Intelligence Lab (CSAIL) and the Qatar Computing Research Institute (QCRI) is offering a new approach.<\/p>\n<p>The researchers have developed a machine learning system that fact-checks <a href=\"http:\/\/news.mit.edu\/2018\/mit-csail-machine-learning-system-detects-fake-news-from-source-1004\">not the story but the news source<\/a>. By analyzing the text of hundreds of articles published by a given news outlet, the system creates a grade for the source based on its accuracy of reporting and bias.<\/p>\n<p>\u201cIf a website has published fake news before, there\u2019s a good chance they\u2019ll do it again,\u201d <a href=\"https:\/\/www.csail.mit.edu\/person\/ramy-baly\">Ramy Baly<\/a>, a postdoctoral associate at MIT and the lead author on a paper about the system, said in a statement. \u201cBy automatically scraping data about these sites, the hope is that our system can help figure out which ones are likely to do it in the first place.\u201d<\/p>\n<p>It is not the first <a href=\"https:\/\/www.tun.com\/blog\/detect-fake-news-with-algorithm\/\">machine learning fact-checking system<\/a>, but, until now, most of the research has gone into identifying individual stories, rather than the news sources as a whole.<\/p>\n<p>The researchers suggest that their more broad-based approach will be a more cost-effective and efficient tool for both fact-checkers and readers.<\/p>\n<p>\u201cWe cannot fact-check every single news story. This is too costly,\u201d said <a href=\"https:\/\/www.qcri.org\/our-people\/bio?pid=35&amp;par=acc&amp;name=PreslavNakov\">Preslav Nakov<\/a>, a senior scientist at QCRI and a co-author of the study. \u201cIt is much more feasible to check the news outlets. Also, checking a news story takes time, while we can check sources in advance.\u201d<\/p>\n<p>The system uses a variety of information sources to determine a publication\u2019s trustworthiness, Nakov said.<\/p>\n<p>It analyzes the text of a source\u2019s articles. The system looks at the style, subjectivity, sentiment and vocabulary richness, among other characteristics.<\/p>\n<p>More emotional or hyperbolic language tends to be a sign of fake news. Keywords and tone can reveal bias; left-leaning publications focus on moral concepts like care, harm, fairness and reciprocity, while right-leaning publications focus on concepts like loyalty, authority and sanctity.<\/p>\n<p>It only requires about 150 articles to reliably determine how trustworthy a news source is.<\/p>\n<p>The system also looks at the Wikipedia page of a news outlet. The Wikipedia page is assessed based on length and the substance of the text. It searches for target words and phrases like \u201cextreme\u201d or \u201cconspiracy theory\u201d that can help determine the site\u2019s credibility.<\/p>\n<p>Likewise, the system examines a site\u2019s Twitter presence. If there is an account, it looks at how old the account is, how many followers it has, whether it is verified, what is written in the text, and other notable information.<\/p>\n<p>Lastly, it looks at certain website features such as the URL structure and web traffic statistics.<\/p>\n<p>Each of these features helps to build a complete picture of the website\u2019s bias and credibility.<\/p>\n<p>This information, along with data from Media Bias\/Fact Check (MBFC), a fact-checking website run by human fact-checkers who report on the accuracy and bias of over 2,000 news sites, is fed into a machine learning algorithm called a Support Vector Machine (SVM) classifier.<\/p>\n<p>The SVM is programmed to classify news sites by factuality and bias. Using this set of information, it can identify factuality with 65 percent accuracy and determine bias with 70 percent accuracy.<\/p>\n<figure id=\"attachment_27072\" aria-describedby=\"caption-attachment-27072\" style=\"width: 639px\" class=\"wp-caption aligncenter\"><img decoding=\"async\" class=\"size-full wp-image-27072\" src=\"https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/10\/Fake-news-machine-learning-bias-factuality-chart-edited-MIT-00.jpg\" alt=\"\" width=\"639\" height=\"426\" srcset=\"https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/10\/Fake-news-machine-learning-bias-factuality-chart-edited-MIT-00.jpg 639w, https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/10\/Fake-news-machine-learning-bias-factuality-chart-edited-MIT-00-300x200.jpg 300w\" sizes=\"(max-width: 639px) 100vw, 639px\" \/><figcaption id=\"caption-attachment-27072\" class=\"wp-caption-text\">Image: Courtesy of MIT CSAIL<\/figcaption><\/figure>\n<p>The researchers have already adapted the system to other languages. They have tested left-right bias on 100 news outlets in nine languages: Arabic, Hungarian, Italian, Turkish, Greek, French, German, Danish and Macedonian.<\/p>\n<p>\u201cWe have developed a language-independent model for that, which is slightly worse than the English one, but not by much,\u201d said Nakov.<\/p>\n<p>They are also working on adapting the system to determine bias along different ideological spectrums. As of now, it is only capable of determining left-right bias.<\/p>\n<p>Nakov noted that these divisions are not universal.<\/p>\n<p>\u201cThere are reversed notions in Eastern Europe, where left is conservative and right is liberal,\u201d he said. \u201cIn other parts of the world, other divisions might make more sense, such as religious versus secular in the Arab world. Or maybe pro-West versus anti-West in some countries. Or pro-Russia versus anti-Russia.\u201d<\/p>\n<p>The researchers said that the system is not intended to function as the be-all and end-all of fact-checking. It could be used in conjunction with traditional fact-checking and machine learning systems that focus on article accuracy.<\/p>\n<p>The team is currently developing a fact-checking news aggregator that compiles news stories from various sources and rates them according to factuality, left-right ideology, propaganda and hyper-partisanship.<\/p>\n<p>QCRI also has plans to develop a news aggregator app that exposes users to different points of view by presenting them with a collection of articles that span the political spectrum.<\/p>\n<p>Together with traditional fact-checkers, this system and others like it could help a reader understand a story\u2019s credibility before reading or sharing it.<\/p>\n<p>\u201cIt\u2019s interesting to think about new ways to present the news to people,\u201d Nakov said in a statement. \u201cTools like this could help people give a bit more thought to issues and explore other perspectives that they might not have otherwise considered.\u201d<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The onslaught of media in the social media era has made it ever-more challenging to know what news to trust. The phrase \u201cfake news\u201d has become a part of common parlance as fabricated stories stating false or misleading claims spread misinformation to thousands, even millions, of readers each day. This has created a major problem [&hellip;]<\/p>\n","protected":false},"author":61,"featured_media":27071,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"om_disable_all_campaigns":false,"_uag_custom_page_level_css":"","_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[376,230,229],"tags":[],"class_list":["post-27065","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-massachusetts-institute-of-technology","category-news","category-lead-stories"],"aioseo_notices":[],"uagb_featured_image_src":{"full":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/10\/Fake-news-machine-learning-InfoWars-page-annotated-edited-MIT-00.png",830,533,false],"thumbnail":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/10\/Fake-news-machine-learning-InfoWars-page-annotated-edited-MIT-00-224x144.png",224,144,true],"medium":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/10\/Fake-news-machine-learning-InfoWars-page-annotated-edited-MIT-00-300x193.png",300,193,true],"medium_large":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/10\/Fake-news-machine-learning-InfoWars-page-annotated-edited-MIT-00.png",830,533,false],"large":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/10\/Fake-news-machine-learning-InfoWars-page-annotated-edited-MIT-00.png",830,533,false],"1536x1536":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/10\/Fake-news-machine-learning-InfoWars-page-annotated-edited-MIT-00.png",830,533,false],"2048x2048":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/10\/Fake-news-machine-learning-InfoWars-page-annotated-edited-MIT-00.png",830,533,false]},"uagb_author_info":{"display_name":"Sam Benezra","author_link":"https:\/\/www.tun.com\/blog\/author\/sam-benezra\/"},"uagb_comment_info":0,"uagb_excerpt":"The onslaught of media in the social media era has made it ever-more challenging to know what news to trust. The phrase \u201cfake news\u201d has become a part of common parlance as fabricated stories stating false or misleading claims spread misinformation to thousands, even millions, of readers each day. This has created a major problem&hellip;","featured_media_src_url":"https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/10\/Fake-news-machine-learning-InfoWars-page-annotated-edited-MIT-00.png","_links":{"self":[{"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/posts\/27065","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/users\/61"}],"replies":[{"embeddable":true,"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/comments?post=27065"}],"version-history":[{"count":0,"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/posts\/27065\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/media\/27071"}],"wp:attachment":[{"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/media?parent=27065"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/categories?post=27065"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/tags?post=27065"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}