{"id":35384,"date":"2020-01-10T15:09:47","date_gmt":"2020-01-10T20:09:47","guid":{"rendered":"https:\/\/www.tun.com\/blog\/?p=35384"},"modified":"2021-05-20T20:40:50","modified_gmt":"2021-05-21T00:40:50","slug":"could-ai-make-internet-trolls-a-thing-of-the-past","status":"publish","type":"post","link":"https:\/\/www.tun.com\/blog\/could-ai-make-internet-trolls-a-thing-of-the-past\/","title":{"rendered":"Could AI Make Internet Trolls a Thing of the Past?"},"content":{"rendered":"\n

The age of the internet troll may soon come to an end, as researchers at Caltech and Stanford have laid the groundwork<\/a> for an effective AI tool that social media networks could eventually use to flag online hate speech and harassment.   
<\/p>\n\n\n\n

This is particularly important today, as many believe a rise in hateful rhetoric online has made room<\/a> for frequent mass shootings and violent crimes. 
<\/p>\n\n\n\n

Although many social media sites have already turned to AI to monitor hate speech and harassment on their platforms, existing methods are far from flawless.
<\/p>\n\n\n\n

In a recent study<\/a>, researchers from the University of Washington found that a leading AI tool designed to pick up on hate speech had a racial bias against African Americans. They found that tweets were one-and-a-half times more likely to be labeled as \u201coffensive\u201d when they were written by black people. And they were about two times more likely to be labeled as \u201coffensive\u201d when written in what the researchers called \u201cAfrican American English.\u201d 
<\/p>\n\n\n\n

A separate study<\/a> conducted by Cornell researchers revealed similar findings. 
<\/p>\n\n\n\n

Primarily, this is because many existing AI tools rely on keywords and aren\u2019t effective in gauging for context. The \u201cn-word,\u201d for example, can be either hateful or endearing depending on the demographic it is used by. So flagging something out of context, strictly based on the words used, is not an effective solution. 
<\/p>\n\n\n\n

\u201cThese systems are being developed to identify language that\u2019s used to target marginalized populations online,\u201d Thomas Davidson, a doctoral candidate in sociology and lead author of the Cornell study, said in a news release<\/a>. \u201cIt\u2019s extremely concerning if the same systems are themselves discriminating against the population they\u2019re designed to protect.\u201d
<\/p>\n\n\n\n

To supplement existing AI tools, many social media sites also depend on their users to point out abusive, hateful speech. Though, it\u2019s clearly not an effective long-term solution.  
<\/p>\n\n\n\n

“It isn’t scalable to have humans try to do this work by hand, and those humans are potentially biased,” Maya Srikanth, a junior at Caltech and co-author of the Caltech\/Stanford study, said in a news release<\/a>. “On the other hand, keyword searching suffers from the speed at which online conversations evolve. New terms crop up and old terms change meaning, so a keyword that was used sincerely one day might be meant sarcastically the next.”
<\/p>\n\n\n\n

So instead, her team used a GloVe (Global Vectors for Word Representation) model to discover new and relevant keywords. 
<\/p>\n\n\n\n

GloVe is a word-embedding model. Starting with one word, it can be used to find clusters of terms that are linguistically and semantically related to the original word. For example, when the researchers used the GloVe model to search Twitter for uses of \u201cMeToo,\u201d clusters of related hashtags popped up, including \u201cSupportSurvivors,\u201d \u201cNot Silent\u201d and \u201cI\u2019m With Her.\u201d This model gives researchers the ability to track keywords and phrases as they evolve over time and lets them find new ones as they emerge. 
<\/p>\n\n\n\n

GloVe also considers context, showing the extent to which specific keywords are related and giving input to how the words are being used. For example, in an online Reddit forum used by an anti-feminist men\u2019s rights activists group, the model determined that the term \u201cfemale\u201d was used most commonly with words like \u201cintercourse,\u201d \u201cnegative\u201d and \u201csexual.\u201d But in Twitter posts about the \u201cMeToo\u201d movement, the term \u201dfemale\u201d was most commonly next to words like \u201ccompanies,\u201d \u201cdesire\u201d and \u201ccapitalist.\u201d
<\/p>\n\n\n\n

Currently, the study provides proof-of-concept, proving a more powerful and effective way to spot online harassment exists. After further testing, however, the team hopes its discoveries can be used to rid the internet of trolls, making social media sites places for supportive and productive conversations rather than abusive ones. 
<\/p>\n\n\n\n

Anima Anandkumar, a co-author of the study and the Bren Professor of Computing and Mathematical Sciences at Caltech, explained that in 2018, she found herself a victim of online harassment. “It was an eye-opening experience about just how ugly trolling can get,\u201d she said in a news release. \u201cHopefully, the tools we’re developing now will help fight all kinds of harassment in the future.”<\/p>\n\n\n\n

<\/p>\n","protected":false},"excerpt":{"rendered":"

The age of the internet troll may soon come to an end, as researchers at Caltech and Stanford have laid the groundwork for an effective AI tool that social media networks could eventually use to flag online hate speech and harassment.    This is particularly important today, as many believe a rise in hateful rhetoric online […]<\/p>\n","protected":false},"author":32,"featured_media":35393,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"om_disable_all_campaigns":false,"_uag_custom_page_level_css":"","_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[626,297,625,444,230,229],"tags":[],"class_list":["post-35384","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-artificial-intelligence","category-california-institute-of-technology","category-future","category-stanford-university","category-news","category-lead-stories"],"aioseo_notices":[],"uagb_featured_image_src":{"full":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2020\/01\/AI-Internet-Troll.jpg",830,533,false],"thumbnail":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2020\/01\/AI-Internet-Troll-224x144.jpg",224,144,true],"medium":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2020\/01\/AI-Internet-Troll-300x193.jpg",300,193,true],"medium_large":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2020\/01\/AI-Internet-Troll.jpg",830,533,false],"large":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2020\/01\/AI-Internet-Troll.jpg",830,533,false],"1536x1536":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2020\/01\/AI-Internet-Troll.jpg",830,533,false],"2048x2048":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2020\/01\/AI-Internet-Troll.jpg",830,533,false]},"uagb_author_info":{"display_name":"Jackson Schroeder","author_link":"https:\/\/www.tun.com\/blog\/author\/jackson-schroeder\/"},"uagb_comment_info":0,"uagb_excerpt":"The age of the internet troll may soon come to an end, as researchers at Caltech and Stanford have laid the groundwork for an effective AI tool that social media networks could eventually use to flag online hate speech and harassment.    This is particularly important today, as many believe a rise in hateful rhetoric online…","featured_media_src_url":"https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2020\/01\/AI-Internet-Troll.jpg","_links":{"self":[{"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/posts\/35384","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/users\/32"}],"replies":[{"embeddable":true,"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/comments?post=35384"}],"version-history":[{"count":0,"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/posts\/35384\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/media\/35393"}],"wp:attachment":[{"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/media?parent=35384"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/categories?post=35384"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/tags?post=35384"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}