{"id":24512,"date":"2018-06-14T10:26:15","date_gmt":"2018-06-14T14:26:15","guid":{"rendered":"https:\/\/www.tun.com\/blog\/?p=24512"},"modified":"2022-03-16T10:57:49","modified_gmt":"2022-03-16T14:57:49","slug":"brain-work-during-speech","status":"publish","type":"post","link":"https:\/\/www.tun.com\/blog\/brain-work-during-speech\/","title":{"rendered":"Study Reveals How Brain Works During Speech"},"content":{"rendered":"

Everytime we speak, we are engaging nearly 100 different muscles in our lips, jaw, tongue and throat. Now, a new UC San Francisco study shows <\/span>how the brain works during speech<\/span><\/a> and suggests promising results to help create prosthetic devices for those who are unable to speak. <\/span><\/p>\n

The new study is published in <\/span>Neuron<\/span><\/a>.<\/span><\/p>\n

More than just sound<\/b><\/h2>\n

For a long time, linguists divided speech into abstract units of sounds called “<\/span>phonemes<\/span><\/a>,\u201d by which they considered the \/k\/ sound in “keep” the same as the \/k\/ in “coop.” <\/span><\/p>\n

But in reality, according to the UCSF team, our mouth forms the sound differently in these two words to prepare for the different vowels that follow. <\/span><\/p>\n

At least to the brain regions responsible for producing speech, this physical difference appears to be more important than the theoretical sameness of the phoneme.<\/span><\/p>\n

Picking up from their previous <\/span>study<\/span><\/a> on how the brain interprets the sounds of isolated, single syllables, the researchers dug deeper into how the brain works during fluent speech. <\/span><\/p>\n

\u201cIn our most recent study, we were curious as to how the complexity of speech is represented in the brain with respect to the actual movements of the vocal tract,\u201d said <\/span>Josh Chartier<\/span><\/a>, a doctoral candidate in the <\/span>UC Berkeley and UCSF Joint Program in Bioengineering<\/span><\/a> and co-author of the study.<\/span><\/p>\n

The study<\/b><\/h2>\n

The researchers used electrocorticography, or <\/span>ECoG<\/span><\/a>, a method used in brain surgeries that places high-density arrays of electrodes onto the surface of the patients\u2019 brains to record electrical activity in important areas of a human brain, such as those involved in language. <\/span><\/p>\n

\u201cIt\u2019s a unique means of looking at thousands of neurons activating in unison,\u201d Chartier said in a statement.<\/span><\/p>\n

With ECoG electrodes placed over a region of ventral sensorimotor cortex that is a key center of speech production, five volunteers awaiting surgery were asked to read aloud a collection of 460 natural sentences, which were constructed to encapsulate nearly all the possible articulatory contexts in American English. <\/span><\/p>\n

This comprehensiveness was crucial to capture the complete range of \u201c<\/span>coarticulation<\/span><\/a>,\u201d the blending of phonemes in natural speech.<\/span><\/p>\n

\u201cWithout coarticulation, our speech would be blocky and segmented to the point where we couldn\u2019t really understand it,\u201d Chartier said in a statement.<\/span><\/p>\n

Instead of simultaneously recording the volunteers\u2019 neural activity and their tongue, mouth and larynx movements, the researchers recorded only audio of the volunteers speaking and developed a new deep learning algorithm to estimate which movements were made during specific speaking tasks. <\/span><\/p>\n

The result<\/b><\/h2>\n

The researchers found that the brain’s speech centers are organized more according to the physical movements of the vocal tract as it produces speech than by how the speech sounds.<\/span><\/p>\n

They identified<\/span> four emergent groups of neurons that appeared to be responsible for coordinating movements of muscles of the lips, tongue and throat into the four main configurations of the vocal tract used in American English. <\/span><\/p>\n

Also, they identified neural populations associated with specific classes of phonetic groupings, such as consonants and vowels of different types, that are more of a byproduct of more natural groupings based on different types of muscle movement than their sound. <\/span><\/p>\n

\u201cIt\u2019s really made me think twice about phonemes fit in \u2014 in a sense, these units of speech that we pin so much of our research on are just byproducts of a sensorimotor signal,\u201d <\/span>Gopala K. Anumanchipalli<\/span><\/a>, a doctoral candidate in the <\/span>Department of Neurological Surgery<\/span><\/a> at UCSF<\/span> and co-author of the study, said in a statement. \u00a0<\/span><\/p>\n

Regarding coarticulation, the researchers discovered that our brains\u2019 speech centers coordinate different muscle movement patterns based on the context of what\u2019s being said, and the order in which different sounds occur. <\/span><\/p>\n

For example, the jaw opens more to say the word \u201ctap\u201d than to say the word \u201chas\u201d even though they both have the same vowel sound (\/ae\/). This is because the mouth has to get ready to close to make the \/z\/ sound in \u201chas,\u201d but not in \u201ctap.\u201d <\/span><\/p>\n

They found that neurons in the ventral sensorimotor cortex, an area in the brain that controls speech, were highly attuned to this and other co-articulatory features of English, suggesting that the brain cells are tuned to produce fluid, context-dependent speech, as opposed to reading out discrete speech segments in consecutive order.<\/span><\/p>\n

In languages other than English, the researchers speculate that the brain activity patterns would be reflective of the dominant vocal movements used in that language. <\/span><\/p>\n

\u201cThis study highlights why we need to take into account vocal tract movements and not just linguistic features like phonemes when studying speech production,\u201d Chartier said in a statement. <\/span><\/p>\n

The next step<\/b><\/h2>\n

According to Chartier, the researchers will expand their study to look at native speakers of other languages. <\/span><\/p>\n

In the long term, they hope this study will pave the way for building speech prosthetics. <\/span><\/p>\n

\u201cWe know now that the sensorimotor cortex encodes vocal tract movements, so we can use that knowledge to decode cortical activity and translate that via a speech prosthetic,\u201d Chartier said in a statement. \u201cThis would give voice to people who can\u2019t speak but have intact neural functions.\u201d<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"

Everytime we speak, we are engaging nearly 100 different muscles in our lips, jaw, tongue and throat. Now, a new UC San Francisco study shows how the brain works during speech and suggests promising results to help create prosthetic devices for those who are unable to speak. The new study is published in Neuron. More […]<\/p>\n","protected":false},"author":60,"featured_media":24517,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"om_disable_all_campaigns":false,"_uag_custom_page_level_css":"","_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[619,230,229,243],"tags":[],"class_list":["post-24512","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-mind","category-news","category-lead-stories","category-health"],"aioseo_notices":[],"uagb_featured_image_src":{"full":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/06\/Brain-Speech.jpg",830,533,false],"thumbnail":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/06\/Brain-Speech-224x144.jpg",224,144,true],"medium":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/06\/Brain-Speech-300x193.jpg",300,193,true],"medium_large":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/06\/Brain-Speech.jpg",830,533,false],"large":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/06\/Brain-Speech.jpg",830,533,false],"1536x1536":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/06\/Brain-Speech.jpg",830,533,false],"2048x2048":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/06\/Brain-Speech.jpg",830,533,false]},"uagb_author_info":{"display_name":"Hyeyeun Jeon","author_link":"https:\/\/www.tun.com\/blog\/author\/hyeyeun-jeon\/"},"uagb_comment_info":0,"uagb_excerpt":"Everytime we speak, we are engaging nearly 100 different muscles in our lips, jaw, tongue and throat. Now, a new UC San Francisco study shows how the brain works during speech and suggests promising results to help create prosthetic devices for those who are unable to speak. The new study is published in Neuron. More…","featured_media_src_url":"https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/06\/Brain-Speech.jpg","_links":{"self":[{"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/posts\/24512","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/users\/60"}],"replies":[{"embeddable":true,"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/comments?post=24512"}],"version-history":[{"count":0,"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/posts\/24512\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/media\/24517"}],"wp:attachment":[{"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/media?parent=24512"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/categories?post=24512"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/tags?post=24512"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}