{"id":24776,"date":"2018-06-27T15:06:48","date_gmt":"2018-06-27T19:06:48","guid":{"rendered":"https:\/\/www.tun.com\/blog\/?p=24776"},"modified":"2022-03-16T10:48:23","modified_gmt":"2022-03-16T14:48:23","slug":"algorithm-analyzes-brain-scans-thousand-times-faster","status":"publish","type":"post","link":"https:\/\/www.tun.com\/blog\/algorithm-analyzes-brain-scans-thousand-times-faster\/","title":{"rendered":"New Algorithm Makes Analyzing Brain Scans 1,000 Times Faster"},"content":{"rendered":"

MIT researchers have <\/span>built a machine-learning algorithm<\/span><\/a> that can register MRI scans and other 3D images, and compare and analyze them in a matter of seconds. <\/span><\/p>\n

This reduces the traditional runtime of two hours or more down to just a second. <\/span><\/p>\n

Medical imaging, including MRI and CT scans, is not only a medical breakthrough, allowing doctors to thoroughly compare and analyze anatomical differences, but also a <\/span>giant global business<\/span><\/a> with nearly $50 billion spent on almost 40 million scans per year in the U.S. alone. <\/span><\/p>\n

However, this widely used technology still takes up to two hours or more, slowing down clinical researches and limiting other potential applications.<\/span><\/p>\n

\u201cTraditional algorithms for medical image registration are prohibitively slow, making it unlikely that they will be used in many clinical settings,\u201d said <\/span>Adrian Dalca<\/span><\/a>, co-author and a postdoctoral fellow at Massachusetts General Hospital and <\/span>MIT\u2019s Computer Science and Artificial Intelligence Laboratory (<\/span>CSAIL<\/span><\/a>)<\/span>, and <\/span>Guha Balakrishnan, co-author and <\/span>a graduate student in CSAIL and the Department of Engineering and Computer Science (<\/span>EECS<\/span><\/a>). <\/span>\u00a0<\/span><\/p>\n

The two papers describing their machine-learning algorithm were <\/span>presented at the <\/span>2018 Conference on Computer Vision and Pattern Recognition (CVPR)<\/span><\/a> last week, and will be presented at the <\/span>21st International Conference on Medical Image Computing and Computer Assisted Interventions (MICCAI)<\/span><\/a> in Spain, Sept. 16-20.<\/span><\/p>\n

Why does it take so long?<\/b><\/h2>\n

In MRI scans, hundreds of stacked 2-D images form massive 3D images, called “volumes,” that contain a million or more 3D pixels, called “voxels.”<\/span><\/p>\n

For example, when scanning the brain, the technique produces many 2-D \u201cslices\u201d that are combined to form a 3D representation of the brain.<\/span><\/p>\n

This is why it takes a long time to meticulously align all voxels in the first scan with those in the second. This process is made more challenging when the scans are from different machines, and becomes particularly slow when analyzing scans from large populations.<\/span><\/p>\n

In cases where doctors need to learn about the variations in brain structures across hundreds of patients with a particular disease or condition, the scanning alone could potentially take hundreds of hours.<\/span><\/p>\n

“You have two different images of two different brains, put them on top of each other, and you start wiggling one until one fits the other. Mathematically, this optimization procedure takes a long time,” Dalca said in a statement.<\/span><\/p>\n

However, instead of starting from scratch when given a new pair of images, the researchers wondered what would happen if the algorithm learned from previous scans.<\/span><\/p>\n

“After 100 registrations, you should have learned something from the alignment. That’s what we leverage,\u201d Balakrishnan said in a statement.<\/span><\/p>\n

An algorithm that learns<\/b><\/h2>\n

The new machine-learning algorithm, called the \u201cVoxelMorph,\u201d is powered by a convolutional neural network (<\/span>CNN<\/span><\/a>), a machine-learning approach commonly used for image processing. <\/span><\/p>\n

These networks consist of many nodes that process image and other information across several layers of computation.<\/span><\/p>\n

The researchers trained VoxelMorph on 7,000 publicly available MRI brain scans.<\/span><\/p>\n

During training, VoxelMorph registered thousands of pairs of brain scan images. Its CNN component and spatial transformer, a modified computational layer, learned all the necessary information about how to align images by capturing similar groups of voxels in each pair of MRI scans, such as anatomical shapes common to both scans.<\/span><\/p>\n

Then, when fed two new scans, VoxelMorph used the parameters it estimated during the training to quickly calculate the exact alignment of every voxel in the new scans. <\/span><\/p>\n

In short, the algorithm’s CNN component gains all necessary information during training so that, during each new registration, the entire registration can be executed using one, easily computable function evaluation.<\/span><\/p>\n

“The tasks of aligning a brain MRI shouldn’t be that different when you’re aligning one pair of brain MRIs or another,\u201d Balakrishnan said in a statement. <\/span><\/p>\n

“There is information you should be able to carry over in how you do the alignment. If you’re able to learn something from previous image registration, you can do a new task much faster and with the same accuracy.”<\/span><\/p>\n

Unlike some other algorithms that also incorporates CNN models but require another algorithm to be run first to compute accurate registrations, VoxelMorph is “unsupervised,” which means it only needs the image data to compute accurate registration.<\/span><\/p>\n

The result<\/b><\/h2>\n

Tested on 250 additional scans, VoxelMorph accurately registered all of them within two minutes using a traditional central processing unit (CPU), and in under one second using a graphics processing unit (GPU). <\/span><\/p>\n

\u201cIn our initial tests and publications, we processed a large number of research images, to help gain insights into disease. In this scenario, the shortened VoxelMorph runtime can dramatically impact analysis,\u201d said Dalca and Balakrishnan.<\/span><\/p>\n

Then, the researchers further refined the VoxelMorph algorithm, so it guarantees the “smoothness” of each registration, meaning it doesn’t produce folds, holes, or general distortions in the composite image.<\/span><\/p>\n

The researchers used a mathematical model, called a Dice score, a standard metric to evaluate the accuracy of overlapped images, to validate the algorithm’s accuracy. <\/span><\/p>\n

They found that, across 17 brain regions, the refined VoxelMorph scored the same accuracy as a commonly used state-of-the-art registration algorithm, while providing runtime and methodological improvements. <\/span><\/p>\n

The next step<\/b><\/h2>\n

In addition to analyzing brain scans, VoxelMorph allows for a wide range of new research and application.<\/span><\/p>\n

At the very least, VoxelMorph allows for much more efficient care for patients. Doctors can now quickly align medical images of a particular patient taken before and after a surgery or treatment to assess the effect of the procedure.<\/span><\/p>\n

\u201cWhereas previous methods were prohibitively slow, the short VoxelMorph runtime promises to enable this comparison as soon as the scan is acquired,\u201d said Dalca and Balakrishnan. \u201cThis is a direction of future work for us.\u201d<\/span><\/p>\n

Moreover, VoxelMorph can pave the way for image registration during operations.<\/span><\/p>\n

Currently, when resecting a brain tumor, surgeons have to first scan a patient\u2019s brain before and wait until after the operation to see if they\u2019ve removed all the tumor. If the removal is incomplete, they have to go back to the operating room. \u00a0<\/span><\/p>\n

VoxelMorph, however, has the potential capacity to register scans in near real-time, so surgeons could have a much clearer picture on their progress.<\/span><\/p>\n

“Today, they can’t really overlap the images during surgery, because it will take two hours, and the surgery is ongoing,” Dalca said in a statement. “However, if it only takes a second, you can imagine that it could be feasible.”<\/span><\/p>\n

Currently, the researchers are running the algorithm on lung images. And they are hopeful to see further improvement.<\/span><\/p>\n

\u201cWe are working on automatically evaluating the result of image alignment to help clinicians understand where pathologies might be present, registering low-quality stroke clinical scans that come from the hospital, and aligning lung images for patients with pulmonary disease,\u201d said Dalca and Balakrishnan. <\/span><\/p>\n","protected":false},"excerpt":{"rendered":"

MIT researchers have built a machine-learning algorithm that can register MRI scans and other 3D images, and compare and analyze them in a matter of seconds. This reduces the traditional runtime of two hours or more down to just a second. Medical imaging, including MRI and CT scans, is not only a medical breakthrough, allowing […]<\/p>\n","protected":false},"author":60,"featured_media":24765,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"om_disable_all_campaigns":false,"_uag_custom_page_level_css":"","_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[626,232,241,376,230,229],"tags":[],"class_list":["post-24776","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-artificial-intelligence","category-technology","category-medical-breakthrough","category-massachusetts-institute-of-technology","category-news","category-lead-stories"],"aioseo_notices":[],"uagb_featured_image_src":{"full":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/06\/MIT-Brain.png",830,533,false],"thumbnail":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/06\/MIT-Brain-224x144.png",224,144,true],"medium":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/06\/MIT-Brain-300x193.png",300,193,true],"medium_large":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/06\/MIT-Brain.png",830,533,false],"large":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/06\/MIT-Brain.png",830,533,false],"1536x1536":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/06\/MIT-Brain.png",830,533,false],"2048x2048":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/06\/MIT-Brain.png",830,533,false]},"uagb_author_info":{"display_name":"Hyeyeun Jeon","author_link":"https:\/\/www.tun.com\/blog\/author\/hyeyeun-jeon\/"},"uagb_comment_info":0,"uagb_excerpt":"MIT researchers have built a machine-learning algorithm that can register MRI scans and other 3D images, and compare and analyze them in a matter of seconds. This reduces the traditional runtime of two hours or more down to just a second. Medical imaging, including MRI and CT scans, is not only a medical breakthrough, allowing…","featured_media_src_url":"https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/06\/MIT-Brain.png","_links":{"self":[{"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/posts\/24776","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/users\/60"}],"replies":[{"embeddable":true,"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/comments?post=24776"}],"version-history":[{"count":0,"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/posts\/24776\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/media\/24765"}],"wp:attachment":[{"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/media?parent=24776"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/categories?post=24776"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/tags?post=24776"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}