{"id":7569,"date":"2024-10-16T16:21:28","date_gmt":"2024-10-16T16:21:28","guid":{"rendered":"https:\/\/www.tun.com\/home\/?p=7569"},"modified":"2024-10-16T21:41:03","modified_gmt":"2024-10-16T21:41:03","slug":"revolutionary-app-mobileposer-achieves-real-time-full-body-motion-capture","status":"publish","type":"post","link":"https:\/\/www.tun.com\/home\/revolutionary-app-mobileposer-achieves-real-time-full-body-motion-capture\/","title":{"rendered":"Revolutionary App MobilePoser Achieves Real-Time Full-Body Motion Capture"},"content":{"rendered":"\n<div class=\"wp-block-group\"><div class=\"wp-block-group__inner-container is-layout-constrained wp-block-group-is-layout-constrained\">\n<div class=\"wp-block-uagb-blockquote uagb-block-e7eb3fc3 uagb-blockquote__skin-border uagb-blockquote__stack-img-none\"><blockquote class=\"uagb-blockquote\"><div class=\"uagb-blockquote__content\">Northwestern University engineers unveil MobilePoser, a state-of-the-art mobile app capable of real-time full-body motion capture using consumer devices. Discover its potential to revolutionize gaming, fitness, health care and beyond.<\/div><footer><div class=\"uagb-blockquote__author-wrap uagb-blockquote__author-at-left\"><\/div><\/footer><\/blockquote><\/div>\n\n\n\n<div class=\"wp-block-group is-content-justification-space-between is-nowrap is-layout-flex wp-container-core-group-is-layout-0dfbf163 wp-block-group-is-layout-flex\"><div style=\"font-size:16px;\" class=\"has-text-align-left wp-block-post-author\"><div class=\"wp-block-post-author__content\"><p class=\"wp-block-post-author__name\">The University Network<\/p><\/div><\/div>\n\n\n<div class=\"wp-block-uagb-social-share uagb-social-share__outer-wrap uagb-social-share__layout-horizontal uagb-block-ee584a31\">\n<div class=\"wp-block-uagb-social-share-child uagb-ss-repeater uagb-ss__wrapper uagb-block-ec619ce7\"><span class=\"uagb-ss__link\" data-href=\"https:\/\/www.facebook.com\/sharer.php?u=\" tabindex=\"0\" role=\"button\" aria-label=\"facebook\"><span class=\"uagb-ss__source-wrap\"><span class=\"uagb-ss__source-icon\"><svg xmlns=\"https:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 512 512\"><path d=\"M504 256C504 119 393 8 256 8S8 119 8 256c0 123.8 90.69 226.4 209.3 245V327.7h-63V256h63v-54.64c0-62.15 37-96.48 93.67-96.48 27.14 0 55.52 4.84 55.52 4.84v61h-31.28c-30.8 0-40.41 19.12-40.41 38.73V256h68.78l-11 71.69h-57.78V501C413.3 482.4 504 379.8 504 256z\"><\/path><\/svg><\/span><\/span><\/span><\/div>\n\n\n\n<div class=\"wp-block-uagb-social-share-child uagb-ss-repeater uagb-ss__wrapper uagb-block-32d99934\"><span class=\"uagb-ss__link\" data-href=\"https:\/\/twitter.com\/share?url=\" tabindex=\"0\" role=\"button\" aria-label=\"twitter\"><span class=\"uagb-ss__source-wrap\"><span class=\"uagb-ss__source-icon\"><svg xmlns=\"https:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 512 512\"><path d=\"M389.2 48h70.6L305.6 224.2 487 464H345L233.7 318.6 106.5 464H35.8L200.7 275.5 26.8 48H172.4L272.9 180.9 389.2 48zM364.4 421.8h39.1L151.1 88h-42L364.4 421.8z\"><\/path><\/svg><\/span><\/span><\/span><\/div>\n\n\n\n<div class=\"wp-block-uagb-social-share-child uagb-ss-repeater uagb-ss__wrapper uagb-block-1d136f14\"><span class=\"uagb-ss__link\" data-href=\"https:\/\/www.linkedin.com\/shareArticle?url=\" tabindex=\"0\" role=\"button\" aria-label=\"linkedin\"><span class=\"uagb-ss__source-wrap\"><span class=\"uagb-ss__source-icon\"><svg xmlns=\"https:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 448 512\"><path d=\"M416 32H31.9C14.3 32 0 46.5 0 64.3v383.4C0 465.5 14.3 480 31.9 480H416c17.6 0 32-14.5 32-32.3V64.3c0-17.8-14.4-32.3-32-32.3zM135.4 416H69V202.2h66.5V416zm-33.2-243c-21.3 0-38.5-17.3-38.5-38.5S80.9 96 102.2 96c21.2 0 38.5 17.3 38.5 38.5 0 21.3-17.2 38.5-38.5 38.5zm282.1 243h-66.4V312c0-24.8-.5-56.7-34.5-56.7-34.6 0-39.9 27-39.9 54.9V416h-66.4V202.2h63.7v29.2h.9c8.9-16.8 30.6-34.5 62.9-34.5 67.2 0 79.7 44.3 79.7 101.9V416z\"><\/path><\/svg><\/span><\/span><\/span><\/div>\n<\/div>\n<\/div>\n<\/div><\/div>\n\n\n\n<p><\/p>\n\n\n\n<p>Engineers at Northwestern University have developed a groundbreaking system, MobilePoser, which can perform real-time, full-body motion capture using only a smartphone. This innovative technology leverages sensors already present in everyday consumer electronics, such as smartphones, smartwatches and wireless earbuds.<\/p>\n\n\n\n<p>&#8220;Running in real time on mobile devices, MobilePoser achieves state-of-the-art accuracy through advanced machine learning and physics-based optimization, unlocking new possibilities in gaming, fitness and indoor navigation without needing specialized equipment,&#8221; lead researcher Karan Ahuja, an assistant professor of computer science at Northwestern\u2019s McCormick School of Engineering, said in a <a href=\"https:\/\/www.mccormick.northwestern.edu\/news\/articles\/2024\/10\/new-app-performs-real-time-full-body-motion-capture-with-a-mobile-device\/\" title=\"\">news release<\/a>.<\/p>\n\n\n\n<p><\/p>\n\n\n\n<p>The system, showcased at the 2024 ACM Symposium on User Interface Software and Technology in Pittsburgh on October 15, represents a significant leap in accessibility for motion capture technology. <\/p>\n\n\n\n<p>Unlike traditional systems that require expensive equipment and specialized environments, MobilePoser democratizes access by using inertial measurement units (IMUs) already integrated into mobile devices.<\/p>\n\n\n\n<div style=\"height:19px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<figure class=\"wp-block-embed aligncenter is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"MobilePoser: Full-Body Pose Estimation and 3D Human Translation from IMUs in Mobile Consumer Devices\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/N5tkPR9EwHk?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<div style=\"height:11px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h2 class=\"wp-block-heading\">Limitations of Current Systems<\/h2>\n\n\n\n<p>Traditional motion capture systems involve actors donning sensor-covered suits and working in specialized environments, often costing upwards of $100,000. Even consumer-level solutions, like Microsoft Kinect, require stationary cameras and are not viable for mobile applications.<\/p>\n\n\n\n<p>\u201cThis is the gold standard of motion capture, but it costs upward of $100,000 to run that setup,\u201d Ahuja added. \u201cWe wanted to develop an accessible, democratized version that basically anyone can use with equipment they already have.\u201d<\/p>\n\n\n\n<p><\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Breakthrough Technology<\/h2>\n\n\n\n<p>To address these limitations, Ahuja&#8217;s team utilized IMUs, which contain accelerometers, gyroscopes and magnetometers. While standard IMUs in smartphones lack the fidelity for precise motion capture, the Northwestern team enhanced their functionality using a multi-stage AI algorithm trained on high-quality motion capture data.<\/p>\n\n\n\n<p>The algorithm estimates joint positions, rotations, walking speed, direction and foot-ground contact. A physics-based optimizer further refines these estimates, ensuring they align with real-world constraints, such as joint flexibility.<\/p>\n\n\n\n<p>&#8220;The accuracy is better when a person is wearing more than one device, such as a smartwatch on their wrist plus a smartphone in their pocket,&#8221; added Ahuja. &#8220;But a key part of the system is that it&#8217;s adaptive. Even if you don&#8217;t have your watch one day and only have your phone, it can adapt to figure out your full-body pose.&#8221;<\/p>\n\n\n\n<p><\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Potential Impacts<\/h2>\n\n\n\n<p>While MobilePoser is poised to revolutionize gaming with more immersive experiences, its applicability spans far beyond entertainment. Fitness enthusiasts can use the app to monitor their posture during exercise, ensuring correct form and improving workout effectiveness. Medical professionals can leverage the technology for detailed analysis of patients&#8217; mobility and gait, surpassing simple step-counting.<\/p>\n\n\n\n<p>\u201cRight now, physicians track patient mobility with a step counter. That\u2019s kind of sad, right? Our phones can calculate the temperature in Rome. They know more about the outside world than about our own bodies,\u201d Ahuja added. \u201cWe would like phones to become more than just intelligent step counters. A phone should be able to detect different activities, determine your poses and be a more proactive assistant.\u201d<\/p>\n\n\n\n<p><\/p>\n\n\n\n<p>To foster further advancements, Ahuja&#8217;s team has made their pre-trained models, data pre-processing scripts and model training code available as open-source software. The app will soon be accessible on iPhone, AirPods and Apple Watch.<\/p>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Engineers at Northwestern University have developed a groundbreaking system, MobilePoser, which can perform real-time, full-body motion capture using only a smartphone. This innovative technology leverages sensors already present in everyday consumer electronics, such as smartphones, smartwatches and wireless earbuds. &#8220;Running in real time on mobile devices, MobilePoser achieves state-of-the-art accuracy through advanced machine learning and [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"single-no-separators","format":"standard","meta":{"_acf_changed":false,"_uag_custom_page_level_css":"","_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[17],"tags":[],"class_list":["post-7569","post","type-post","status-publish","format-standard","hentry","category-tech"],"acf":[],"aioseo_notices":[],"uagb_featured_image_src":{"full":false,"thumbnail":false,"medium":false,"medium_large":false,"large":false,"1536x1536":false,"2048x2048":false},"uagb_author_info":{"display_name":"The University Network","author_link":"https:\/\/www.tun.com\/home\/author\/funky_junkie\/"},"uagb_comment_info":0,"uagb_excerpt":"Engineers at Northwestern University have developed a groundbreaking system, MobilePoser, which can perform real-time, full-body motion capture using only a smartphone. This innovative technology leverages sensors already present in everyday consumer electronics, such as smartphones, smartwatches and wireless earbuds. &#8220;Running in real time on mobile devices, MobilePoser achieves state-of-the-art accuracy through advanced machine learning and&hellip;","_links":{"self":[{"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/posts\/7569","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/comments?post=7569"}],"version-history":[{"count":9,"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/posts\/7569\/revisions"}],"predecessor-version":[{"id":7667,"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/posts\/7569\/revisions\/7667"}],"wp:attachment":[{"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/media?parent=7569"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/categories?post=7569"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.tun.com\/home\/wp-json\/wp\/v2\/tags?post=7569"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}