{"id":24877,"date":"2018-07-03T12:07:28","date_gmt":"2018-07-03T16:07:28","guid":{"rendered":"https:\/\/www.tun.com\/blog\/?p=24877"},"modified":"2022-03-16T10:45:20","modified_gmt":"2022-03-16T14:45:20","slug":"why-robots-might-pack-your-next-amazon-order","status":"publish","type":"post","link":"https:\/\/www.tun.com\/blog\/why-robots-might-pack-your-next-amazon-order\/","title":{"rendered":"Why Robots Might Pack Your Next Amazon Order"},"content":{"rendered":"<p><span style=\"font-weight: 400;\">A team of three roboticists from the Queensland University of Technology (QUT) has <\/span><a href=\"https:\/\/www.qut.edu.au\/news?id=132368\"><span style=\"font-weight: 400;\">developed a faster and more accurate way<\/span><\/a><span style=\"font-weight: 400;\"> for robots to grasp objects in real-time, opening doors for applications in both industrial and domestic settings. <\/span><\/p>\n<p><span style=\"font-weight: 400;\">Their<\/span> <a href=\"https:\/\/arxiv.org\/abs\/1804.05172\"><span style=\"font-weight: 400;\">paper<\/span><\/a> <span style=\"font-weight: 400;\">was presented at the Carnegie Mellon University\u2019s international robotics conference,<\/span> <a href=\"http:\/\/www.roboticsconference.org\/\"><span style=\"font-weight: 400;\">Robotics: Science and Systems<\/span><\/a><span style=\"font-weight: 400;\">, last week. <\/span><\/p>\n<h2><b>Taking baby steps<\/b><\/h2>\n<p><span style=\"font-weight: 400;\">No one can deny that robotics is the way of the future. According to the <\/span><a href=\"https:\/\/www.idc.com\/getdoc.jsp?containerId=IDC_P33201\"><span style=\"font-weight: 400;\">International Data Corporation<\/span><\/a><span style=\"font-weight: 400;\">, worldwide spending on robotics will reach $135 billion by 2019. <\/span><\/p>\n<p><span style=\"font-weight: 400;\">While robots have long been replacing human labor in assembly lines and computation and have even started to see, hear and think like humans in chess and debates, robots can\u2019t quite grasp one thing &#8212; picking up an object in an unstructured environment. <\/span><\/p>\n<p><span style=\"font-weight: 400;\">Even for humans, although unnoticed, thousands of sensors in human fingers and complex network of circuitry inside human brains allow a three-month-old to pick up his toy rattle. However, he obviously does not need hours of training or hundreds of researchers to teach him. <\/span><\/p>\n<p><span style=\"font-weight: 400;\">But for robots, grasping objects in unstructured environments is extremely difficult. Yet, to be useful around humans, robots need to know how to adapt to changing environments. <\/span><\/p>\n<p><span style=\"font-weight: 400;\">The QUT team has developed a new method for robots to grasp items that move randomly more quickly and accurately. <\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u201c<\/span><span style=\"font-weight: 400;\">We are interested in creating robots that do useful tasks in the real world. I have been interested for a while in getting robots to robustly interact with the world, pick objects up and place them correctly,\u201d said <\/span><a href=\"http:\/\/staff.qut.edu.au\/staff\/leitnerj\/\"><span style=\"font-weight: 400;\">J\u00fcrgen Leitner<\/span><\/a><span style=\"font-weight: 400;\">, a postdoctoral research fellow at <\/span><span style=\"font-weight: 400;\">QUT\u2019s <\/span><a href=\"https:\/\/www.qut.edu.au\/science-engineering\"><span style=\"font-weight: 400;\">Science and Engineering Faculty<\/span><\/a><span style=\"font-weight: 400;\">. \u201cIt turns out some things that are hard for us are simple for computers, such as chess, while some things that come easy for us are very tricky for robots, such as grasping.\u201d<\/span><\/p>\n<h2><b>The new approach<\/b><\/h2>\n<p><span style=\"font-weight: 400;\">Deep-learning techniques allow robots to learn from thousands of sizes and shapes to calculate the best way to grasp an unknown item in a static condition. <\/span><\/p>\n<p><span style=\"font-weight: 400;\">For example, a robot with convolutional neural network (CNN), the most widely used method for object recognition, samples and ranks objects individually and thinks of the best possible grip. However, this technique takes long computation time, even in static environments. <\/span><\/p>\n<p><span style=\"font-weight: 400;\">The researchers\u2019 method, however, is based on a generative grasping convolutional neural network (GG-CNN), which directly scans its environment and maps each pixel it captures using a depth image, and is fast enough to grasp moving objects. <\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u201cThe Generative Grasping Convolutional Neural Network approach works by predicting the quality and pose of a two-fingered grasp at every pixel. By mapping what is in front of it using a depth image in a single pass, the robot doesn\u2019t need to sample many different possible grasps before making a decision, avoiding long computing times,\u201d Douglas Morrison, a QUT doctoral researcher said in a <\/span><a href=\"https:\/\/www.qut.edu.au\/news?id=132368\"><span style=\"font-weight: 400;\">statement<\/span><\/a><span style=\"font-weight: 400;\">.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">While their previous robot, which won the Amazon Picking Challenge in 2017, simply looked into a bin of objects, calculated the best possible grip and blindly went in to pick them up, their updated version processes images of the objects within about 20 milliseconds. <\/span><\/p>\n<p><span style=\"font-weight: 400;\">According to Leitner, after picking up objects, their current robot places them at a fixed location and starts looking for the next item at the scene. <\/span><\/p>\n<h2><b>The unpredictable world<\/b><\/h2>\n<p><span style=\"font-weight: 400;\">The researchers tested their new approach in multiple ways. <\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u201cThere were various experimental setups, all with real world robot and objects,\u201d said Leitner. \u201cWe tested with a range of \u2018household objects,\u2019 3D printed objects, and we verified the approach with different noise levels in the robot controller.\u201d<\/span><\/p>\n<p><span style=\"font-weight: 400;\">First, they performed 10 trials on grasping unseen objects with adversarial geometry and household objects under both static and moving environment. <\/span><\/p>\n<p><span style=\"font-weight: 400;\">While the robot achieved grasp success rate of 84 percent for adversarial geometry and 92 percent for household objects under static environment, it achieved 83 percent and 88 percent respectively under moving environment. <\/span><\/p>\n<p><span style=\"font-weight: 400;\">Second, they mixed 10 test objects in a box and poured it in a cluttered pile below the robot for it to grasp them one by one. They then performed 10 trials on grasping under both static and moving environment. <\/span><\/p>\n<p><span style=\"font-weight: 400;\">While the robot achieved grasp success rate of 87 percent under static environment, it achieved 81 percent under moving environment. <\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u201cUsing this new method, we can process images of the objects that a robot views within about 20 milliseconds, which allows the robot to update its decision on where to grasp an object and then do so with much greater purpose. This is particularly important in cluttered spaces,\u201d Letiner said in a statement.<\/span><\/p>\n<p><iframe title=\"QUT Closes the Loop for Robotic Grasping\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/RLoPx8T6WjQ?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n<h2><b>The next step<\/b><\/h2>\n<p><span style=\"font-weight: 400;\">The researchers hope to further improve their method for robots to be used more safely and widely around humans in industrial and domestic settings. <\/span><\/p>\n<p><span style=\"font-weight: 400;\">\u201cThis line of research enables us to use robotic systems not just in structured settings where the whole factory is built based on robotic capabilities,\u201d Leitner said in a statement. \u201cThis has benefits for industry \u2013 from warehouses for online shopping and sorting, through to fruit picking. It could also be applied in the home, as more intelligent robots are developed to not just vacuum or mop a floor, but also to pick items up and put them away.\u201d<\/span><\/p>\n<p><span style=\"font-weight: 400;\">They are also working on overcoming some of the limitations of the current approach, such as robotic vision and manipulation skills in a variety of settings, according to Leitner. <\/span><\/p>\n<p><span style=\"font-weight: 400;\">They are currently planning on organizing a \u201cRobotic Tidy Up My Room Challenge.\u201d <\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>A team of three roboticists from the Queensland University of Technology (QUT) has developed a faster and more accurate way for robots to grasp objects in real-time, opening doors for applications in both industrial and domestic settings. Their paper was presented at the Carnegie Mellon University\u2019s international robotics conference, Robotics: Science and Systems, last week. [&hellip;]<\/p>\n","protected":false},"author":60,"featured_media":24883,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"om_disable_all_campaigns":false,"_uag_custom_page_level_css":"","_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[232,632,230,229],"tags":[],"class_list":["post-24877","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology","category-robotics","category-news","category-lead-stories"],"aioseo_notices":[],"uagb_featured_image_src":{"full":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/07\/QUT.png",830,533,false],"thumbnail":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/07\/QUT-224x144.png",224,144,true],"medium":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/07\/QUT-300x193.png",300,193,true],"medium_large":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/07\/QUT.png",830,533,false],"large":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/07\/QUT.png",830,533,false],"1536x1536":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/07\/QUT.png",830,533,false],"2048x2048":["https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/07\/QUT.png",830,533,false]},"uagb_author_info":{"display_name":"Hyeyeun Jeon","author_link":"https:\/\/www.tun.com\/blog\/author\/hyeyeun-jeon\/"},"uagb_comment_info":0,"uagb_excerpt":"A team of three roboticists from the Queensland University of Technology (QUT) has developed a faster and more accurate way for robots to grasp objects in real-time, opening doors for applications in both industrial and domestic settings. Their paper was presented at the Carnegie Mellon University\u2019s international robotics conference, Robotics: Science and Systems, last week.&hellip;","featured_media_src_url":"https:\/\/www.tun.com\/blog\/wp-content\/uploads\/2018\/07\/QUT.png","_links":{"self":[{"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/posts\/24877","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/users\/60"}],"replies":[{"embeddable":true,"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/comments?post=24877"}],"version-history":[{"count":0,"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/posts\/24877\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/media\/24883"}],"wp:attachment":[{"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/media?parent=24877"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/categories?post=24877"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.tun.com\/blog\/wp-json\/wp\/v2\/tags?post=24877"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}