The Robot Report

  • Research
  • Technologies
    • Batteries / Power Supplies
    • Cameras / Imaging / Vision
    • Controllers
    • Grippers / End Effectors
    • Microprocessors / SoCs
    • Motion Control
    • Sensors / Sensing Systems
    • Soft Robotics
    • Software / Simulation
  • Development
    • A.I. / Cognition
    • Human Robot Interaction / Haptics
    • Mobility / Navigation
  • Robots
    • AGVs
    • AMRs
    • Consumer
    • Collaborative Robots
    • Drones
    • Exoskeletons
    • Self-Driving Vehicles
    • Unmanned Maritime Systems
  • Markets
    • Agriculture
    • Defense / Security
    • Healthcare
    • Logistics
    • Manufacturing
    • Mining
  • Investments
  • Resources
    • COVID-19
    • Digital Issues
    • Publications
      • Collaborative Robotics Trends
      • Robotics Business Review
    • RBR50
    • Search Robotics Database
    • Videos
    • Webinars
  • Events
    • RoboBusiness Direct
    • Robotics Summit & Expo
    • Healthcare Robotics Engineering Forum
    • DeviceTalks
    • R&D 100
  • Podcast

Georgia Tech robots learn to ‘MacGyver’ simple tools

By The Robot Report Staff | August 11, 2019


Thanks to new technology that enables them to create simple tools, robots may be on the verge of their own version of the Stone Age.

Using a novel capability to reason about shape, function, and attachment of unrelated parts, researchers have for the first time successfully trained an intelligent agent to create basic tools by combining objects.

The breakthrough comes from Georgia Tech’s Robot Autonomy and Interactive Learning (RAIL) research lab and is a significant step toward enabling intelligent agents to devise more advanced tools that could prove useful in hazardous – and potentially life-threatening – environments.

The concept may sound familiar. It’s called “MacGyvering,” based off the name of a 1980s — and recently rebooted — television series. In the series, the title character is known for his unconventional problem-solving ability using differing resources available to him.

For years, computer scientists and others have been working to provide robots with similar capabilities. In their new robot-MacGyvering work, RAIL lab researchers led by Associate Professor Sonia Chernova used as a starting point a robotics technique previously developed by former Georgia Tech Professor Mike Stilman.

In this latest work, a robot trained using the team’s novel approach is given a set of optional parts and told to make a specific tool. Much like its human counterparts, the robot first examines the shapes of each part and how one might be attached to another.

Using machine learning, the robot is trained to match form to function – which object shapes facilitate a particular outcome – from numerous examples of everyday objects. For example, by learning that the concavity of bowls enables them to hold liquids, it makes use of this knowledge when constructing a spoon. Similarly, the robots were taught how to attach objects together from examples of materials that could be pierced or grasped.

In the study, researchers successfully created hammers, spatulas, scoops, squeegees, and screwdrivers.

robots

Overview of our framework highlighting the four key steps involved: segmentation, shape scoring, attachment scoring, and tool validation. Solid lines denote the path taken for the example shown, dashed lines represent alternate paths. Click the image to enlarge. | Credit: Georgia Tech

“The screwdriver was particularly interesting because the robot combined pliers and a coin,” said Lakshmi Nair, a Ph.D. student in the School of Interactive Computing and one of the researchers on the project. “It reasoned that the pliers were able to grasp something and said that the coin sort of matched the head of a screwdriver. Put them together, and it creates an effective tool.”

Currently, the robot is limited only to the shape and attachment. It cannot yet effectively reason about particular material properties, a crucial step in advancing to a real-world scenario.

“People reason that hammers are sturdy and strong, so you wouldn’t make a hammer out of foam blocks,” Nair said. “We want to reach that level of reasoning in our work, which is something we’re working on now.”

The inspiration for the work comes from the popular story of Apollo 13, the doomed seventh crewed flight of the Apollo space program. After an oxygen tank in the ship’s service module exploded two days into the mission, crew members were forced to make makeshift modifications to the carbon dioxide removal system.

Despite a dangerously tight window of time and extremely high tension among all aboard and at mission control, the rescue proved successful. Nair and collaborators hope this research will prove foundational to future robotics technology that could reason faster and without the burden of stress.

“They were able to make this filter, but the solution took a long time to come up with,” Nair said. “We want to make robots that can assist humans in these kinds of scenarios to take the pressure off of them to come up with innovative solutions and potentially save their lives.”

This work was presented at the 2019 Robotics: Science and Systems conference in a paper titled “Autonomous Tool Construction Using Part Shape and Attachment Prediction” (Lakshmi Nair, Nithin Shrivatsav, Zackory Erickson, Sonia Chernova). It is supported in part by grants from the National Science Foundation and the Office of Naval Research.

Editor’s Note: This article was republished from the Georgia Tech College of Computing.

Comments

  1. Georg Hrabanek says

    August 20, 2019 at 3:37 am

    Please inform me about the robot arm used in the video; thanks!

    Reply
    • Steve Crowe says

      August 20, 2019 at 7:35 am

      Georg, it’s a 7-DOF arm from Kinova. Here’s a link to Kinova’s robot arms:

      https://www.kinovarobotics.com/en/products/robotic-arm-series

      Reply
  2. Jason says

    August 22, 2019 at 3:37 pm

    Also using a Waypoint Robotics CuffLink to seamlessly mate the Robotiq Gripper to the Kinova arm.

    https://waypointrobotics.com/cufflink-rk-robotic-arm-gripper-adapter/

    Reply
    • Eugene Demaitre says

      August 23, 2019 at 3:34 pm

      Thanks for the information, Jason!

      Reply

Tell Us What You Think! Cancel reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Related Articles Read More >

Laser-steering microrobot aims to refine minimally invasive surgery
neuromorphic chip
Researchers develop powerful optical neuromorphic processor
Team Cerberus readies for Round 2 in DARPA Subterranean Challenge
DARPA announces finals of SubT Challenge
Shape-changing robots could create new swarms

Robotics Year in Review

The Robot Report Listing Database

Latest Robotics News

Robot Report Podcast

Teradyne’s acquisition strategy & the future of cobot

The Robot Report Podcast · Teradyne's acquisition strategy & the future of cobots

Sponsored Content

  • Doosan Robotics: Driving Innovation and Growth in Cobots
  • FORT Robotics Podcast: FORT Robotics on how to keep humans safe and in control of robots
  • Pallet Detection Systems Help Automated Forklifts Modernize Warehouse Operations
  • IES Servo Control Gripper
  • How to cut the cost of manufacturing

Tweets by RoboticTips

The Robot Report
  • Collaborative Robotics Trends
  • Field Robotics Forum
  • Healthcare Robotics Engineering Forum
  • RoboBusiness Event
  • Robotics Business Review
  • Robotics Summit & Expo
  • About The Robot Report
  • Subscribe
  • Advertising
  • Contact Us

Copyright © 2021 WTWH Media, LLC. All Rights Reserved. The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written permission of WTWH Media. Site Map | Privacy Policy | RSS

Search The Robot Report

  • Research
  • Technologies
    • Batteries / Power Supplies
    • Cameras / Imaging / Vision
    • Controllers
    • Grippers / End Effectors
    • Microprocessors / SoCs
    • Motion Control
    • Sensors / Sensing Systems
    • Soft Robotics
    • Software / Simulation
  • Development
    • A.I. / Cognition
    • Human Robot Interaction / Haptics
    • Mobility / Navigation
  • Robots
    • AGVs
    • AMRs
    • Consumer
    • Collaborative Robots
    • Drones
    • Exoskeletons
    • Self-Driving Vehicles
    • Unmanned Maritime Systems
  • Markets
    • Agriculture
    • Defense / Security
    • Healthcare
    • Logistics
    • Manufacturing
    • Mining
  • Investments
  • Resources
    • COVID-19
    • Digital Issues
    • Publications
      • Collaborative Robotics Trends
      • Robotics Business Review
    • RBR50
    • Search Robotics Database
    • Videos
    • Webinars
  • Events
    • RoboBusiness Direct
    • Robotics Summit & Expo
    • Healthcare Robotics Engineering Forum
    • DeviceTalks
    • R&D 100
  • Podcast