The Robot Report

  • Home
  • News
  • Technologies
    • Batteries / Power Supplies
    • Cameras / Imaging / Vision
    • Controllers
    • End Effectors
    • Microprocessors / SoCs
    • Motion Control
    • Sensors
    • Soft Robotics
    • Software / Simulation
  • Development
    • Artificial Intelligence
    • Human Robot Interaction / Haptics
    • Mobility / Navigation
    • Research
  • Robots
    • AGVs
    • AMRs
    • Consumer
    • Collaborative Robots
    • Drones
    • Humanoids
    • Industrial
    • Self-Driving Vehicles
    • Unmanned Maritime Systems
  • Business
    • Financial
      • Investments
      • Mergers & Acquisitions
      • Earnings
    • Markets
      • Agriculture
      • Healthcare
      • Logistics
      • Manufacturing
      • Mining
      • Security
    • RBR50
      • RBR50 Winners 2025
      • RBR50 Winners 2024
      • RBR50 Winners 2023
      • RBR50 Winners 2022
      • RBR50 Winners 2021
  • Resources
    • Automated Warehouse Research Reports
    • Digital Issues
    • eBooks
    • Publications
      • Automated Warehouse
      • Collaborative Robotics Trends
    • Search Robotics Database
    • Videos
    • Webinars / Digital Events
  • Events
    • RoboBusiness
    • Robotics Summit & Expo
    • DeviceTalks
    • R&D 100
    • Robotics Weeks
  • Podcast
    • Episodes
  • Advertise
  • Subscribe

MIT researchers help robots use their whole body to manipulate objects

By Brianna Wessling | August 29, 2023

a Kuka robot handling a bucket.

A robot attempting to use its whole hands to rotate a bucket 180º. | Source: MIT

An MIT research team has developed an AI technique that allows robots to manipulate objects with their entire hand or body, instead of just their fingertips. 

When a person picks up a box, they typically use their entire hands to lift it, and then their forearms and chest to keep the box steady while they move the box somewhere else. This kind of manipulation is whole-body manipulation, and it’s something that robots struggle with. 

For robots, each spot where the box could touch any point of their fingers, arms, and torso is a contact event that the robot has to reason about. This leaves robots with billions of potential contact events, making planning for tasks that require the whole body extremely complicated. This process of a robot trying to learn the best way to move an object is called contact-rich manipulation planning. 

However, MIT researchers have found a way to simplify this process using an AI technique called smoothing and an algorithm built by the team. Smoothing summarizes many contact events into a smaller number of decisions, eliminating events that aren’t important to the task and narrowing things down to a smaller number of decisions. This allows even a simple algorithm to quickly devise an effective manipulation plan. 

Many robots learn how to handle objects through reinforcement learning, a machine-learning technique where an agent uses trial and error to learn how to complete a task for a reward. Through this kind of learning, a system has to learn everything about the world through trial and error. 

With billions of contact points to try out, reinforcement learning can take a great deal of computation, making it a not ideal choice for contact-rich manipulation planning, although it can be effective with enough time.

Reinforcement learning does, however, perform the smoothing process by trying different contact points and computing a weighted average of the results, which is what helps to make it so effective in teaching robots. 

The MIT research team drew on this knowledge to build a simple model that performs this kind of research, enabling the system to focus on core robot-object interactions and predict long-term behavior. 

The team then combined their model with an algorithm that can rapidly search through all possible decisions a robot can make. Between the smoothing model and algorithm, the team created a system that only needed about a minute of computation time on a standard laptop. 

While this project is still in its early stages, this method could be used to allow factories to deploy smaller, mobile robots that use their entire bodies to manipulate objects rather than large robotic arms that only grasp with their fingertips. 

While the model showed promising results when tested in simulation, it cannot handle very dynamic motions, like objects falling. This is one of the issues that the team hopes to continue to address in future research. 

The teams’ research was funded, in part, by Amazon, MIT Lincoln Laboratory, the National Science Foundation, and the Ocado Group. The team included H.J Terry Suh, an electrical engineering and computer science (EECS) graduate student and co-lead author on the paper are co-lead author Tao Pang Ph.D. ’23, a roboticist at Boston Dynamics AI Institute; Lujie Yang, an EECS graduate student; and senior author Russ Tedrake, the Toyota Professor of EECS, Aeronautics and Astronautics, and Mechanical Engineering, and a member of the Computer Science and Artificial Intelligence Laboratory (CSAIL).

About The Author

Brianna Wessling

Brianna Wessling is an Associate Editor, Robotics, WTWH Media. She joined WTWH Media in November 2021, after graduating from the University of Kansas with degrees in Journalism and English. She covers a wide range of robotics topics, but specializes in women in robotics, autonomous vehicles, and space robotics.

She can be reached at bwessling@wtwhmedia.com

Tell Us What You Think! Cancel reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Related Articles Read More >

Six of multiple possible assistance scenarios with a prototype of a new robot being developed at MIT. Top row: getting into/out of a bathtub, bending down to reach objects, and catching a fall. Bottom row: powered sit-to-stand transition from a toilet, lifting a person from the floor, and walking assistance.
MIT engineers create elder assist robot E-BAR to prevent falls at home
The Northeastern team that won the MassRobotics Form & Function Challenge.
Northeastern soft robotic arm wins MassRobotics Form & Function Challenge at Robotics Summit
A FANUC robot working in car manufacturing.
U.S. automotive industry increased robot installations by 10% in 2024
A robot arm with a two-fingered gripper picking up a cup next to a sink.
Cornell University teaches robots new tasks from how-to videos in just 30 minutes

RBR50 Innovation Awards

“rr
EXPAND YOUR KNOWLEDGE AND STAY CONNECTED
Get the latest info on technologies, tools and strategies for Robotics Professionals.
The Robot Report Listing Database

Latest Episode of The Robot Report Podcast

Automated Warehouse Research Reports

Sponsored Content

  • Sager Electronics and its partners, logos shown here, will exhibit at the 2025 Robotics Summit & Expo. Sager Electronics to exhibit at the Robotics Summit & Expo
  • The Shift in Robotics: How Visual Perception is Separating Winners from the Pack
  • An AutoStore automated storage and retrieval grid. Webinar to provide automated storage and retrieval adoption advice
  • Smaller, tougher devices for evolving demands
  • Modular motors and gearboxes make product development simple
The Robot Report
  • Mobile Robot Guide
  • Collaborative Robotics Trends
  • Field Robotics Forum
  • Healthcare Robotics Engineering Forum
  • RoboBusiness Event
  • Robotics Summit & Expo
  • About The Robot Report
  • Subscribe
  • Contact Us

Copyright © 2025 WTWH Media LLC. All Rights Reserved. The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written permission of WTWH Media
Privacy Policy | Advertising | About Us

Search The Robot Report

  • Home
  • News
  • Technologies
    • Batteries / Power Supplies
    • Cameras / Imaging / Vision
    • Controllers
    • End Effectors
    • Microprocessors / SoCs
    • Motion Control
    • Sensors
    • Soft Robotics
    • Software / Simulation
  • Development
    • Artificial Intelligence
    • Human Robot Interaction / Haptics
    • Mobility / Navigation
    • Research
  • Robots
    • AGVs
    • AMRs
    • Consumer
    • Collaborative Robots
    • Drones
    • Humanoids
    • Industrial
    • Self-Driving Vehicles
    • Unmanned Maritime Systems
  • Business
    • Financial
      • Investments
      • Mergers & Acquisitions
      • Earnings
    • Markets
      • Agriculture
      • Healthcare
      • Logistics
      • Manufacturing
      • Mining
      • Security
    • RBR50
      • RBR50 Winners 2025
      • RBR50 Winners 2024
      • RBR50 Winners 2023
      • RBR50 Winners 2022
      • RBR50 Winners 2021
  • Resources
    • Automated Warehouse Research Reports
    • Digital Issues
    • eBooks
    • Publications
      • Automated Warehouse
      • Collaborative Robotics Trends
    • Search Robotics Database
    • Videos
    • Webinars / Digital Events
  • Events
    • RoboBusiness
    • Robotics Summit & Expo
    • DeviceTalks
    • R&D 100
    • Robotics Weeks
  • Podcast
    • Episodes
  • Advertise
  • Subscribe