The Robot Report

  • Home
  • News
  • Technologies
    • Batteries / Power Supplies
    • Cameras / Imaging / Vision
    • Controllers
    • End Effectors
    • Microprocessors / SoCs
    • Motion Control
    • Sensors
    • Soft Robotics
    • Software / Simulation
  • Development
    • Artificial Intelligence
    • Human Robot Interaction / Haptics
    • Mobility / Navigation
    • Research
  • Robots
    • AGVs
    • AMRs
    • Consumer
    • Collaborative Robots
    • Drones
    • Exoskeletons
    • Industrial
    • Self-Driving Vehicles
    • Unmanned Maritime Systems
  • Markets
    • Agriculture
    • Healthcare
    • Logistics
    • Manufacturing
    • Mining
    • Security
  • Financial
    • Investments
    • Mergers & Acquisitions
    • Earnings
  • Resources
    • Careers
    • COVID-19
    • Digital Issues
    • Publications
      • Collaborative Robotics Trends
      • Robotics Business Review
    • RBR50 Winners 2022
    • Search Robotics Database
    • Videos
    • Webinars / Digital Events
  • Events
    • RoboBusiness
    • Robotics Summit & Expo
    • Healthcare Robotics Engineering Forum
    • DeviceTalks
    • R&D 100
    • Robotics Weeks
  • Podcast
    • Episodes
    • Leave a voicemail

How Amazon trained its robot Robin to sort packages

By Brianna Wessling | April 19, 2022

Listen to this article
Voiced by Amazon Polly
robin

Robin uses its suction gripper to pick packages from a conveyor belt. | Source: Amazon Robotics and AI

Thousands of packages pass through Amazon’s fulfillment centers every day. More and more of those packages are picked up, scanned, and organized by Amazon’s Robin robotic arm. 

Robin picks packages from a conveyor belt with its suction gripper, scans them and then places them on a drive robot that routes it to the correct loading dock. Robin’s job is particularly difficult because of its rapidly changing environment. Unlike other robotic arms, Robin doesn’t just perform a series of pre-set motions, it responds to its environment in real-time. 

“Robin deals with a world where things are changing all around it. It understands what objects are there — different sized boxes, soft packages, envelopes on top of other envelopes — and decides which one it wants and grabs it,” Charles Swan, a senior manager of software development at Amazon Robotics and AI, said. “It does all these things without a human scripting each move that it makes. What Robin does is not unusual in research. But it is unusual in production.”

Amazon’s team decided to take a unique approach when teaching Robin how to recognize packages coming down a conveyor belt. Instead of teaching computer vision algorithms to segment scenes into individual elements, the team allowed the model to try to find objects in an image on its own. After the model finds an object, the team provides feedback on how accurate it is. 

Beginning with pre-trained models that were able to identify simple object elements like edges and planes, the team slowly taught Robin how to identify a wide variety of packages it would handle. To continue to improve the system, the team also gathered thousands of images and drew lines around the different packages represented. 

“Everything comes in a jumble of sizes and shapes, some on top of the other, some in the shadows,” Bhavana Chandrashekhar, a software development manager at Amazon Robotics, said. “During the holidays, you might see pictures of Minions or Billie Eilish mixed in with our usual brown and white packages. The taping might change. Sometimes, the differences between one package and another are hard to see, even for humans. You might have a white envelope on another white envelope, and both are crinkled so you can’t tell where one begins and the other ends.”

These images are used to continually re-train Robin, but they’re not the only way the team pushes for the highest accuracy possible for its robot. Robin is able to give feedback on how confident it is about the decisions it makes. Images that the robot marks as low-confidence are automatically sent for annotation and then added to the teams training deck. 

Robin also knows when it’s made a mistake. If it drops a package, or accidentally puts two packages onto one sortation robot, Robin will try to correct the problem. If it can’t, then a human is called for intervention. 

Robin is currently deployed in small numbers, but the team’s push for accuracy means that it’s closer to being rolled out at scale. The robot still has some room to learn, however. Robin is retrained every few days with new fleet metrics, and the team hopes that it can roll out updates multiple times a week to the robot.

About The Author

Brianna Wessling

Brianna Wessling is an Associate Editor, Robotics, WTWH Media. She joined WTWH Media in November 2021, and is a recent graduate from the University of Kansas. She can be reached at [email protected]

Comments

  1. Abraham says

    April 21, 2022 at 12:15 pm

    There are more advanced vision robotic processes that are handle by Dutch pioneer Fizyrand partners.

    Reply

Tell Us What You Think! Cancel reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Related Articles Read More >

UR20 cobot Universal Robots
Anders Beck introduces the UR20; California bans autonomous tractors
John Deere autonomous tractor
Calif.’s ongoing ban of autonomous tractors a major setback
cruise robotaxis in San Francisco
Cruise hits milestone by charging for robotaxis rides in SF
synkar mobile robot on sidewalk
Synkar offers sidewalk delivery as a service

2021 Robotics Handbook

The Robot Report Listing Database

Latest Robotics News

Robot Report Podcast

Anders Beck introduces the UR20; California bans autonomous tractors
See More >

Sponsored Content

  • Magnetic encoders support the stabilization control of a self-balancing two-wheeled robotic vehicle
  • How to best choose your AGV’s Wheel Drive provider
  • Meet Trey, the autonomous trailer (un)loading forklift
  • Kinova Robotics launches Link 6, the first Canadian industrial collaborative robot
  • Torque sensors help make human/robot collaborations safer for workers

RBR50 Innovation Awards

Leave us a voicemail

The Robot Report
  • Mobile Robot Guide
  • Collaborative Robotics Trends
  • Field Robotics Forum
  • Healthcare Robotics Engineering Forum
  • RoboBusiness Event
  • Robotics Business Review
  • Robotics Summit & Expo
  • About The Robot Report
  • Subscribe
  • Advertising
  • Contact Us

Copyright © 2022 WTWH Media LLC. All Rights Reserved. The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written permission of WTWH Media
Privacy Policy | Advertising | About Us

Search The Robot Report

  • Home
  • News
  • Technologies
    • Batteries / Power Supplies
    • Cameras / Imaging / Vision
    • Controllers
    • End Effectors
    • Microprocessors / SoCs
    • Motion Control
    • Sensors
    • Soft Robotics
    • Software / Simulation
  • Development
    • Artificial Intelligence
    • Human Robot Interaction / Haptics
    • Mobility / Navigation
    • Research
  • Robots
    • AGVs
    • AMRs
    • Consumer
    • Collaborative Robots
    • Drones
    • Exoskeletons
    • Industrial
    • Self-Driving Vehicles
    • Unmanned Maritime Systems
  • Markets
    • Agriculture
    • Healthcare
    • Logistics
    • Manufacturing
    • Mining
    • Security
  • Financial
    • Investments
    • Mergers & Acquisitions
    • Earnings
  • Resources
    • Careers
    • COVID-19
    • Digital Issues
    • Publications
      • Collaborative Robotics Trends
      • Robotics Business Review
    • RBR50 Winners 2022
    • Search Robotics Database
    • Videos
    • Webinars / Digital Events
  • Events
    • RoboBusiness
    • Robotics Summit & Expo
    • Healthcare Robotics Engineering Forum
    • DeviceTalks
    • R&D 100
    • Robotics Weeks
  • Podcast
    • Episodes
    • Leave a voicemail