The Robot Report

  • Home
  • News
  • Technologies
    • Batteries / Power Supplies
    • Cameras / Imaging / Vision
    • Controllers
    • End Effectors
    • Microprocessors / SoCs
    • Motion Control
    • Sensors
    • Soft Robotics
    • Software / Simulation
  • Development
    • Artificial Intelligence
    • Human Robot Interaction / Haptics
    • Mobility / Navigation
    • Research
  • Robots
    • AGVs
    • AMRs
    • Consumer
    • Collaborative Robots
    • Drones
    • Humanoids
    • Industrial
    • Self-Driving Vehicles
    • Unmanned Maritime Systems
  • Business
    • Financial
      • Investments
      • Mergers & Acquisitions
      • Earnings
    • Markets
      • Agriculture
      • Healthcare
      • Logistics
      • Manufacturing
      • Mining
      • Security
    • RBR50
      • RBR50 Winners 2025
      • RBR50 Winners 2024
      • RBR50 Winners 2023
      • RBR50 Winners 2022
      • RBR50 Winners 2021
  • Resources
    • Automated Warehouse Research Reports
    • Digital Issues
    • eBooks
    • Publications
      • Automated Warehouse
      • Collaborative Robotics Trends
    • Search Robotics Database
    • Videos
    • Webinars / Digital Events
  • Events
    • RoboBusiness
    • Robotics Summit & Expo
    • DeviceTalks
    • R&D 100
    • Robotics Weeks
  • Podcast
    • Episodes
  • Advertise
  • Subscribe

How Amazon trained its robot Robin to sort packages

By Brianna Wessling | April 19, 2022

robin

Robin uses its suction gripper to pick packages from a conveyor belt. | Source: Amazon Robotics and AI

Thousands of packages pass through Amazon’s fulfillment centers every day. More and more of those packages are picked up, scanned, and organized by Amazon’s Robin robotic arm. 

Robin picks packages from a conveyor belt with its suction gripper, scans them and then places them on a drive robot that routes it to the correct loading dock. Robin’s job is particularly difficult because of its rapidly changing environment. Unlike other robotic arms, Robin doesn’t just perform a series of pre-set motions, it responds to its environment in real-time. 

“Robin deals with a world where things are changing all around it. It understands what objects are there — different sized boxes, soft packages, envelopes on top of other envelopes — and decides which one it wants and grabs it,” Charles Swan, a senior manager of software development at Amazon Robotics and AI, said. “It does all these things without a human scripting each move that it makes. What Robin does is not unusual in research. But it is unusual in production.”

Amazon’s team decided to take a unique approach when teaching Robin how to recognize packages coming down a conveyor belt. Instead of teaching computer vision algorithms to segment scenes into individual elements, the team allowed the model to try to find objects in an image on its own. After the model finds an object, the team provides feedback on how accurate it is. 

Beginning with pre-trained models that were able to identify simple object elements like edges and planes, the team slowly taught Robin how to identify a wide variety of packages it would handle. To continue to improve the system, the team also gathered thousands of images and drew lines around the different packages represented. 

“Everything comes in a jumble of sizes and shapes, some on top of the other, some in the shadows,” Bhavana Chandrashekhar, a software development manager at Amazon Robotics, said. “During the holidays, you might see pictures of Minions or Billie Eilish mixed in with our usual brown and white packages. The taping might change. Sometimes, the differences between one package and another are hard to see, even for humans. You might have a white envelope on another white envelope, and both are crinkled so you can’t tell where one begins and the other ends.”

These images are used to continually re-train Robin, but they’re not the only way the team pushes for the highest accuracy possible for its robot. Robin is able to give feedback on how confident it is about the decisions it makes. Images that the robot marks as low-confidence are automatically sent for annotation and then added to the teams training deck. 

Robin also knows when it’s made a mistake. If it drops a package, or accidentally puts two packages onto one sortation robot, Robin will try to correct the problem. If it can’t, then a human is called for intervention. 

Robin is currently deployed in small numbers, but the team’s push for accuracy means that it’s closer to being rolled out at scale. The robot still has some room to learn, however. Robin is retrained every few days with new fleet metrics, and the team hopes that it can roll out updates multiple times a week to the robot.

About The Author

Brianna Wessling

Brianna Wessling is an Associate Editor, Robotics, WTWH Media. She joined WTWH Media in November 2021, after graduating from the University of Kansas with degrees in Journalism and English. She covers a wide range of robotics topics, but specializes in women in robotics, autonomous vehicles, and space robotics.

She can be reached at bwessling@wtwhmedia.com

Comments

  1. Abraham says

    April 21, 2022 at 12:15 pm

    There are more advanced vision robotic processes that are handle by Dutch pioneer Fizyrand partners.

    Reply

Tell Us What You Think! Cancel reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Related Articles Read More >

Illustration of Reservoir Farms.
Reservoir Farms opens applications for inaugural cohort
All3 is using robot arms and mobile platforms in construction.
All3 launches AI and robotics to tackle housing construction
Simbe's Tally robot in a grocery store.
Simbe, Coresight Research study finds retailers urgently need to reduce inefficiencies
headshot of Dr Robert Ambrose and the robot report logo.
Celebrating 200 podcast episodes; robotics evolve in space exploration

RBR50 Innovation Awards

“rr
EXPAND YOUR KNOWLEDGE AND STAY CONNECTED
Get the latest info on technologies, tools and strategies for Robotics Professionals.
The Robot Report Listing Database

Latest Episode of The Robot Report Podcast

Automated Warehouse Research Reports

Sponsored Content

  • Sager Electronics and its partners, logos shown here, will exhibit at the 2025 Robotics Summit & Expo. Sager Electronics to exhibit at the Robotics Summit & Expo
  • The Shift in Robotics: How Visual Perception is Separating Winners from the Pack
  • An AutoStore automated storage and retrieval grid. Webinar to provide automated storage and retrieval adoption advice
  • Smaller, tougher devices for evolving demands
  • Modular motors and gearboxes make product development simple
The Robot Report
  • Automated Warehouse
  • RoboBusiness Event
  • Robotics Summit & Expo
  • About The Robot Report
  • Subscribe
  • Contact Us

Copyright © 2025 WTWH Media LLC. All Rights Reserved. The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written permission of WTWH Media
Privacy Policy | Advertising | About Us

Search The Robot Report

  • Home
  • News
  • Technologies
    • Batteries / Power Supplies
    • Cameras / Imaging / Vision
    • Controllers
    • End Effectors
    • Microprocessors / SoCs
    • Motion Control
    • Sensors
    • Soft Robotics
    • Software / Simulation
  • Development
    • Artificial Intelligence
    • Human Robot Interaction / Haptics
    • Mobility / Navigation
    • Research
  • Robots
    • AGVs
    • AMRs
    • Consumer
    • Collaborative Robots
    • Drones
    • Humanoids
    • Industrial
    • Self-Driving Vehicles
    • Unmanned Maritime Systems
  • Business
    • Financial
      • Investments
      • Mergers & Acquisitions
      • Earnings
    • Markets
      • Agriculture
      • Healthcare
      • Logistics
      • Manufacturing
      • Mining
      • Security
    • RBR50
      • RBR50 Winners 2025
      • RBR50 Winners 2024
      • RBR50 Winners 2023
      • RBR50 Winners 2022
      • RBR50 Winners 2021
  • Resources
    • Automated Warehouse Research Reports
    • Digital Issues
    • eBooks
    • Publications
      • Automated Warehouse
      • Collaborative Robotics Trends
    • Search Robotics Database
    • Videos
    • Webinars / Digital Events
  • Events
    • RoboBusiness
    • Robotics Summit & Expo
    • DeviceTalks
    • R&D 100
    • Robotics Weeks
  • Podcast
    • Episodes
  • Advertise
  • Subscribe