The Robot Report

  • Home
  • News
  • Technologies
    • Batteries / Power Supplies
    • Cameras / Imaging / Vision
    • Controllers
    • End Effectors
    • Microprocessors / SoCs
    • Motion Control
    • Sensors
    • Soft Robotics
    • Software / Simulation
  • Development
    • Artificial Intelligence
    • Human Robot Interaction / Haptics
    • Mobility / Navigation
    • Research
  • Robots
    • AGVs
    • AMRs
    • Consumer
    • Collaborative Robots
    • Drones
    • Humanoids
    • Industrial
    • Self-Driving Vehicles
    • Unmanned Maritime Systems
  • Business
    • Financial
      • Investments
      • Mergers & Acquisitions
      • Earnings
    • Markets
      • Agriculture
      • Healthcare
      • Logistics
      • Manufacturing
      • Mining
      • Security
    • RBR50
      • RBR50 Winners 2025
      • RBR50 Winners 2024
      • RBR50 Winners 2023
      • RBR50 Winners 2022
      • RBR50 Winners 2021
  • Resources
    • Automated Warehouse Research Reports
    • Digital Issues
    • eBooks
    • Publications
      • Automated Warehouse
      • Collaborative Robotics Trends
    • Search Robotics Database
    • Videos
    • Webinars / Digital Events
  • Events
    • RoboBusiness
    • Robotics Summit & Expo
    • DeviceTalks
    • R&D 100
    • Robotics Weeks
  • Podcast
    • Episodes
  • Advertise
  • Subscribe

Amazon’s ARMBench dataset helps train pick-and-place robots

By Brianna Wessling | April 11, 2023

Amazon has released a dataset that contains images of more than 190,000 objects that it said can be used to train robots for pick-and-place tasks. Amazon claims this is the largest dataset of images captured in an industrial product-sorting setting.

The dataset, called ARMBench, can be used to train pick-and-place robots to better generalize new objects and contexts. The images were collected in an Amazon warehouse where a robotic arm retrieves a single item from a bin full of items and then transfers it to a tray on a conveyor belt. This task can be difficult because of the variety of objects in the bin and their various configurations and interactions.

Images in the dataset fall into three categories:

  • Pick images: top-down images of a bin filled with items before a robot starts picking
  • Transfer images: images captured from multiple viewpoints as the robot transfers an item to the tray
  • Place images: top-down images of the tray in which the selected item is placed

ARMBench contains images from three separate tasks, object segmentation, object identification and defect detection.

The object detection dataset, which helps robots identify the boundaries of different products in the same bin, contains more than 50,000 images. The images show anywhere from one to 50 manual object segmentations per image, with an average of about 10.5.

The object segmentation dataset helps robots determine which product image in a reference database corresponds to the highlighted product in an image. This dataset includes more than 235,000 labeled pick activities, with each pick activity including a pick image and three transfer images. This dataset also includes reference images and text descriptions of more than 190,000 products. Models can learn to match one of these reference products to an object highlighted in pick and transfer images.

From left to right: a pick image, a transfer image and place image from Amazon's ARMBench dataset.

From left to right: a pick image, a transfer image and place image from Amazon’s ARMBench dataset. | Source: Amazon

The defect detection dataset, which includes both images and videos, helps systems know when a robot has committed an error, like picking up multiple items rather than one or damaging an item during transfer. The dataset has more than 19,000 images captured during the transfer phase. It also includes more than 4,000 videos that document pick-and-place activities that resulted in damage to a product.

Videos are a key aspect of this dataset, as certain types of product damage are best diagnosed through video, as they can occur at any point in the transfer process. The defect detection dataset also contains images and videos for over 100,000 pick-and-place activities without defects.

Amazon plans to continue to expand the number of images and videos, and the range of products they depict, in ARMBench.

In November 2022, Amazon unveiled Sparrow, a robotic arm capable of picking individual products before they get packaged. Sparrow can pick 65% of the over 100 million different items that could be processed at an Amazon warehouse, according to the company.

Sparrow can pick a variety of items, like DVDs, socks and stuffed animals, but struggled with items that have loose or complex packaging. It seems likely the company drew on the research it did while developing Sparrow to build this dataset.

About The Author

Brianna Wessling

Brianna Wessling is an Associate Editor, Robotics, WTWH Media. She joined WTWH Media in November 2021, after graduating from the University of Kansas with degrees in Journalism and English. She covers a wide range of robotics topics, but specializes in women in robotics, autonomous vehicles, and space robotics.

She can be reached at bwessling@wtwhmedia.com

Tell Us What You Think! Cancel reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Related Articles Read More >

Orbbec's Gemini 335Lg Depth Camera.
Orbbec, Connect Tech to provide support for Gemini stereo depth camera
Foxconn’s collaborative nursing robot is one example of its smart hospital applications developed using NVIDIA technologies.
NVIDIA releases cloud-to-robot computing platforms for physical AI, humanoid development
A man walking down a crosswalk wearing the Ekso personal exoskeleton with a woman walking beside him. The man is also using crutches to stay steady.
NVIDIA accepts Ekso Bionics into its Connect program
RealMan Robotics offers a variety of mobile manipulators.
RealMan displays embodied robotics at Automate 2025

RBR50 Innovation Awards

“rr
EXPAND YOUR KNOWLEDGE AND STAY CONNECTED
Get the latest info on technologies, tools and strategies for Robotics Professionals.
The Robot Report Listing Database

Latest Episode of The Robot Report Podcast

Automated Warehouse Research Reports

Sponsored Content

  • Sager Electronics and its partners, logos shown here, will exhibit at the 2025 Robotics Summit & Expo. Sager Electronics to exhibit at the Robotics Summit & Expo
  • The Shift in Robotics: How Visual Perception is Separating Winners from the Pack
  • An AutoStore automated storage and retrieval grid. Webinar to provide automated storage and retrieval adoption advice
  • Smaller, tougher devices for evolving demands
  • Modular motors and gearboxes make product development simple
The Robot Report
  • Mobile Robot Guide
  • Collaborative Robotics Trends
  • Field Robotics Forum
  • Healthcare Robotics Engineering Forum
  • RoboBusiness Event
  • Robotics Summit & Expo
  • About The Robot Report
  • Subscribe
  • Contact Us

Copyright © 2025 WTWH Media LLC. All Rights Reserved. The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written permission of WTWH Media
Privacy Policy | Advertising | About Us

Search The Robot Report

  • Home
  • News
  • Technologies
    • Batteries / Power Supplies
    • Cameras / Imaging / Vision
    • Controllers
    • End Effectors
    • Microprocessors / SoCs
    • Motion Control
    • Sensors
    • Soft Robotics
    • Software / Simulation
  • Development
    • Artificial Intelligence
    • Human Robot Interaction / Haptics
    • Mobility / Navigation
    • Research
  • Robots
    • AGVs
    • AMRs
    • Consumer
    • Collaborative Robots
    • Drones
    • Humanoids
    • Industrial
    • Self-Driving Vehicles
    • Unmanned Maritime Systems
  • Business
    • Financial
      • Investments
      • Mergers & Acquisitions
      • Earnings
    • Markets
      • Agriculture
      • Healthcare
      • Logistics
      • Manufacturing
      • Mining
      • Security
    • RBR50
      • RBR50 Winners 2025
      • RBR50 Winners 2024
      • RBR50 Winners 2023
      • RBR50 Winners 2022
      • RBR50 Winners 2021
  • Resources
    • Automated Warehouse Research Reports
    • Digital Issues
    • eBooks
    • Publications
      • Automated Warehouse
      • Collaborative Robotics Trends
    • Search Robotics Database
    • Videos
    • Webinars / Digital Events
  • Events
    • RoboBusiness
    • Robotics Summit & Expo
    • DeviceTalks
    • R&D 100
    • Robotics Weeks
  • Podcast
    • Episodes
  • Advertise
  • Subscribe