The Robot Report

  • Home
  • News
  • Technologies
    • Batteries / Power Supplies
    • Cameras / Imaging / Vision
    • Controllers
    • End Effectors
    • Microprocessors / SoCs
    • Motion Control
    • Sensors
    • Soft Robotics
    • Software / Simulation
  • Development
    • Artificial Intelligence
    • Human Robot Interaction / Haptics
    • Mobility / Navigation
    • Research
  • Robots
    • AGVs
    • AMRs
    • Consumer
    • Collaborative Robots
    • Drones
    • Humanoids
    • Industrial
    • Self-Driving Vehicles
    • Unmanned Maritime Systems
  • Business
    • Financial
      • Investments
      • Mergers & Acquisitions
      • Earnings
    • Markets
      • Agriculture
      • Healthcare
      • Logistics
      • Manufacturing
      • Mining
      • Security
    • RBR50
      • RBR50 Winners 2025
      • RBR50 Winners 2024
      • RBR50 Winners 2023
      • RBR50 Winners 2022
      • RBR50 Winners 2021
  • Resources
    • Automated Warehouse Research Reports
    • Digital Issues
    • eBooks
    • Publications
      • Automated Warehouse
      • Collaborative Robotics Trends
    • Search Robotics Database
    • Videos
    • Webinars / Digital Events
  • Events
    • RoboBusiness
    • Robotics Summit & Expo
    • DeviceTalks
    • R&D 100
    • Robotics Weeks
  • Podcast
    • Episodes
  • Advertise
  • Subscribe

Berkeley released BridgeData V2 dataset for robot learning at scale

By Brianna Wessling | September 14, 2023

dataset image of a robot closing a cabinet door.

The initial and final state of a trajectory with the natural language annotation “close cabinet”. | Source: UC Berkeley

A research team at UC Berkeley has released BridgeData V2, a large and diverse dataset of robotic manipulation behaviors. The dataset aims to facilitate research in scalable robot learning. 

This updated dataset is compatible with open-vocabulary and multi-task learning methods conditioned on goal images or natural language instructions. The skills learned from the dataset can be generalized to novel objects and environments and across institutions. 

The Berkeley team collected data from a wide range of tasks in many different environments with variations in objects, camera poses, and workspace positioning. All of these variations are to better support broad generalization. 

The dataset includes 60,096 trajectories, 50,365 teleoperated demonstrations, 9,731 rollouts, 24 environments, and 13 skills. Each trajectory is labeled with a natural language instruction corresponding to the task the robot is performing. 

The 24 environments included in the dataset are grouped into four different categories. Most of the data comes from seven distinct toy kitchens, which all include some combination of sinks, stoves, and microwaves. 

Most of the 13 skills included in BridgeData V2 come from foundational object manipulation tasks like pick-and-place, pushing, and sweeping. Some data comes from environment manipulation, which includes things like opening and closing doors and drawers. The rest of the data comes from more complex tasks, like stacking blocks, folding clothes, and sweeping granular media. Some parts of the data come from mixtures of these categories. 

The team evaluated several state-of-the-art offline learning methods using the dataset. First, they evaluated the dataset on tasks that are seen in the training data. While the tasks were seen in training, many methods still required the team to generalize to novel object positions, distractor objects, and lighting. The team then evaluated the dataset on tasks that require generalizing skills in the data to novel objects and environments. 

The data was collected on a WidowX 250 6DOF robot arm. The team collected the demonstrations by teleoperating the robot with a VR controller. The control frequency is 5 Hz and the average trajectory length is 38 timesteps. 

For sensing, the team used an RGBD camera that is fixed in an over-the-shoulder view, two RGB cameras with poses that are randomized during data collection, and an RGB camera attached to the robot’s wrist. All of the images are saved at a 640×480 resolution. 

The dataset can be downloaded here. The data for teleoperated demonstrations and from the scripted pick-and-place policy are provided as separate zip files. The team provides both model training code and pre-trained weights for getting started with the dataset.

This repository provides code and instructions for training on the dataset and evaluating policies. This guide provides instructions for setting up the robot hardware.

About The Author

Brianna Wessling

Brianna Wessling is an Associate Editor, Robotics, WTWH Media. She joined WTWH Media in November 2021, after graduating from the University of Kansas with degrees in Journalism and English. She covers a wide range of robotics topics, but specializes in women in robotics, autonomous vehicles, and space robotics.

She can be reached at bwessling@wtwhmedia.com

Comments

  1. Dennis says

    September 22, 2023 at 3:51 pm

    Amazing work. The link for data does not work, unfortunately.

    Reply

Tell Us What You Think! Cancel reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Related Articles Read More >

telesurgery demo Intuitive Surgical
Intuitive demos 4,000-mile telesurgery with da Vinci 5 surgical robot
Intel RealSense D421 Depth Module
After Intel exit, RealSense maps its own future in 3D vision
close up view of the TUM robot tree.
Unveiling the Tree of Robots: A new taxonomy for understanding robotic diversity
A Moxi robot standing at a pharmacy window.
Diligent Robotics completes 300,000 pharmacy deliveries with Moxi

RBR50 Innovation Awards

“rr
EXPAND YOUR KNOWLEDGE AND STAY CONNECTED
Get the latest info on technologies, tools and strategies for Robotics Professionals.
The Robot Report Listing Database

Latest Episode of The Robot Report Podcast

Automated Warehouse Research Reports

Sponsored Content

  • How to Set Up a Planetary Gear Motion with SOLIDWORKS
  • Sager Electronics and its partners, logos shown here, will exhibit at the 2025 Robotics Summit & Expo. Sager Electronics to exhibit at the Robotics Summit & Expo
  • The Shift in Robotics: How Visual Perception is Separating Winners from the Pack
  • An AutoStore automated storage and retrieval grid. Webinar to provide automated storage and retrieval adoption advice
  • Smaller, tougher devices for evolving demands
The Robot Report
  • Automated Warehouse
  • RoboBusiness Event
  • Robotics Summit & Expo
  • About The Robot Report
  • Subscribe
  • Contact Us

Copyright © 2025 WTWH Media LLC. All Rights Reserved. The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written permission of WTWH Media
Privacy Policy | Advertising | About Us

Search The Robot Report

  • Home
  • News
  • Technologies
    • Batteries / Power Supplies
    • Cameras / Imaging / Vision
    • Controllers
    • End Effectors
    • Microprocessors / SoCs
    • Motion Control
    • Sensors
    • Soft Robotics
    • Software / Simulation
  • Development
    • Artificial Intelligence
    • Human Robot Interaction / Haptics
    • Mobility / Navigation
    • Research
  • Robots
    • AGVs
    • AMRs
    • Consumer
    • Collaborative Robots
    • Drones
    • Humanoids
    • Industrial
    • Self-Driving Vehicles
    • Unmanned Maritime Systems
  • Business
    • Financial
      • Investments
      • Mergers & Acquisitions
      • Earnings
    • Markets
      • Agriculture
      • Healthcare
      • Logistics
      • Manufacturing
      • Mining
      • Security
    • RBR50
      • RBR50 Winners 2025
      • RBR50 Winners 2024
      • RBR50 Winners 2023
      • RBR50 Winners 2022
      • RBR50 Winners 2021
  • Resources
    • Automated Warehouse Research Reports
    • Digital Issues
    • eBooks
    • Publications
      • Automated Warehouse
      • Collaborative Robotics Trends
    • Search Robotics Database
    • Videos
    • Webinars / Digital Events
  • Events
    • RoboBusiness
    • Robotics Summit & Expo
    • DeviceTalks
    • R&D 100
    • Robotics Weeks
  • Podcast
    • Episodes
  • Advertise
  • Subscribe