The Robot Report

  • Research
  • Technologies
    • Batteries / Power Supplies
    • Cameras / Imaging / Vision
    • Controllers
    • Grippers / End Effectors
    • Microprocessors / SoCs
    • Motion Control
    • Sensors / Sensing Systems
    • Soft Robotics
    • Software / Simulation
  • Development
    • A.I. / Cognition
    • Human Robot Interaction / Haptics
    • Mobility / Navigation
  • Robots
    • AGVs
    • AMRs
    • Consumer
    • Collaborative Robots
    • Drones
    • Exoskeletons
    • Self-Driving Vehicles
    • Unmanned Maritime Systems
  • Markets
    • Agriculture
    • Defense / Security
    • Healthcare
    • Logistics
    • Manufacturing
    • Mining
  • Investments
  • Resources
    • COVID-19
    • Digital Issues
    • Publications
      • Collaborative Robotics Trends
      • Robotics Business Review
    • RBR50
    • Search Robotics Database
    • Videos
    • Webinars
  • Events
    • RoboBusiness Direct
    • Robotics Summit & Expo
    • Healthcare Robotics Engineering Forum
    • DeviceTalks
    • R&D 100
  • Podcast

gym-gazebo2 toolkit uses ROS 2 and Gazebo for reinforcement learning

By The Robot Report Staff | March 19, 2019

Quick demonstration of a converged policy using ROS2Learn framework and the gym-gazebo2 toolkit. We execute a deterministic run and also use settings that replicate a real behavior of the robot.

 

The first gym-gazebo was a successful proof of concept, which is being used by multiple research laboratories and many users of the robotics community. Given its positive impact, specially regarding usability, researchers at Acutronic Robotics have now freshly launched gym-gazebo2.

“This is the logical evolution towards our initial goal: to bring RL methods into robotics at a professional and industrial level.” — Risto Kojcev, head of AI, Acutronic Robotics

The AI team he leads researches on how reinforcement learning (RL) can be used instead of traditional path planning techniques.

“We aim to train behaviors that can be applied in complex dynamic environments, which resemble the new demands of agile production and human robot collaboration scenarios.”

Achieving this would lead to faster and easier development of robotic applications and moving the RL techniques from a research setting to a production environment. gym-gazebo2 is a step forward in this long-term goal.

The paper, which is available here, presents an upgraded, real-world, application-oriented version of gym-gazebo, the ROS- and Gazebo-based RL toolkit, which complies with OpenAI’s Gym.

Start training and visualize the simulation without going through the step by step installation process. In this video we execute a simple test example and visualize it from our main OS. Gazebo must be already installed there, Ubuntu 18 in our case.

 

The text discusses the new ROS 2-based software architecture and summarizes the results obtained using Proximal Policy Optimization (PPO). Ultimately, the output of this work presents a benchmarking system for robotics that allows different techniques and algorithms to be compared using the same virtual conditions.

The team has focused on MARA, a modular robotic arm that is natively running ROS 2 in each of its modules. They have evaluated four different environments with different levels of complexity of MARA, reaching accuracies in the millimeter scale. The environments are MARA, MARA Orient, MARA Collision, and MARA Collision Orient.

“We have focused on MARA first for being this modular robot arm the most direct option of transferring policies learned in gym-gazebo2 to the real world, hopefully industrial applications.”

The converged results show the feasibility and usefulness of the gym-gazebo 2 toolkit, its potential and applicability in industrial use cases, using modular robots.

More resources:

  • The same AI team has also presented ROS2Learn, a novel reinforcement learning framework for ROS 2
  • gym-gazebo2 tutorials
  • Instructions for installation
  • More on the usage

Robotics Summit & Expo 2019 logoKeynotes | Speakers | Exhibitors | Register

Editor’s note: This post is republished from Acutronic Robotics.

Tell Us What You Think! Cancel reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Related Articles Read More >

ABB ROS Driver
ABB introduces a new ROS driver for its robots
Advanced automation using ROS, UV disinfection robots using 3D vision in RoboBusiness Direct
Advanced automation using ROS, UV disinfection robots using 3D vision to be discussed in RoboBusiness Direct
RTI Connext 6 middleware wrapper bridges gap for robotics developers using ROS 2
RTI Connext 6 middleware wrapper bridges gap for robotics developers using ROS 2
Special Issue: 2020 Robotics Handbook

Robotics Year in Review

The Robot Report Listing Database

Latest Robotics News

Robot Report Podcast

Teradyne’s acquisition strategy & the future of cobot

The Robot Report Podcast · Teradyne's acquisition strategy & the future of cobots

Sponsored Content

  • Doosan Robotics: Driving Innovation and Growth in Cobots
  • FORT Robotics Podcast: FORT Robotics on how to keep humans safe and in control of robots
  • Pallet Detection Systems Help Automated Forklifts Modernize Warehouse Operations
  • IES Servo Control Gripper
  • How to cut the cost of manufacturing

Tweets by RoboticTips

The Robot Report
  • Collaborative Robotics Trends
  • Field Robotics Forum
  • Healthcare Robotics Engineering Forum
  • RoboBusiness Event
  • Robotics Business Review
  • Robotics Summit & Expo
  • About The Robot Report
  • Subscribe
  • Advertising
  • Contact Us

Copyright © 2021 WTWH Media, LLC. All Rights Reserved. The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written permission of WTWH Media. Site Map | Privacy Policy | RSS

Search The Robot Report

  • Research
  • Technologies
    • Batteries / Power Supplies
    • Cameras / Imaging / Vision
    • Controllers
    • Grippers / End Effectors
    • Microprocessors / SoCs
    • Motion Control
    • Sensors / Sensing Systems
    • Soft Robotics
    • Software / Simulation
  • Development
    • A.I. / Cognition
    • Human Robot Interaction / Haptics
    • Mobility / Navigation
  • Robots
    • AGVs
    • AMRs
    • Consumer
    • Collaborative Robots
    • Drones
    • Exoskeletons
    • Self-Driving Vehicles
    • Unmanned Maritime Systems
  • Markets
    • Agriculture
    • Defense / Security
    • Healthcare
    • Logistics
    • Manufacturing
    • Mining
  • Investments
  • Resources
    • COVID-19
    • Digital Issues
    • Publications
      • Collaborative Robotics Trends
      • Robotics Business Review
    • RBR50
    • Search Robotics Database
    • Videos
    • Webinars
  • Events
    • RoboBusiness Direct
    • Robotics Summit & Expo
    • Healthcare Robotics Engineering Forum
    • DeviceTalks
    • R&D 100
  • Podcast