The Robot Report

  • News
  • Technologies
    • Batteries / Power Supplies
    • Cameras / Imaging / Vision
    • Controllers
    • End Effectors
    • Microprocessors / SoCs
    • Motion Control
    • Sensors
    • Soft Robotics
    • Software / Simulation
  • Development
    • Artificial Intelligence
    • Human Robot Interaction / Haptics
    • Mobility / Navigation
    • Research
  • Robots
    • AGVs
    • AMRs
    • Consumer
    • Collaborative Robots
    • Drones
    • Exoskeletons
    • Industrial
    • Self-Driving Vehicles
    • Unmanned Maritime Systems
  • Markets
    • Agriculture
    • Healthcare
    • Logistics
    • Manufacturing
    • Mining
    • Security
  • Investments
    • Funding
    • Mergers & Acquisitions
  • Resources
    • COVID-19
    • Digital Issues
    • Publications
      • Collaborative Robotics Trends
      • Robotics Business Review
    • RBR50
    • Search Robotics Database
    • Videos
    • Webinars / Digital Events
  • Events
    • RoboBusiness Direct
    • Robotics Summit & Expo
    • Healthcare Robotics Engineering Forum
    • DeviceTalks
    • R&D 100
  • Podcast

Deep learning, vision help exoskeleton adapt to its surroundings

By Steve Crowe | March 15, 2021

exoskeleton

Researchers fitted exoskeleton users with cameras and are optimizing computer software to process the video feed to recognize stairs, doors and other surroundings. | Photo Credit: University of Waterloo

Robotics researchers are developing exoskeletons and prosthetic legs capable of making control decisions on their own using sophisticated artificial intelligence (AI) technology.

The system combines computer vision and deep learning to mimic how able-bodied people walk by seeing their surroundings and adjusting their movements.

“We’re giving robotic exoskeletons vision so they can control themselves,” said Brokoslaw Laschowski, a PhD candidate in systems design engineering who leads a University of Waterloo research project called ExoNet.

Exoskeletons legs operated by motors already exist, but users must manually control them via smartphone applications or joysticks.

“That can be inconvenient and cognitively demanding,” said Laschowski, also a student member of the Waterloo Artificial Intelligence Institute (Waterloo.ai). “Every time you want to perform a new locomotor activity, you have to stop, take out your smartphone and select the desired mode.”

To address that limitation, the researchers fitted exoskeleton users with wearable cameras and are now optimizing AI computer software to process the video feed to accurately recognize stairs, doors and other features of the surrounding environment.

The next phase of the ExoNet research project will involve sending instructions to motors so that robotic exoskeletons can climb stairs, avoid obstacles or take other appropriate actions based on analysis of the user’s current movement and the upcoming terrain.

“Our control approach wouldn’t necessarily require human thought,” said Laschowski, who is supervised by engineering professor John McPhee, the Canada Research Chair in Biomechatronic System Dynamics. “Similar to autonomous cars that drive themselves, we’re designing autonomous exoskeletons and prosthetic legs that walk for themselves.”

The researchers are also working to improve the energy efficiency of motors for robotic exoskeletons and prostheses by using human motion to self-charge the batteries.

The research team also includes engineering professor Alexander Wong, the Canada Research Chair in Artificial Intelligence and Medical Imaging, and William McNally, also a PhD candidate in systems design engineering and a student member of Waterloo.ai.

Editor’s Note: This article was republished from the University of Waterloo.

About The Author

Steve Crowe

Steve Crowe is Editor of The Robot Report and co-chair of the Robotics Summit & Expo. He joined WTWH Media in January 2018 after spending four-plus years as Managing Editor of Robotics Trends Media. He can be reached at [email protected]

Tell Us What You Think! Cancel reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Related Articles Read More >

MIT RF Grasp
Radio frequency perception helps robot grasp hidden objects
Using tactile-based reinforcement learning for insertion tasks
Multiple drones move a single box
Small drones team up to carry heavy packages
Deep learning optimizes sensor placement for soft robots

End-of-Arm Tooling Issue

The Robot Report Listing Database

Latest Robotics News

Robot Report Podcast

The Evolution of RE2 Robotics

The Robot Report Podcast ยท The Evolution of RE2 Robotics

Sponsored Content

  • Why field-of-view matters
  • FORT Robotics Podcast: FORT Robotics on how to keep humans safe and in control of robots
  • IES servo control gripper
  • How to cut the cost of manufacturing
  • Analytics: Robotics’ untapped vein of business value

Tweets by RoboticTips

The Robot Report
  • Collaborative Robotics Trends
  • Field Robotics Forum
  • Healthcare Robotics Engineering Forum
  • RoboBusiness Event
  • Robotics Business Review
  • Robotics Summit & Expo
  • About The Robot Report
  • Subscribe
  • Advertising
  • Contact Us

Copyright © 2021 WTWH Media, LLC. All Rights Reserved. The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written permission of WTWH Media. Site Map | Privacy Policy | RSS

Search The Robot Report

  • News
  • Technologies
    • Batteries / Power Supplies
    • Cameras / Imaging / Vision
    • Controllers
    • End Effectors
    • Microprocessors / SoCs
    • Motion Control
    • Sensors
    • Soft Robotics
    • Software / Simulation
  • Development
    • Artificial Intelligence
    • Human Robot Interaction / Haptics
    • Mobility / Navigation
    • Research
  • Robots
    • AGVs
    • AMRs
    • Consumer
    • Collaborative Robots
    • Drones
    • Exoskeletons
    • Industrial
    • Self-Driving Vehicles
    • Unmanned Maritime Systems
  • Markets
    • Agriculture
    • Healthcare
    • Logistics
    • Manufacturing
    • Mining
    • Security
  • Investments
    • Funding
    • Mergers & Acquisitions
  • Resources
    • COVID-19
    • Digital Issues
    • Publications
      • Collaborative Robotics Trends
      • Robotics Business Review
    • RBR50
    • Search Robotics Database
    • Videos
    • Webinars / Digital Events
  • Events
    • RoboBusiness Direct
    • Robotics Summit & Expo
    • Healthcare Robotics Engineering Forum
    • DeviceTalks
    • R&D 100
  • Podcast