The Robot Report

  • Research
  • Technologies
    • Batteries / Power Supplies
    • Cameras / Imaging / Vision
    • Controllers
    • Grippers / End Effectors
    • Microprocessors / SoCs
    • Motion Control
    • Sensors / Sensing Systems
    • Soft Robotics
    • Software / Simulation
  • Development
    • A.I. / Cognition
    • Human Robot Interaction / Haptics
    • Mobility / Navigation
  • Robots
    • AGVs
    • AMRs
    • Consumer
    • Collaborative Robots
    • Drones
    • Exoskeletons
    • Self-Driving Vehicles
    • Unmanned Maritime Systems
  • Markets
    • Agriculture
    • Defense / Security
    • Healthcare
    • Logistics
    • Manufacturing
    • Mining
  • Investments
  • Resources
    • COVID-19
    • Digital Issues
    • Publications
      • Collaborative Robotics Trends
      • Robotics Business Review
    • RBR50
    • Search Robotics Database
    • Videos
    • Webinars
  • Events
    • RoboBusiness Direct
    • Robotics Summit & Expo
    • Healthcare Robotics Engineering Forum
    • DeviceTalks
    • R&D 100
  • Podcast

Fruit fly inspires AI chip to help drones avoid obstacles, save power

By The Robot Report Staff | March 7, 2020

Fruit fly inspires AI chip to help drones avoid obstacles, save power

An NTHU team has developed an AI chip that follows the streamlined function of a fruit fly optic nerve. Source: National Sing Hua University

A major limitation for aerial drones is the tradeoff between weight and battery capacity, which limits their range and usefulness for applications such as agriculture and infrastructure inspection. To address this challenge, a multidisciplinary team at National Tsing Hua University in Hsinchu, Taiwan, has developed an artificial intelligence processor that mimics the optical nerves of a fruit fly.

This AI chip enables unmanned aerial vehicles (UAVs) to automatically avoid obstacles while staying in an “ultra-power-saving mode,” said the researchers. The team was led by professors Tang Kea-tiong of the Department of Electrical Engineering and Lo Chung-chuan of the Department of Life Sciences at National Tsing Hua University (NTHU).

Most UAVs currently rely on the transmission and reflection of electromagnetic waves to detect and avoid obstacles, but this consumes a lot of power, they said. An alternative approach to avoiding obstacles is to use optical lenses to capture and analyze images, but the amount of information to be processed is too large to be done quickly, and this approach also consumes a lot of power.

Agile fruit fly provides inspiration

Intrigued by the fruit fly’s uncanny ability to avoid obstacles, Tang figured that it might be possible to replicate the optical nerve of this tiny insect and adapt it to AI applications.

The first task was to solve the problem of information overload. According to Tang, the image sensors currently used in cameras and mobile phones have millions of pixels, whereas the eye of a fruit fly has only about 800 pixels. When the fruit fly’s brain processes such visual signals as contour and contrast, it uses a detection mechanism that automatically filters out unimportant information. The fruit fly pay attention only to moving objects with which it could collide.

National Tsing Hua University fruit fly AI chip

Professors Tang Kea-tiong (right) and Lo Chung-chuan led the team that has created an AI chip that could help UAVs fly like insects. Source: National Tsing Hua University

By imitating the fruit fly’s detection mechanism, the research team has developed an AI chip that makes it possible to use hand gestures and an image sensor to operate a drone.

First, the drone is taught to focus on what’s most important, and then it’s taught how to judge distance and the likelihood of a collision. Lo conducted a detailed investigation on how the fruit fly detects optical flow, for which he made extensive use of the maps of the fruit fly’s neural pathways produced by the Brain Research Center at NTHU.

“Optical flow is the relative trajectory left in the field of vision by nearby moving objects, and which is used by the brain to determine its distance and to avoid obstacles,” Lo explained.

Tang said that the AI chip developed by his research team represents a major breakthrough in the area of in-memory computing. Computers and mobile phones first move data from the memory to the central processing unit. Once it’s processed, the data is moved back to the memory for storage. Such a process can consume up to 90% of the energy and time of the AI deep-learning process.

By contrast, the NTHU team said its AI chip mimics the fruit fly neuronal synapses, allowing it to perform computations in the memory, which greatly improves efficiency.

Tell Us What You Think! Cancel reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Related Articles Read More >

Drone Immervision
FAA Drone Advisory Committee selects new members
Teledyne acquiring FLIR for $8B in major merger
Long-awaited FAA rules clear commercial drones for takeoff
autonomous vehicles November 2020
Robotics investments recap: November 2020

Robotics Year in Review

The Robot Report Listing Database

Latest Robotics News

Robot Report Podcast

Teradyne’s acquisition strategy & the future of cobot

The Robot Report Podcast · Teradyne's acquisition strategy & the future of cobots

Sponsored Content

  • Doosan Robotics: Driving Innovation and Growth in Cobots
  • FORT Robotics Podcast: FORT Robotics on how to keep humans safe and in control of robots
  • Pallet Detection Systems Help Automated Forklifts Modernize Warehouse Operations
  • IES Servo Control Gripper
  • How to cut the cost of manufacturing

Tweets by RoboticTips

The Robot Report
  • Collaborative Robotics Trends
  • Field Robotics Forum
  • Healthcare Robotics Engineering Forum
  • RoboBusiness Event
  • Robotics Business Review
  • Robotics Summit & Expo
  • About The Robot Report
  • Subscribe
  • Advertising
  • Contact Us

Copyright © 2021 WTWH Media, LLC. All Rights Reserved. The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written permission of WTWH Media. Site Map | Privacy Policy | RSS

Search The Robot Report

  • Research
  • Technologies
    • Batteries / Power Supplies
    • Cameras / Imaging / Vision
    • Controllers
    • Grippers / End Effectors
    • Microprocessors / SoCs
    • Motion Control
    • Sensors / Sensing Systems
    • Soft Robotics
    • Software / Simulation
  • Development
    • A.I. / Cognition
    • Human Robot Interaction / Haptics
    • Mobility / Navigation
  • Robots
    • AGVs
    • AMRs
    • Consumer
    • Collaborative Robots
    • Drones
    • Exoskeletons
    • Self-Driving Vehicles
    • Unmanned Maritime Systems
  • Markets
    • Agriculture
    • Defense / Security
    • Healthcare
    • Logistics
    • Manufacturing
    • Mining
  • Investments
  • Resources
    • COVID-19
    • Digital Issues
    • Publications
      • Collaborative Robotics Trends
      • Robotics Business Review
    • RBR50
    • Search Robotics Database
    • Videos
    • Webinars
  • Events
    • RoboBusiness Direct
    • Robotics Summit & Expo
    • Healthcare Robotics Engineering Forum
    • DeviceTalks
    • R&D 100
  • Podcast