The Robot Report

  • Home
  • News
  • Technologies
    • Batteries / Power Supplies
    • Cameras / Imaging / Vision
    • Controllers
    • End Effectors
    • Microprocessors / SoCs
    • Motion Control
    • Sensors
    • Soft Robotics
    • Software / Simulation
  • Development
    • Artificial Intelligence
    • Human Robot Interaction / Haptics
    • Mobility / Navigation
    • Research
  • Robots
    • AGVs
    • AMRs
    • Consumer
    • Collaborative Robots
    • Drones
    • Humanoids
    • Industrial
    • Self-Driving Vehicles
    • Unmanned Maritime Systems
  • Business
    • Financial
      • Investments
      • Mergers & Acquisitions
      • Earnings
    • Markets
      • Agriculture
      • Healthcare
      • Logistics
      • Manufacturing
      • Mining
      • Security
    • RBR50
      • RBR50 Winners 2025
      • RBR50 Winners 2024
      • RBR50 Winners 2023
      • RBR50 Winners 2022
      • RBR50 Winners 2021
  • Resources
    • Automated Warehouse Research Reports
    • Digital Issues
    • eBooks
    • Publications
      • Automated Warehouse
      • Collaborative Robotics Trends
    • Search Robotics Database
    • Videos
    • Webinars / Digital Events
  • Events
    • RoboBusiness
    • Robotics Summit & Expo
    • DeviceTalks
    • R&D 100
    • Robotics Weeks
  • Podcast
    • Episodes
  • Advertise
  • Subscribe

TuSimple’s deep learning approach to self-driving trucks

By Paul Heney | April 6, 2018

TUSimple Self-Driving Truck

At NVIDIA’s GPU Technology Conference, I spoke with Xiaodi Hou, co-founder and CTO of TuSimple, a startup that is employing artificial intelligence to drive R&D of an SAE Level 4 autonomous trucking solution. Founded in 2015, the company has created a low-cost, commercially viable self-driving system to address a variety of pain points in the logistics industry.

Why is this such an area of interest? The freight industry is the backbone of economies around the world and, according to TuSimple, in the United States alone, it represents more than 70% of all freight tonnage is transported by trucks. TUSimple’s platform is focused on line-haul trucking – this niche is the transportation of cargo between ports, plants, warehouses, and distribution centers.

“We’re focused on the middle mile,” said Hou. “There are a lot of logistic centers or hubs in different places – and there’s a lot of need for transporting container boxes from one hub to the other; this is what our truck is doing.”

By integrating technology into this crucial part of the supply chain, TUSimple aims to address current industry challenges such as road safety and driver shortages, while helping to reduce carbon emissions with optimized driving.

TuSimple’s technology is able to detect and track objects at distances of greater than 300 meters through advanced sensor fusion that combines data from multiple cameras. The localization technology achieves consistent, decimeter-level localization, even in a tunnel. Furthermore, the truck’s decision-making system dynamically adapts to road conditions, changing lanes and adjusting driving speeds to maximize safety and efficiency.

“We are very product oriented, so many of the things that we build are not just building a demo,” Hou said. “We build the whole stack of the product. Whenever there is something we feel missing, or not good enough for our solution, we just build it by ourselves. For example, we build the mask ourselves. And we build the camera modules by ourselves, and we build the servers by ourselves. And, of course, all of the software stacks are done by TuSimple. We’re very heavily invested in safety and product level safety, such as ASIL D and ISO 2662.”

TuSimple Turns to Deep Learning

Deep learning is really an enabler for TuSimple, although Hou explained that in the company’s code base, they have probably less than 10% of the code in deep learning.

“Even though deep learning is only five or 10 years old, it’s really changing the entire idea of how we use computer vision to see the world,” he said. “Based on the triumph of deep learning, the majority of our sensors are camera based. With the camera-based sensors, we can actually beat the performance of some of the LIDAR performance, using them as pure cameras.”

Photos: 9 Self-Driving Trucks Disrupting Logistics

“We’re using deep learning a lot, and it consumes a lot of computational resources. Also, we always want to have a conjugate algorithm, in addition to one. We don’t want the system to rely on one algorithm result, because that’s not stable. If you have a conjugate algorithm, adding on another conjugate algorithm, adding all together, you need a lot of computation. That’s why we have a lot of graphic cards used in this chassis. So that’s the idea of the necessity of using Nvidia.”

Hou said TUSimple is currently doing a lot of road testing in both China and the U.S. It’s working with Peterbilt and other tier-one OEMs, including ZF, Cummins, and Bendix.

He is “pretty optimistic” that, by the end of 2019, TUSimple will be able to get most, if not all, of the algorithm ready to be completely driverless.


Engineering the Future of Robotics

Register for the Robotics Summit and Showcase (May 23-24, Boston) by April 20 and save 20% with early bird registration. Learn from and network with the best minds in robotics and unlock the keys to developing next-gen commercial robotics systems.

Agenda | Keynotes | Speakers | Sponsors | Register

Robotics Summit


About The Author

Paul Heney

Paul is a dynamic editor, writer and public speaker with more than 20 years experience in b2b magazines, online content and editorial management. He is the Editorial Director for Design World at WTWH Media LLC, helping design engineers parse the flood of information available online today - so they can receive critical information for performing their jobs more efficiently. He leads an editorial team comprised of engineers, technical journalists and freelance writers.

Tell Us What You Think! Cancel reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Related Articles Read More >

A Boston Dynamics Stretch robot unloading a container for DHL.
DHL buying 1,000+ Stretch robots from Boston Dynamics
The Gemini 435Le sensor package from Orbbec.
Orbbec designs Gemini 435Le to help robots see farther, navigate smarter
The humanoid robot market is about to experience a boom, with projections indicating a substantial and sustained increase over the next decade, says Freudenberg.
Humanoid robots can benefit from high-performance seals, says Freudenberg
An image of ABB's Flexly P604 Visual Slam AMR.
ABB upgrades Flexley Mover AMR with visual SLAM capabilities

RBR50 Innovation Awards

“rr
EXPAND YOUR KNOWLEDGE AND STAY CONNECTED
Get the latest info on technologies, tools and strategies for Robotics Professionals.
The Robot Report Listing Database

Latest Episode of The Robot Report Podcast

Automated Warehouse Research Reports

Sponsored Content

  • Sager Electronics and its partners, logos shown here, will exhibit at the 2025 Robotics Summit & Expo. Sager Electronics to exhibit at the Robotics Summit & Expo
  • The Shift in Robotics: How Visual Perception is Separating Winners from the Pack
  • An AutoStore automated storage and retrieval grid. Webinar to provide automated storage and retrieval adoption advice
  • Smaller, tougher devices for evolving demands
  • Modular motors and gearboxes make product development simple
The Robot Report
  • Mobile Robot Guide
  • Collaborative Robotics Trends
  • Field Robotics Forum
  • Healthcare Robotics Engineering Forum
  • RoboBusiness Event
  • Robotics Summit & Expo
  • About The Robot Report
  • Subscribe
  • Contact Us

Copyright © 2025 WTWH Media LLC. All Rights Reserved. The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written permission of WTWH Media
Privacy Policy | Advertising | About Us

Search The Robot Report

  • Home
  • News
  • Technologies
    • Batteries / Power Supplies
    • Cameras / Imaging / Vision
    • Controllers
    • End Effectors
    • Microprocessors / SoCs
    • Motion Control
    • Sensors
    • Soft Robotics
    • Software / Simulation
  • Development
    • Artificial Intelligence
    • Human Robot Interaction / Haptics
    • Mobility / Navigation
    • Research
  • Robots
    • AGVs
    • AMRs
    • Consumer
    • Collaborative Robots
    • Drones
    • Humanoids
    • Industrial
    • Self-Driving Vehicles
    • Unmanned Maritime Systems
  • Business
    • Financial
      • Investments
      • Mergers & Acquisitions
      • Earnings
    • Markets
      • Agriculture
      • Healthcare
      • Logistics
      • Manufacturing
      • Mining
      • Security
    • RBR50
      • RBR50 Winners 2025
      • RBR50 Winners 2024
      • RBR50 Winners 2023
      • RBR50 Winners 2022
      • RBR50 Winners 2021
  • Resources
    • Automated Warehouse Research Reports
    • Digital Issues
    • eBooks
    • Publications
      • Automated Warehouse
      • Collaborative Robotics Trends
    • Search Robotics Database
    • Videos
    • Webinars / Digital Events
  • Events
    • RoboBusiness
    • Robotics Summit & Expo
    • DeviceTalks
    • R&D 100
    • Robotics Weeks
  • Podcast
    • Episodes
  • Advertise
  • Subscribe