The Robot Report

  • Home
  • News
  • Technologies
    • Batteries / Power Supplies
    • Cameras / Imaging / Vision
    • Controllers
    • End Effectors
    • Microprocessors / SoCs
    • Motion Control
    • Sensors
    • Soft Robotics
    • Software / Simulation
  • Development
    • Artificial Intelligence
    • Human Robot Interaction / Haptics
    • Mobility / Navigation
    • Research
  • Robots
    • AGVs
    • AMRs
    • Consumer
    • Collaborative Robots
    • Drones
    • Humanoids
    • Industrial
    • Self-Driving Vehicles
    • Unmanned Maritime Systems
  • Business
    • Financial
      • Investments
      • Mergers & Acquisitions
      • Earnings
    • Markets
      • Agriculture
      • Healthcare
      • Logistics
      • Manufacturing
      • Mining
      • Security
    • RBR50
      • RBR50 Winners 2025
      • RBR50 Winners 2024
      • RBR50 Winners 2023
      • RBR50 Winners 2022
      • RBR50 Winners 2021
  • Resources
    • Automated Warehouse Research Reports
    • Digital Issues
    • eBooks
    • Publications
      • Automated Warehouse
      • Collaborative Robotics Trends
    • Search Robotics Database
    • Videos
    • Webinars / Digital Events
  • Events
    • RoboBusiness
    • Robotics Summit & Expo
    • DeviceTalks
    • R&D 100
    • Robotics Weeks
  • Podcast
    • Episodes
  • Advertise
  • Subscribe

CARMERA maps could benefit both autonomous vehicles and cities

By Eugene Demaitre | April 2, 2020

Carmera uses cameras to build maps for autonomous vehicles, urban traffic

CARMERA and TRI-AD map from vehicle cameras in downtown Tokyo. Source: CARMERA

In addition to systems for sensing, decision making, and communicating, self-driving cars need reliable maps. CARMERA Inc. has been providing “living maps” and navigational data for autonomous vehicles.

The New York-based company has about 60 employees and has been conducting trials with partners in the Brooklyn Navy Yard. Ethan Sorrelgreen, head of product at CARMERA, recently spoke with The Robot Report about challenges around creating reliable maps at scale.

Going out to get map data

The first challenge is gathering enough data. CARMERA works with partner fleets to create high-definition maps that it says can “regenerate in real time.”

“We take a two-pronged approach to mapping,” Sorreelgreen said. “We use lidar, imaging, GPS, and IMUs [inertial measurement units] in the car to generate HD maps for localization and to improve safety.”

“We’re also leveraging human-driven delivery vehicles and telematics to track them, plus video monitoring,” he explained. “With the capture of HD video, we have the data to maintain maps and to understand what’s changing.”

Striking the right balance between processing petabytes of video or using too little to scale for reducing “noisy” signals is another data management challenge.

Last month, CARMERA and Toyota Research Institute-Advanced Development (TRI-AD) used consumer-grade cameras to map roads in Tokyo and Michigan.

“Our work together demonstrates the power of developing systems that are built to take advantage of the ubiquity — and understand the constraints — of automotive technology widely in use today,” stated Ro Gupta, CEO of CARMERA. “It shows that with the right approach, companies like TRI-AD can start building the data necessary for automated driving, without having to rely on expensive or proprietary third-party hardware.”

Toyota and CARMERA Detroit

Suburban road feature placement (left) and urban street-level object detection (right) developed from Toyota TransLog telematics cameras in suburban Michigan. Source: CARMERA

Fleet size and data management

Service-level agreements typically specify what percentage of road segments or which ones much be refreshed and how often, Sorrelgreen said.

“With the right-size fleets, CARMERA can meet data SLAs for our customers, providing operational intelligence,” he added. “For instance, in Seattle, we make an effort to cover all major highways and access roads on a weekly basis. It’s not all done with fleet vehicles; there is some filling in with our own technicians.”

“They keep the lenses clean and see if Wi-Fi hotspots are working,” said Sorrelgreen. “With a small fleet, we get 99% of highways in Tacoma, Everett, and Easton, [Wash.] There is an optimal size for that fleet, which is proprietary.”

“We haven’t needed more technicians in New York so far, but we have noticed that there is a difference in road types to fill in; vehicles can drive faster on highways,” he said. “Downtown San Francisco is worse than Manhattan in terms of getting Pac-Man-style coverage of streets.”

Is weather a challenge? “Not really,” responded Sorrelgreen. “Some of our testing for maintaining data was at M-City, and Michigan gets much worse weather than we do in Seattle. We’ve actively tested our systems in snow and rain.”

“Our software is flexible, and we put it on fleet vehicles in a ruggedized Android device,” he explained. “We’re working with companies such as Toyota on production hardware.”

CARMERA works with city governments

In addition to helping with management of autonomous fleets, CARMERA has been sharing the “data exhaust” of its HD maps for free with municipal agencies, Sorrelgreen said.

“We started working in New York city way before the Brooklyn Navy Yard deployment,” he added. “We’ve also covered Manhattan, and we’re trying to get to refreshing data on 99% of streets there every 30 days.”

The mapping data could help utility providers, traffic bureaus, and mass-transit providers. “With the data exhaust, we’re exploring the technology in a different way,” said Sorrelgreen. “In the past, it was hard to tell how active construction was impacting buses or pedestrians. We’re working with the Downtown Brooklyn Partnership on providing data on dense infrastructure.”

“We’ve recently worked with the Transit Tech Lab and the MTA [Metropolitan Transportation Authority] in New York City,” he said. “We hope to learn how public-transit agencies will value our data. It would be interesting if buses could be routed to go faster and if drivers could be given more enforcement instructions. More people would ride them.”

CARMERA calibrates sensors

As part of its effort to map various cities, CARMERA must choose which vehicles to equip with its sensors. For instance, CARMERA has mounted its sensors on delivery fleets and its own technicians’ cars, but it has not yet put them on mass-transit vehicles, Sorrelgreen said.

“There is specific integration with any vehicle we want to use,” he noted. “When looking at a partnership with with an automaker, we have to calibrate computer-vision models for the sensors they use.”

“The hardware on R&D autonomous vehicles is the same as on some production vehicles today,” said Sorrelgreen. “We could calibrate our systems to work with them, and we would protect privacy while gathering data.”

About The Author

Eugene Demaitre

Eugene Demaitre is editorial director of the robotics group at WTWH Media. He was senior editor of The Robot Report from 2019 to 2020 and editorial director of Robotics 24/7 from 2020 to 2023. Prior to working at WTWH Media, Demaitre was an editor at BNA (now part of Bloomberg), Computerworld, TechTarget, and Robotics Business Review.

Demaitre has participated in robotics webcasts, podcasts, and conferences worldwide. He has a master's from the George Washington University and lives in the Boston area.

Tell Us What You Think! Cancel reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Related Articles Read More >

Images showing the difference between the CARLA simulator on its own, and working with Helm.ai's GenSim-2.
Helm.ai launches AV software for up SAE L4 autonomous driving
A talk being given at the 2024 Robotics Summit's Engineering Theater.
9 sessions to see at the Robotics Summit Engineering Theater
AmbiPick, shown here, is an example of the picking systems to be discussed in this upcoming free webinar.
Robotic picking experts to explain AI advancements in webinar
the two armed dexterity dexr solution unpacks boxes from a trailer.
Dexterity picks up $95M in funding for container loading robots

RBR50 Innovation Awards

“rr
EXPAND YOUR KNOWLEDGE AND STAY CONNECTED
Get the latest info on technologies, tools and strategies for Robotics Professionals.
The Robot Report Listing Database

Latest Episode of The Robot Report Podcast

Automated Warehouse Research Reports

Sponsored Content

  • Sager Electronics and its partners, logos shown here, will exhibit at the 2025 Robotics Summit & Expo. Sager Electronics to exhibit at the Robotics Summit & Expo
  • The Shift in Robotics: How Visual Perception is Separating Winners from the Pack
  • An AutoStore automated storage and retrieval grid. Webinar to provide automated storage and retrieval adoption advice
  • Smaller, tougher devices for evolving demands
  • Modular motors and gearboxes make product development simple
The Robot Report
  • Mobile Robot Guide
  • Collaborative Robotics Trends
  • Field Robotics Forum
  • Healthcare Robotics Engineering Forum
  • RoboBusiness Event
  • Robotics Summit & Expo
  • About The Robot Report
  • Subscribe
  • Contact Us

Copyright © 2025 WTWH Media LLC. All Rights Reserved. The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written permission of WTWH Media
Privacy Policy | Advertising | About Us

Search The Robot Report

  • Home
  • News
  • Technologies
    • Batteries / Power Supplies
    • Cameras / Imaging / Vision
    • Controllers
    • End Effectors
    • Microprocessors / SoCs
    • Motion Control
    • Sensors
    • Soft Robotics
    • Software / Simulation
  • Development
    • Artificial Intelligence
    • Human Robot Interaction / Haptics
    • Mobility / Navigation
    • Research
  • Robots
    • AGVs
    • AMRs
    • Consumer
    • Collaborative Robots
    • Drones
    • Humanoids
    • Industrial
    • Self-Driving Vehicles
    • Unmanned Maritime Systems
  • Business
    • Financial
      • Investments
      • Mergers & Acquisitions
      • Earnings
    • Markets
      • Agriculture
      • Healthcare
      • Logistics
      • Manufacturing
      • Mining
      • Security
    • RBR50
      • RBR50 Winners 2025
      • RBR50 Winners 2024
      • RBR50 Winners 2023
      • RBR50 Winners 2022
      • RBR50 Winners 2021
  • Resources
    • Automated Warehouse Research Reports
    • Digital Issues
    • eBooks
    • Publications
      • Automated Warehouse
      • Collaborative Robotics Trends
    • Search Robotics Database
    • Videos
    • Webinars / Digital Events
  • Events
    • RoboBusiness
    • Robotics Summit & Expo
    • DeviceTalks
    • R&D 100
    • Robotics Weeks
  • Podcast
    • Episodes
  • Advertise
  • Subscribe