The Robot Report

  • Home
  • News
  • Technologies
    • Batteries / Power Supplies
    • Cameras / Imaging / Vision
    • Controllers
    • End Effectors
    • Microprocessors / SoCs
    • Motion Control
    • Sensors
    • Soft Robotics
    • Software / Simulation
  • Development
    • Artificial Intelligence
    • Human Robot Interaction / Haptics
    • Mobility / Navigation
    • Research
  • Robots
    • AGVs
    • AMRs
    • Consumer
    • Collaborative Robots
    • Drones
    • Humanoids
    • Industrial
    • Self-Driving Vehicles
    • Unmanned Maritime Systems
  • Business
    • Financial
      • Investments
      • Mergers & Acquisitions
      • Earnings
    • Markets
      • Agriculture
      • Healthcare
      • Logistics
      • Manufacturing
      • Mining
      • Security
    • RBR50
      • RBR50 Winners 2025
      • RBR50 Winners 2024
      • RBR50 Winners 2023
      • RBR50 Winners 2022
      • RBR50 Winners 2021
  • Resources
    • Automated Warehouse Research Reports
    • Digital Issues
    • eBooks
    • Publications
      • Automated Warehouse
      • Collaborative Robotics Trends
    • Search Robotics Database
    • Videos
    • Webinars / Digital Events
  • Events
    • RoboBusiness
    • Robotics Summit & Expo
    • DeviceTalks
    • R&D 100
    • Robotics Weeks
  • Podcast
    • Episodes
  • Advertise
  • Subscribe

Affectiva Automotive AI Helps Cars Monitor Your Emotions

By Steve Crowe | March 21, 2018

The Robotics Summit and Showcase is just a couple months away. Find out all about our agenda here and register by April 20 for a 20% discount to learn from the best in the robotics industry.

Affectiva Automotive AI

Affectiva Automotive AI hopes to improve driver safety. (Credit: Affectiva)

Artificial intelligence (AI), to date, has helped autonomous vehicles mainly by monitoring the world around them. As we learned from the fatal Uber self-driving car crash, unfortunately, the technology is not perfect.

Affectiva, a Boston-based developer of emotional AI, is now turning to AI to help monitor what’s happening on the inside of cars. The Affectiva Automotive AI monitors in real time the emotional and cognitive state of a vehicle’s occupants.

To do so, the Affectiva Automotive AI uses a combination of RGB cameras and near-IR cameras to track facial expressions and head movements. The system call also monitor one’s voice. It measures facial expressions and emotions such as joy, anger and surprise, as well as vocal expressions of anger, arousal and laughter. The Affectiva Automotive AI also indicates when a driver is drowsy by tracking yawns, eye closure and blink rates.

The Affectiva Automotive AI compiles all this data and compares it to AI models the company built that indicate how a driver or passenger feels. According to Affectiva, this allows OEMs and Tier 1 suppliers to build advanced driver monitoring systems (DMS).

For semi-autonomous vehicles, the Affectiva Automotive AI will focus on monitoring drivers to increase safety and facilitate the handoff of controls. More than 1,000 injuries and nine fatalities are caused everyday by distracted driving in the U.S. And up to 6,000 fatal crashes each year may be caused by drowsy drivers.

If and when fully autonomous vehicles become a reality, Affectiva could shift its focus to personalizing the in-cabin experience.

“We have built industry-leading Emotion AI, using our database of more than 6 million faces analyzed in 87 countries,” said Dr. Rana el Kaliouby, CEO and co-founder, Affectiva. “We are now training on large amounts of naturalistic driver and passenger data that Affectiva has collected, to ensure our models perform accurately in real-world automotive environments. With a deep understanding of the emotional and cognitive states of people in a vehicle, our technology will not only help save lives and improve the overall transportation experience, but accelerate the commercial use of semi-autonomous and autonomous vehicles.”

Affectiva Automotive AI Partners

Affectiva already has partnerships with Autoliv, a Swedish supplier of automotive safety products, and Renovo, a California-based self-driving taxi startup. Affectiva said it has partnerships with other unnamed companies, too.

“Our Learning Intelligent Vehicle (LIV) was developed to shape consumer acceptance of autonomous vehicles by building two-way trust and confidence between human and machine,” said Ola Boström, Vice President of Research, Autoliv, Inc. “Supported by Affectiva’s AI, LIV is able to sense driver and passenger moods, and interact with human occupants accordingly. As the adoption and development of autonomous vehicles continues, the need for humans to trust that they’re safe at the hands of their vehicle will be critical. AI systems like Affectiva’s that allow vehicles to really understand occupants, will have a huge role to play, not only in driver safety but in the future of autonomy.”

Affectiva’s emotional AI is built on computer vision, speech science and deep learning. Affectiva launched a voice analysis tool in 2017 for AI assistants and social robots. There are other companies building emotional AI, of course, including EMOSpeech, Vokaturi, and Eyeris. Affectiva hopes, however, it’s entry into the automotive industry will be a differentiator.

“Imagine how much better your robo-taxi experience would be if the vehicle taking you from Point A to Point B understood your moods and emotions,” said Christopher Heiser, co-founder and CEO, Renovo. “Affectiva Automotive AI is integrated into AWare, our OS for automated mobility, and running on our fleet in California today. It is a powerful addition to the AWare ecosystem by providing a feedback loop between a highly automated vehicle and its occupants. Companies building automated driving systems on AWare can use this to tune and potentially provide real-time customization of their algorithms. We believe this real-time passenger feedback capability, combined with aggregate analytics on the occupants’ emotional and cognitive states, will be fundamental to technology developers and operators of automated mobility services.”

About The Author

Steve Crowe

Steve Crowe is Executive Editor, Robotics, WTWH Media, and chair of the Robotics Summit & Expo and RoboBusiness. He is also co-host of The Robot Report Podcast, the top-rated podcast for the robotics industry. He joined WTWH Media in January 2018 after spending four-plus years as Managing Editor of Robotics Trends Media. He can be reached at scrowe@wtwhmedia.com

Tell Us What You Think! Cancel reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Related Articles Read More >

Kawasaki had one of the largest robots at Automate 2025.
10 robotics trends spotted at Automate 2025
A woman with three daughters excitedly approaching a Tally robot in a grocery store.
Simbe upgrades vision platform with AI-powered capabilities
The Spot quadruped uses AI to provide more insights into site health, says Boston Dynamics.
Orbit 5.0 adds features to Boston Dynamics’ Spot quadruped robot
Foxconn’s collaborative nursing robot is one example of its smart hospital applications developed using NVIDIA technologies.
NVIDIA releases cloud-to-robot computing platforms for physical AI, humanoid development

RBR50 Innovation Awards

“rr
EXPAND YOUR KNOWLEDGE AND STAY CONNECTED
Get the latest info on technologies, tools and strategies for Robotics Professionals.
The Robot Report Listing Database

Latest Episode of The Robot Report Podcast

Automated Warehouse Research Reports

Sponsored Content

  • Sager Electronics and its partners, logos shown here, will exhibit at the 2025 Robotics Summit & Expo. Sager Electronics to exhibit at the Robotics Summit & Expo
  • The Shift in Robotics: How Visual Perception is Separating Winners from the Pack
  • An AutoStore automated storage and retrieval grid. Webinar to provide automated storage and retrieval adoption advice
  • Smaller, tougher devices for evolving demands
  • Modular motors and gearboxes make product development simple
The Robot Report
  • Mobile Robot Guide
  • Collaborative Robotics Trends
  • Field Robotics Forum
  • Healthcare Robotics Engineering Forum
  • RoboBusiness Event
  • Robotics Summit & Expo
  • About The Robot Report
  • Subscribe
  • Contact Us

Copyright © 2025 WTWH Media LLC. All Rights Reserved. The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written permission of WTWH Media
Privacy Policy | Advertising | About Us

Search The Robot Report

  • Home
  • News
  • Technologies
    • Batteries / Power Supplies
    • Cameras / Imaging / Vision
    • Controllers
    • End Effectors
    • Microprocessors / SoCs
    • Motion Control
    • Sensors
    • Soft Robotics
    • Software / Simulation
  • Development
    • Artificial Intelligence
    • Human Robot Interaction / Haptics
    • Mobility / Navigation
    • Research
  • Robots
    • AGVs
    • AMRs
    • Consumer
    • Collaborative Robots
    • Drones
    • Humanoids
    • Industrial
    • Self-Driving Vehicles
    • Unmanned Maritime Systems
  • Business
    • Financial
      • Investments
      • Mergers & Acquisitions
      • Earnings
    • Markets
      • Agriculture
      • Healthcare
      • Logistics
      • Manufacturing
      • Mining
      • Security
    • RBR50
      • RBR50 Winners 2025
      • RBR50 Winners 2024
      • RBR50 Winners 2023
      • RBR50 Winners 2022
      • RBR50 Winners 2021
  • Resources
    • Automated Warehouse Research Reports
    • Digital Issues
    • eBooks
    • Publications
      • Automated Warehouse
      • Collaborative Robotics Trends
    • Search Robotics Database
    • Videos
    • Webinars / Digital Events
  • Events
    • RoboBusiness
    • Robotics Summit & Expo
    • DeviceTalks
    • R&D 100
    • Robotics Weeks
  • Podcast
    • Episodes
  • Advertise
  • Subscribe