The Robot Report

  • Home
  • News
  • Technologies
    • Batteries / Power Supplies
    • Cameras / Imaging / Vision
    • Controllers
    • End Effectors
    • Microprocessors / SoCs
    • Motion Control
    • Sensors
    • Soft Robotics
    • Software / Simulation
  • Development
    • Artificial Intelligence
    • Human Robot Interaction / Haptics
    • Mobility / Navigation
    • Research
  • Robots
    • AGVs
    • AMRs
    • Consumer
    • Collaborative Robots
    • Drones
    • Humanoids
    • Industrial
    • Self-Driving Vehicles
    • Unmanned Maritime Systems
  • Business
    • Financial
      • Investments
      • Mergers & Acquisitions
      • Earnings
    • Markets
      • Agriculture
      • Healthcare
      • Logistics
      • Manufacturing
      • Mining
      • Security
    • RBR50
      • RBR50 Winners 2025
      • RBR50 Winners 2024
      • RBR50 Winners 2023
      • RBR50 Winners 2022
      • RBR50 Winners 2021
  • Resources
    • Automated Warehouse Research Reports
    • Digital Issues
    • eBooks
    • Publications
      • Automated Warehouse
      • Collaborative Robotics Trends
    • Search Robotics Database
    • Videos
    • Webinars / Digital Events
  • Events
    • RoboBusiness
    • Robotics Summit & Expo
    • DeviceTalks
    • R&D 100
    • Robotics Weeks
  • Podcast
    • Episodes
  • Advertise
  • Subscribe

Simbe receives patent for tracking fruit & vegetable freshness

By Mike Oitzman | December 20, 2021

image of a fruit stand

Fruit spoilage is a major source of lost revenue for grocers. | Image credit: Clem Onojeghuo from Pexels

Simbe Robotics was recently granted US Patent 11,200,537 covering the application of autonomous mobile robot and vision for tracking the freshness/ripeness of fruits and vegetables in a grocery display.

According to the USDA Economic Research Service (ERS), in 2010 a totalĀ of 133 billion pounds (31%) of the 430 billion pounds of available food supply at retail and consumer levels went uneaten, with an estimated retail value of $162 billion. Estimates of the average supermarket loss rate was 11.6% for 31 fresh vegetable types.

Grocers operate on thin margins, so every little bit of savings counts. This is potentially a huge application opportunity in a market where Simbe Robotics already has a presence. Simbe recently announced it is expanding the use of inventory robots at 100% of the Schnucks Grocery stores in the U.S.

The difficult part of this application is the machine vision and creating an algorithm that can determine when food is starting to go bad, and subsequently when it’s time to raise an alert to a fresh food clerk to remediate the situation. In the patent application, Simbe outlines the use of hyper-spectral imaging to determine the freshness of fruits and vegetables and the characterization of the quality.

The Simbe Tally robot is one of the market leaders in grocery store inventory management. Up until now, Tally could track the inventory of all of the stable food items and hard goods within a store. But fresh food inventory and spoilage has long been a difficult application to solve, so this hasn’t been a capability of the Tally robot. Until now.

screenshot of the simbe patent illustrating the workslow for identifying spoiled fruit with a mobile robot

The patent outlines the workflow to identify spoiled fruit with a camera on a mobile robot and alert a clerk. | Image credit: USPTO

With the patent in hand, Simbe can now begin the process of commercializing this idea. It is likely the company already has it working in a lab environment, but the real proof will come from validating the imaging and analysis with real-world environments of a grocery store with changing lighting conditions throughout the day.

We reached out to the company for comment, but at this time Simbe is remaining quiet on its commercialization plans.

This application has been a “holy grail” opportunity since the early days of in-store inventory management with mobile robots. The biggest hurdle has been solving the lighting, imaging and analysis of fresh food products in display cases. Imaging hard goods on standard grocery shelves was solved by a number of competitors in this space. However, all these competitors noted that imaging fresh fruits and vegetables remained a difficult problem to solve.

Hy-Vee Simbe Tally robot

Simbe’s Tally robot moves autonomously through the store to check inventory levels. | Image credit: Simbe Robotics

First of all, imaging fruits and vegetables on display requires a different lens and depth-of-field setup from shelf imaging. It requires that the camera look down from a different vantage point than a camera looking at items on shelves. This is because fruits and vegetables are typically arranged at different angles as the items are stacked and presented to the buyer. Other problems include reflections from overhead lighting, used to illuminate the items for purchase, as well as inconsistent reflections from moisture on an item’s surface from frequent water spraying.

The patent is long and intricate at 32 pages. It covers the design of an application that assesses the state of the fruit, identifies fruit that is spoiling, and subsequently alerting a clerk to check and/or replace the spoiling fruit. The outcome of the new capabilities will be the ability to alert the fresh food clerk that items on display need to be removed from sale and replaced with fresher offerings.

The end game for Simbe is better utilization of the Simbe mobile robot in-store along with the capabilities to cover more SKUs in the store, but especially the support for one of the highest-labor intensive processes (managing the fresh food displays) in the store.

About The Author

Mike Oitzman

Mike Oitzman is Senior Editor of WTWH's Robotics Group and founder of the Mobile Robot Guide. Oitzman is a robotics industry veteran with 25-plus years of experience at various high-tech companies in the roles of marketing, sales and product management. Mike has a BS in Systems Engineering from UCSD and an MBA from Golden Gate University. He can be reached at moitzman@wtwhmedia.com.

Comments

  1. John Bran says

    January 26, 2022 at 8:34 pm

    Bravo! Retail is not going away and solutions like Simbe are becoming more and more inline for growth.

    Reply

Tell Us What You Think! Cancel reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Related Articles Read More >

Headshot of Geoffrey Biggs and the podcast logo.
ICRA Recap; OSRF on ROS 1 Sunset
kilted kaiju logo in a green background.
Kilted Kaiju ROS 2 release details are available
Jorgen Pedersen, the ARM Institute's new CEO, will be at its annual member meeting, shown here.
ARM Institute appoints Jorgen Pedersen as new CEO
Artedrone's Sasha autonomous mechanical thrombectomy system.
Microrobot system is designed to float inside stroke patient for autonomous thrombectomy

RBR50 Innovation Awards

ā€œrr
EXPAND YOUR KNOWLEDGE AND STAY CONNECTED
Get the latest info on technologies, tools and strategies for Robotics Professionals.
The Robot Report Listing Database

Latest Episode of The Robot Report Podcast

Automated Warehouse Research Reports

Sponsored Content

  • Sager Electronics and its partners, logos shown here, will exhibit at the 2025 Robotics Summit & Expo. Sager Electronics to exhibit at the Robotics Summit & Expo
  • The Shift in Robotics: How Visual Perception is Separating Winners from the Pack
  • An AutoStore automated storage and retrieval grid. Webinar to provide automated storage and retrieval adoption advice
  • Smaller, tougher devices for evolving demands
  • Modular motors and gearboxes make product development simple
The Robot Report
  • Mobile Robot Guide
  • Collaborative Robotics Trends
  • Field Robotics Forum
  • Healthcare Robotics Engineering Forum
  • RoboBusiness Event
  • Robotics Summit & Expo
  • About The Robot Report
  • Subscribe
  • Contact Us

Copyright © 2025 WTWH Media LLC. All Rights Reserved. The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written permission of WTWH Media
Privacy Policy | Advertising | About Us

Search The Robot Report

  • Home
  • News
  • Technologies
    • Batteries / Power Supplies
    • Cameras / Imaging / Vision
    • Controllers
    • End Effectors
    • Microprocessors / SoCs
    • Motion Control
    • Sensors
    • Soft Robotics
    • Software / Simulation
  • Development
    • Artificial Intelligence
    • Human Robot Interaction / Haptics
    • Mobility / Navigation
    • Research
  • Robots
    • AGVs
    • AMRs
    • Consumer
    • Collaborative Robots
    • Drones
    • Humanoids
    • Industrial
    • Self-Driving Vehicles
    • Unmanned Maritime Systems
  • Business
    • Financial
      • Investments
      • Mergers & Acquisitions
      • Earnings
    • Markets
      • Agriculture
      • Healthcare
      • Logistics
      • Manufacturing
      • Mining
      • Security
    • RBR50
      • RBR50 Winners 2025
      • RBR50 Winners 2024
      • RBR50 Winners 2023
      • RBR50 Winners 2022
      • RBR50 Winners 2021
  • Resources
    • Automated Warehouse Research Reports
    • Digital Issues
    • eBooks
    • Publications
      • Automated Warehouse
      • Collaborative Robotics Trends
    • Search Robotics Database
    • Videos
    • Webinars / Digital Events
  • Events
    • RoboBusiness
    • Robotics Summit & Expo
    • DeviceTalks
    • R&D 100
    • Robotics Weeks
  • Podcast
    • Episodes
  • Advertise
  • Subscribe