Xperi Develops World-first In-cabin Monitoring Technologies on
Neuromorphic Vision Systems

New sensing technologies complement standard vision system capabilities, enhancing occupant safety, enabling increased personalization, advancing today’s in-cabin experience to tomorrow’s third space experience

With more than 20 years of world-leading experience in neural solutions and computer vision, and with billions of products powered by their solutions, the Xperi team maps and adapts in-cabin monitoring (ICM) technologies to existing and future sensor centric trends. 

“Intelligent sensing is required by the next-generation in-cabin experience. The critical path to this is a sensor fusion-focused advanced research strategy,” said Petronel Bigioi, chief technology officer, Xperi. “DTS AutoSense’s advanced research team is centered on state-of-the-art sensing solutions and neuromorphic sensing is one of the technologies that can shape the future of the industry.”

The neuromorphic sensors capture information at an equivalent frame rate of 10,000 frames per second without requiring active illumination. This enables better low light performance for driver monitoring features as well as never seen before capabilities such as saccadic eye movement or micro-expressions, crucial next steps in the next-generation in-cabin experiences.

Xperi’s implementation has 12 patents pending and relies on an end-to-end data generation and training system built to address the particularities of the sensor. The training data set was generated based on Xperi’s extensive computer vision infrastructure, reusing ground-truth from the visible and near infrared spectrums, synthesizing a completely novel approach in neuromorphic based sensing.   

“Being able to instantaneously detect the subtlest, almost imperceptible, face and eye motions can be lifesaving,” said Petronel Bigioi. “The low light powerful vision processing capabilities, fast response times and low power operation that this pioneering neuromorphic-based technology application enables makes it ideal for the safety-critical applications of driver monitoring systems, while also broadening the ability to further enhance and personalize the vehicle cabin.”

In addition to excellent low light performance and robustness to various illumination conditions, neuromorphic sensing addresses head-on the privacy aspect specific to traditional imaging-based sensing (always-on cameras).

“DTS AutoSense’s innovative AI-enabled approach underscores the ability of Prophesee’s sensor solution to provide OEMs with an effective safety enhancement for vehicles of all types,” said Marc Rousseau, VP Products and Business Development at Prophesee. “We are delighted to collaborate on this first-of-its-kind technology with Xperi DTS and its forward-thinking, high caliber team.”

*DTS AutoSense comprises a Driver Monitoring Solution (DMS) and an Occupancy Monitoring Solution (OMS), the first to be designed into passenger vehicles projected to be on the road in 2021. Working together they provide actionable insights into activity inside the vehicle, including the driver, passengers, pets and objects, to create a better, safer experience.

ABOUT XPERI HOLDING CORPORATION

Xperi invents, develops, and delivers technologies that enable extraordinary experiences. Xperi technologies, delivered via its brands (DTS, HD Radio, IMAX Enhanced, Invensas, TiVo), and by its startup, Perceive, make entertainment more entertaining, and smart devices smarter. Xperi technologies are integrated into billions of consumer devices, media platforms, and semiconductors worldwide, driving increased value for partners, customers and consumers.

Xperi, DTS, IMAX Enhanced, Invensas, HD Radio, Perceive, TiVo, DTS AutoSense, and their respective logos are trademarks or registered trademarks of affiliated companies of Xperi Holding Corporation in the United States and other countries. All other company, brand and product names may be trademarks or registered trademarks of their respective companies.

ABOUT PROPHESEE

Prophesee is the inventor of the world’s most advanced neuromorphic vision systems.

The company developed a breakthrough Event-Based Vision approach to machine vision. This new vision category allows for significant reductions of power, latency and data processing requirements to reveal what was invisible to traditional frame-based sensors until now.

Prophesee’s patented Metavision® sensors and algorithms mimic how the human eye and brain work to dramatically improve efficiency in areas such as autonomous vehicles, industrial automation, IoT, security and surveillance, and AR/VR.

Prophesee is based in Paris, with local offices in Grenoble, Shanghai, Tokyo and Silicon Valley. The company is driven by a team of more than 100 visionary engineers, holds more than 50 international patents and is backed by leading international investors including Sony, iBionext, 360 Capital Partners, Intel Capital, Robert Bosch Venture Capital, Supernova Invest, and European Investment Bank.

SOURCE: Xperi Holding Corporation

XPER-P

MEDIA INQUIRIES

Prophesee PR Agency: Mike Sottak / mike@wiredislandpr.com / +1 650 248 9597