April 18, 2023, Shanghai - SenseAuto unveiled new features for its Smart Cabins, including Lip Reading, Guard Mode, Intelligent Rescue, Air Touch, AR Karaoke, and Smart Screensaver. Nearly 30 vehicles with SenseAuto’s smart cabin technology built-in were debut at the Auto Shanghai 2023 exhibition, showcasing new possibilities for the AI-powered automobile experience through enhanced connectivity, safety and entertainment features.    

New smart cabin features designed for a more enjoyable “third living space”

SenseAuto is creating a safer, smarter, and more enjoyable “third living space” experience with its full-stack artificial general intelligence (AGI) capabilities. The recent launch of six new innovative features for smart cabins propels SenseAuto’s leadership in developing next-generation mobility solutions.

Lip-Reading: The lip-reading feature represents a significant advancement in human-machine interaction. It relies solely on lip movements to accurately receive commands despite the level of noise inside the car. In situations when users cannot give a voice command, the system can still recognize the instructions based on the user’s lip movements, providing another layer of safety to drivers and passengers in a dangerous scenario.

Sentinel Mode: SenseAuto’s Guard Mode utilizes a combination of radar and dual-camera sensing to provide high-precision monitoring of the vehicle. It can identify and detect threats accurately even in low-light and closed environments, such as an underground parking lot, and safeguard the car and users against any possible malicious attacks and damages.  

Intelligent Rescue: SenseAuto’s Intelligent Rescue feature largely improves both road and driver’s safety by continuously monitoring the driver’s alertness. It is able to determine if a driver is impaired by scanning the driver’s body posture, vital signs, and real-time vehicle signals. If the driver is unable to continue driving due to a health issue, it will automatically pull over to the side of the road and contact emergency services.

Air Touch:  With the Air Touch feature, users can now use the gesture control to perform different actions inside the car. The Air Touch feature uses the 2D camera to translate hand motions into precise commands, such as gesture tracking, confirmation, and dragging, allowing passengers to seamlessly manipulate the display without physical contact.

AR Karaoke: SenseAuto's music metaverse app now brings an immersive augmented reality (AR) karaoke experience to vehicles. In collaboration with Changba, a smartphone application that offers a portable solo KTV booth, AR Karaoke integrates AR displays and social features to make the ride more entertaining.

Intelligent Screensaver: The cutting-edge "Intelligent Screensaver" offers a glimpse into the future of personalized in-cabin space. Through seamless response to user gestures, eye movements, and facial expressions, it transforms the cabin into an immersive visual haven tailored uniquely to each passenger.

SenseAuto empowers nearly 30 mass-produced models showcased at Auto Shanghai 2023

In 2022, SenseAuto’s Cabin and Pilot products were implemented in 27 vehicle models from over 30 renowned automotive brands. Nearly 30 models integrated with SenseAuto’s advanced in-cabin technologies, including the Nio ES7, ET7, ET5, GAC AION LX Plus and Zeekr X, debuted at Auto Shanghai 2023.

SenseAuto's success is evident in its partnerships with over 30 automotive manufacturers and more than 50 ecosystem allies worldwide. With plans to extend its technology to over 31 million vehicles in the near future, SenseAuto is leading the way in intelligent vehicle innovation. Leveraging AGI capabilities, SenseAuto is poised to continue enhancing its R&D efficiency and commercialization process towards a new era of human-vehicle collaborative driving.