ams 3D technology to address driver drowsiness and distraction: new demo system combines 3D sensing with eye tracking
News facts:
Firat Sarialtun, In-Cabin Sensing Segment Manager of ams, said: “The automotive industry has been actively evaluating 3D optical sensing technologies for driver monitoring, as it provides more accurate and robust information about the position and movement of the driver’s head and eyes compared to existing less sophisticated 2D systems. Now, by developing a 3D demonstration system for eye tracking, ams and Eyeware have shown the industry the way to integrate the 3D sensing hardware and eye-tracking software elements and produce a reliable method for detecting drowsiness and distraction.”
Bastjan Prenaj, Co-founder and Chief Business Development Officer at Eyeware, said:
“Driver monitoring has the potential to make a vital contribution to improving road safety, but the systems and components used in a DMS must be ultra-reliable. That is a key benefit of the
Eyeware software: together with the ams 3D sensing technology, it performs in all lighting and usage conditions, and gives accurate data on which OEMs can build applications such as drowsiness alerts.”
Active Stereo Vision (ASV)-based demonstrator for precise automotive cabin monitoring
Flood and dot pattern illuminators from ams are used in the ASV-based demonstrator to provide robust illumination, resisting interference from sunlight and reflection from sunglasses. This combines with advanced eye-tracking software from Eyeware Tech SA, to apply proprietary algorithms to the depth-mapped images of the driver’s eyes and head posture to calculate in real time the direction of the driver’s gaze
Designers developing driver and cabin monitoring systems can use the outputs of this demonstrator to build sophisticated safety features which can detect when the driver is drowsy or asleep at the wheel. Using 3D images and 3D head pose estimation enables precise monitoring of the so called “micro sleeps” for early detection of sleepy drivers, not possible with 2D systems. The DMS also detects drivers when their gaze has been distracted from the road, for instance to read a text message on their mobile phone. This can help reduce a leading cause of road accidents.
The signals from the 3D DMS demonstrator will also enable next-generation heads-up displays, detecting where the driver’s gaze is directed to control the projection of displayed information on the windshield. This enables groundbreaking visual applications in the car based on augmented reality. The demonstration system is based on the ams Active Stereo Vision evaluation kit, which uses the ams face image processing library and Eyeware’s eye-tracking software. Customer implementations can use a dedicated software development kit supplied by Eyeware, which is fully compatible with the ams 3D sensing components.
For more information on ams’ driver monitoring technology please go to
https://ams.com/automotive
News facts:
- Driver monitoring system (DMS) demonstrator includes robust 3D optical sensing and facial recognition technology from ams
- Eye-tracking software from Eyeware detects the direction of the driver’s gaze
- 3D images and 3D head pose estimation enables precise monitoring of the so called “micro sleeps” for early detection of sleepy drivers, not possible with 2D systems
- Automotive manufacturers can create proof-of-concept designs for drowsiness detection, distraction alerts, and heads-up display and other applications
Firat Sarialtun, In-Cabin Sensing Segment Manager of ams, said: “The automotive industry has been actively evaluating 3D optical sensing technologies for driver monitoring, as it provides more accurate and robust information about the position and movement of the driver’s head and eyes compared to existing less sophisticated 2D systems. Now, by developing a 3D demonstration system for eye tracking, ams and Eyeware have shown the industry the way to integrate the 3D sensing hardware and eye-tracking software elements and produce a reliable method for detecting drowsiness and distraction.”
Bastjan Prenaj, Co-founder and Chief Business Development Officer at Eyeware, said:
“Driver monitoring has the potential to make a vital contribution to improving road safety, but the systems and components used in a DMS must be ultra-reliable. That is a key benefit of the
Eyeware software: together with the ams 3D sensing technology, it performs in all lighting and usage conditions, and gives accurate data on which OEMs can build applications such as drowsiness alerts.”
Active Stereo Vision (ASV)-based demonstrator for precise automotive cabin monitoring
Flood and dot pattern illuminators from ams are used in the ASV-based demonstrator to provide robust illumination, resisting interference from sunlight and reflection from sunglasses. This combines with advanced eye-tracking software from Eyeware Tech SA, to apply proprietary algorithms to the depth-mapped images of the driver’s eyes and head posture to calculate in real time the direction of the driver’s gaze
Designers developing driver and cabin monitoring systems can use the outputs of this demonstrator to build sophisticated safety features which can detect when the driver is drowsy or asleep at the wheel. Using 3D images and 3D head pose estimation enables precise monitoring of the so called “micro sleeps” for early detection of sleepy drivers, not possible with 2D systems. The DMS also detects drivers when their gaze has been distracted from the road, for instance to read a text message on their mobile phone. This can help reduce a leading cause of road accidents.
The signals from the 3D DMS demonstrator will also enable next-generation heads-up displays, detecting where the driver’s gaze is directed to control the projection of displayed information on the windshield. This enables groundbreaking visual applications in the car based on augmented reality. The demonstration system is based on the ams Active Stereo Vision evaluation kit, which uses the ams face image processing library and Eyeware’s eye-tracking software. Customer implementations can use a dedicated software development kit supplied by Eyeware, which is fully compatible with the ams 3D sensing components.
For more information on ams’ driver monitoring technology please go to
https://ams.com/automotive
