STMicroelectronics, a global leader in semiconductor solutions, introduces a revolutionary Human Presence Detection (HPD) system designed to enhance the user experience across laptops, PCs, monitors, and accessories. This new technology delivers over 20% savings in daily power consumption while also boosting security and privacy. The advanced solution integrates the high-performance FlightSense™ Time-of-Flight (ToF) sensors with proprietary AI algorithms, offering seamless, hands-free Windows Hello authentication. Key benefits include extended battery life and notifications for user privacy and wellness.
“Building on our success integrating FlightSense technology into over 260 laptop and PC models in recent years, we are excited to see our latest HPD solution making devices more energy-efficient, secure, and user-friendly,” said Alexandre Balmefrezol, Executive Vice President and General Manager of STMicroelectronics’ Imaging Sub-Group. “With AI and sensor technologies advancing rapidly, and the growing synergy between hardware and software, we look forward to seeing even more sophisticated and intuitive ways to interact with devices, with ST at the forefront of this market evolution.”
“Since 2023, 3D sensing in consumer technology has gained significant momentum, driven by the demand for improved user experiences, safety, personal robotics, spatial computing, and enhanced photography. Time-of-Flight (ToF) technology is now expanding beyond smartphones and tablets into drones, robots, AR/VR headsets, home projectors, and laptops. In 2024, ToF modules generated $2.2 billion in revenue, with projections expected to reach $3.8 billion by 2030 (9.5% CAGR). Compact, affordable multi-zone dToF sensors are now enhancing laptop experiences and enabling new use cases,” explained Florian Domengie, PhD, Principal Analyst for Imaging at Yole Group.
This innovative system integrates hardware and software seamlessly, offering a ready-to-deploy solution based on the FlightSense 8×8 multi-zone Time-of-Flight sensor (VL53L8CP) and advanced AI algorithms. The technology enables essential functions like human presence detection, multi-person detection, and head orientation tracking. The 5th generation of sensors also comes with enhanced capabilities such as gesture recognition, hand posture detection, and wellness monitoring through human posture analysis.
ST’s Human Presence Detection (HPD) solution offers several key features designed to enhance user experience and efficiency. The Adaptive Screen Dimming function tracks the user’s head orientation and dims the screen when they’re not looking, reducing power consumption by over 20%. Additionally, Walk-Away Lock & Wake-on-Attention automatically locks the device when the user steps away and wakes it up upon their return, providing an extra layer of security while enhancing convenience.
The solution also includes Multi-Person Detection, which alerts the user if someone is looking over their shoulder, thereby improving privacy. This combination of features makes ST’s HPD solution an effective tool for both energy savings and user security, while also ensuring a more private and personalized interaction with the device.
STMicroelectronics’ development process includes a robust AI-driven approach to data collection, labeling, cleaning, AI training, and integration into mass-market products. Thousands of data logs from diverse sources, including contributions from workers who uploaded personal seating and movement data, helped refine the AI algorithms continuously.
One notable achievement is the successful transformation of a Proof-Of-Concept (PoC) into a fully functional solution capable of detecting the user’s head orientation using just 8×8 pixels of distance data. This breakthrough was made possible through global data capture campaigns, numerous solution updates, and stringent quality control in AI training. Additionally, the VL53L8CP ToF sensor was designed to optimize the Signal-to-Noise ratio (SNR) per zone, playing a vital role in this achievement.
STMicroelectronics’ Time-of-Flight (ToF) sensor prioritizes user privacy by eliminating the need for image capture or webcam reliance, offering a more secure and discreet experience. The sensor’s key features, including adaptive screen dimming, work to optimize energy efficiency and enhance user convenience. By using AI algorithms to detect head orientation, the sensor dims the screen when the user isn’t looking, reducing power consumption and extending battery life. This system seamlessly integrates with existing PC sensor hubs, ensuring that it doesn’t disrupt the overall functionality of the device.
The Walk-Away Lock & Wake-on-Approach features provide an added layer of security, automatically locking the device when the user moves away and waking it up when they return. This hands-free functionality makes it easier to protect sensitive information while minimizing manual interaction. Furthermore, the sensor’s advanced filtering algorithms help prevent false triggers caused by casual passersby, ensuring that the system only responds to intentional actions by the user.
The Multi-Person Detection feature is designed to further enhance privacy. By detecting multiple individuals in front of the screen, the sensor alerts the primary user if someone is looking over their shoulder. This feature helps safeguard sensitive data from unauthorized viewing. The system uses advanced algorithms to differentiate between the primary user and other people nearby, ensuring that only the intended user receives notifications and control.
The ToF sensor is built using the VL53L8CP, ST’s FlightSense 8×8 multi-zone sensor, which allows for precise detection without compromising energy efficiency. It utilizes AI-based, low-power algorithms that are ideal for integration into existing PC sensor hubs. This ready-to-use solution comes with both hardware and software components, making it easy for manufacturers to deploy without additional development.
STMicroelectronics is home to over 50,000 creators and makers of semiconductor technologies, mastering the semiconductor supply chain with state-of-the-art manufacturing facilities. As an integrated device manufacturer, ST collaborates with more than 200,000 customers and thousands of partners to design and build innovative products, solutions, and ecosystems. These efforts address global challenges and support a more sustainable world. ST’s technologies enable smarter mobility, more efficient energy management, and the widespread adoption of cloud-connected autonomous devices. The company is on track to achieve carbon neutrality across all direct and indirect emissions (Scopes 1 and 2), product transportation, business travel, and employee commuting emissions (Scope 3), with a goal to source 100% renewable electricity by 2027.
