An Embedded In-Cabin Lightweight High-Performance 3D Gaze Estimation System

Oyola Suárez, Angely Jazmín (2022) An Embedded In-Cabin Lightweight High-Performance 3D Gaze Estimation System. [Laurea magistrale], Università di Bologna, Corso di Studio in Artificial intelligence [LM-DM270]
Documenti full-text disponibili:
[img] Documento PDF (Thesis)
Disponibile con Licenza: Creative Commons: Attribuzione - Condividi allo stesso modo 4.0 (CC BY-SA 4.0)

Download (7MB)


Gaze estimation has gained interest in recent years for being an important cue to obtain information about the internal cognitive state of humans. Regardless of whether it is the 3D gaze vector or the point of gaze (PoG), gaze estimation has been applied in various fields, such as: human robot interaction, augmented reality, medicine, aviation and automotive. In the latter field, as part of Advanced Driver-Assistance Systems (ADAS), it allows the development of cutting-edge systems capable of mitigating road accidents by monitoring driver distraction. Gaze estimation can be also used to enhance the driving experience, for instance, autonomous driving. It also can improve comfort with augmented reality components capable of being commanded by the driver's eyes. Although, several high-performance real-time inference works already exist, just a few are capable of working with only a RGB camera on computationally constrained devices, such as a microcontroller. This work aims to develop a low-cost, efficient and high-performance embedded system capable of estimating the driver's gaze using deep learning and a RGB camera. The proposed system has achieved near-SOTA performances with about 90% less memory footprint. The capabilities to generalize in unseen environments have been evaluated through a live demonstration, where high performance and near real-time inference were obtained using a webcam and a Raspberry Pi4.

Tipologia del documento
Tesi di laurea (Laurea magistrale)
Autore della tesi
Oyola Suárez, Angely Jazmín
Relatore della tesi
Correlatore della tesi
Corso di studio
Ordinamento Cds
Parole chiave
gaze estimation,eye tracking,computer vision,edge machine learning,machine learning on device
Data di discussione della Tesi
6 Ottobre 2022

Altri metadati

Statistica sui download

Gestione del documento: Visualizza il documento