To access the full text documents, please follow this link: http://hdl.handle.net/2117/18542

Can our TV robustly understand human gestures? Real-Time Gesture Localization in Range Data
López Méndez, Adolfo; Casas Pla, Josep Ramon
Universitat Politècnica de Catalunya. Departament de Teoria del Senyal i Comunicacions; Universitat Politècnica de Catalunya. GPI - Grup de Processament d'Imatge i Vídeo
Google Best Student Paper Award CVMP 2012
The 'old' remote falls short of requirements when confronted with digital convergence for living room displays. Enriched options to watch, manage and interact with content on large displays demand improved means of interaction. Concurrently, gesture recognition is increasingly present in human-computer interaction for gaming applications. In this paper we propose a gesture localization framework for interactive display of audio-visual content. The proposed framework works with range data captured from a single consumer depth camera. We focus on still gestures because they are generally user friendly (users do not have to make complex and tiring movements) and allow formulating the problem in terms of object localization. Our method is based on random forests, which have shown an excellent performance on classification and regression tasks. In this work, however, we aim at a specific class of localization problems involving highly unbalanced data: positive examples appear during a small fraction of space and time. We study the impact of this natural unbalance on the random forest learning and we propose a framework to robustly detect gestures on range images in real applications. Our experiments with offline data show the effectiveness of our approach. We also present a real-time application where users can control the TV display with a reduced set of still gestures.
Peer Reviewed
Award-winning
Àrees temàtiques de la UPC::Enginyeria de la telecomunicació::Radiocomunicació i exploració electromagnètica::Radiodifusió per televisió
Àrees temàtiques de la UPC::Enginyeria de la telecomunicació::Processament del senyal::Processament de la imatge i del senyal vídeo
Image processing -- Digital techniques
Television
Imatges -- Processament --Tècniques digitals
Televisió
info:eu-repo/semantics/publishedVersion
info:eu-repo/semantics/conferenceObject
ACM Press. Association for Computing Machinery
         

Show full item record

Related documents

Other documents of the same author

López Méndez, Adolfo; Gall, Juergen; Casas Pla, Josep Ramon; van Gool, Luc
Suau Cuadros, Xavier; Alcoverro Vidal, Marcel; López Méndez, Adolfo; Ruiz Hidalgo, Javier; Casas Pla, Josep Ramon
López Méndez, Adolfo; Alcoverro Vidal, Marcel; Pardàs Feliu, Montse; Casas Pla, Josep Ramon
López Méndez, Adolfo; Alcoverro Vidal, Marcel; Pardàs Feliu, Montse; Casas Pla, Josep Ramon
 

Coordination

 

Supporters