Title:
|
Probability-based Dynamic Time Warping and Bag-of-Visual-and-Depth-Words for Human Gesture Recognition in RGB-D
|
Author:
|
Hernández-Vela, Antonio; Bautista, Miguel Angel; Perez Sala, Xavier; Ponce, Víctor; Escalera, Sergio; Baró, Xavier; Pujol, Oriol; Angulo Bahón, Cecilio
|
Other authors:
|
Universitat Politècnica de Catalunya. Departament d'Enginyeria de Sistemes, Automàtica i Informàtica Industrial; Universitat Politècnica de Catalunya. GREC - Grup de Recerca en Enginyeria del Coneixement |
Abstract:
|
We present a methodology to address the problem of human gesture segmentation and recognition in video and depth image sequences. A Bag-of-Visual-and-Depth-Words (BoVDW) model is introduced as an extension of the Bag-of-Visual-Words (BoVW) model. State-of-the-art RGB and depth features, including a newly proposed depth descriptor, are analysed and combined in a late fusion form. The method is integrated in a Human Gesture Recognition pipeline, together with a novel probability-based Dynamic
Time Warping (PDTW) algorithm which is used to perform prior segmentation of idle gestures. The proposed DTW variant uses samples of the same gesture category to build a Gaussian Mixture Model driven probabilistic model of that gesture class. Results of the whole Human Gesture Recognition pipeline in a public data set show better performance in comparison to both standard BoVW model and DTW approach. |
Subject(s):
|
-Àrees temàtiques de la UPC::Informàtica::Intel·ligència artificial -Computer vision -Pattern recognition systems -RGB-D -Bag-of-Words -Dynamic Time Warping -Human Gesture Recognition -Visió per ordinador -Reconeixement de formes (Informàtica) |
Rights:
|
|
Document type:
|
Article - Published version Article |
Share:
|
|