|
Title:
|
Action tube extraction based 3D-CNN for RGB-D action recognition
|
|
Author:
|
Xu, Zhengyu; Vilaplana Besler, Verónica; Morros Rubió, Josep Ramon
|
|
Other authors:
|
Universitat Politècnica de Catalunya. Departament de Teoria del Senyal i Comunicacions; Universitat Politècnica de Catalunya. GPI - Grup de Processament d'Imatge i Vídeo |
|
Abstract:
|
In this paper we propose a novel action tube extractor for RGB-D action recognition in trimmed videos. The action tube extractor takes as input a video and outputs an action tube. The method consists of two parts: spatial tube extraction and temporal sampling. The first part is built upon MobileNet-SSD and its role is to define the spatial region where the action takes place. The second part is based on the structural similarity index (SSIM) and is designed to remove frames without obvious motion from the primary action tube. The final extracted action tube has two benefits: 1) a higher ratio of ROI (subjects of action) to background; 2) most frames contain obvious motion change. We propose to use a two-stream (RGB and Depth) I3D architecture as our 3D-CNN model. Our approach outperforms the state-of-the-art methods on the OA and NTU RGB-D datasets. © 2018 IEEE. |
|
Abstract:
|
Peer Reviewed |
|
Subject(s):
|
-Àrees temàtiques de la UPC::Enginyeria de la telecomunicació::Processament del senyal::Processament de la imatge i del senyal vídeo
-Àrees temàtiques de la UPC::So, imatge i multimèdia::Creació multimèdia::Vídeo digital
-Digital video
-3-D video (Three-dimensional imaging)
-Image processing--Digital techniques
-3D-CNN
-action recognition
-action tube extraction
extraction
-indexing (of information)
-3D-CNN
-action recognition
-CNN models
-spatial regions
-state-of-the-art methods
-structural similarity indices (SSIM)
-temporal sampling
-two-stream
-tubes (components)
-Vídeo digital
-Visualització tridimensional (Informàtica)
-Imatges -- Processament -- Tècniques digitals |
|
Rights:
|
|
|
Document type:
|
Article - Published version
Conference Object |
|
Published by:
|
Institute of Electrical and Electronics Engineers (IEEE)
|
|
Share:
|
|
