Title:
|
Semantic summarization of egocentric photo stream events
|
Author:
|
Lidon, Aniol; Bolaños, Marc; Dimiccoli, Mariella; Radeva, Petia; Garolera Freixa, Maite; Giró Nieto, Xavier
|
Other authors:
|
Universitat Politècnica de Catalunya. Departament de Teoria del Senyal i Comunicacions; Universitat Politècnica de Catalunya. GPI - Grup de Processament d'Imatge i Vídeo |
Abstract:
|
With the rapid increase of users of wearable cameras in recent years and of the amount of data they produce, there is a strong need for automatic retrieval and summarization techniques. This work addresses the problem of automatically summarizing egocentric photo streams captured through a wearable camera by taking an image retrieval perspective. After removing non-informative images by a new CNN-based filter, images are ranked by relevance to ensure semantic diversity and finally re-ranked by a novelty criterion to reduce redundancy. To assess the results, a new evaluation metric is proposed which takes into account the non-uniqueness of the solution. Experimental results applied on a database of 7,110 images from 6 different subjects and evaluated by experts gave 95.74% of experts satisfaction and a Mean Opinion Score of 4.57 out of 5.0. |
Subject(s):
|
-Àrees temàtiques de la UPC::Enginyeria de la telecomunicació::Processament del senyal::Processament de la imatge i del senyal vídeo -Àrees temàtiques de la UPC::So, imatge i multimèdia::Creació multimèdia::Vídeo digital -Digital video -Image processing--Digital techniques -Semantic computing -Wearable cameras -Vídeo digital -Imatges -- Processament -- Tècniques digitals -Web semàntica -Càmeres de vídeo |
Rights:
|
|
Document type:
|
Article - Published version Conference Object |
Share:
|
|