Combining geometric, textual and visual features for predicting prepositions in image descriptions

All of RECERCAT

To access the full text documents, please follow this link: http://hdl.handle.net/2117/85160

Title:	Combining geometric, textual and visual features for predicting prepositions in image descriptions
Author:	Ramisa Ayats, Arnau; Wang, Josiah; Lu, Ying; Dellandrea, Emmanuel; Moreno-Noguer, Francesc; Gaizauskas, Robert
Other authors:	Institut de Robòtica i Informàtica Industrial; Universitat Politècnica de Catalunya. ROBiri - Grup de Robòtica de l'IRI
Abstract:	We investigate the role that geometric, textual and visual features play in the task of predicting a preposition that links two visual entities depicted in an image. The task is an important part of the subsequent process of generating image descriptions. We explore the prediction of prepositions for a pair of entities, both in the case when the labels of such entities are known and unknown. In all situations we found clear evidence that all three features contribute to the prediction task.
Abstract:	Peer Reviewed
Subject(s):	-Àrees temàtiques de la UPC::Informàtica::Robòtica -computer vision -natural language processing -Classificació INSPEC::Pattern recognition::Computer vision
Rights:	http://creativecommons.org/licenses/by-nc-nd/3.0/es/
Document type:	Article - Submitted version Conference Object
Share: