Work Package 1: Multimedia Experience
Lead partner: EKETA CERT
Overall objective of this WP is to enable a rich multimedia experience in search by developing techniques for event-based multimedia content indexing. Enabling the indexing of each content item not only by means of low-level features or concepts, as in current state-of-the-art approaches, but also by means of real-life events will significantly boost the efficiency of multimedia content retrieval and management and will allow the integration of advanced personalized multimedia retrieval functionalities in the search schemes investigated in WP4. Classical feature-driven content-based multimedia indexing approaches will be considered in a new perspective to define innovative approaches to assist in bridging the gap between the quantitative data and user perceptions. Exploitation of the context of multimedia data and in particular the interaction with the user will help to bridge the gap between the capabilities of current multimedia understanding algorithms and the richness and subjectivity of semantics in human interpretations of multimedia data. The extraction of concepts and facts from multimedia data and of their relations with the context will be supported, thereby progressively increasing the semantics of the dataset. This will be made possible through an integrated approach jointly using both advanced features extracted from the data, meta-representations available (partial annotation, meta-data connected to location or time) and advanced multidimensional media analysis for concept/object extraction (shape, places, actions). The synergy among low-level and high-level media representations will allow the definition of concept networks eventually supporting event-based content indexing.
