IEEE Transactions on Multimedia paper online
May 20, 2012 00:02 Filed in: Papers
“Content-Based
Analysis Improves Audiovisual Archive Retrieval”
by Bouke Huurnink, Cees Snoek, Maarten de Rijke and
Arnold Smeulders (IEEE Transactions on
Multimedia, published online: 5 April 2012)
is available now.
Content-based video retrieval is maturing to the point where it can be used in real-world retrieval practices. One such practice is the audiovisual archive, whose users increasingly require fine-grained access to broadcast television content. In this paper, we take into account the information needs and retrieval data already present in the audiovisual archive, and demonstrate that retrieval performance can be significantly improved when content-based methods are applied to search. To the best of our knowledge, this is the first time that the practice of an audiovisual archive has been taken into account for quantitative retrieval evaluation. To arrive at our main result, we propose an evaluation methodology tailored to the specific needs and circumstances of the audiovisual archive, which are typically missed by existing evaluation initiatives. We utilize logged searches, content purchases, session information, and simulators to create realistic query sets and relevance judgments. To reflect the retrieval practice of both the archive and the video retrieval community as closely as possible, our experiments with three video search engines incorporate archive-created catalog entries as well as state-of-the-art multimedia content analysis results. A detailed query-level analysis indicates that individual content-based retrieval methods such as transcript-based retrieval and concept-based retrieval yield approximately equal performance gains. When combined, we find that content-based video retrieval incorporated into the archives practice results in significant performance increases for shot retrieval and for retrieving entire television programs. The time has come for audiovisual archives to start accommodating content-based video retrieval methods into their daily practice.
Content-based video retrieval is maturing to the point where it can be used in real-world retrieval practices. One such practice is the audiovisual archive, whose users increasingly require fine-grained access to broadcast television content. In this paper, we take into account the information needs and retrieval data already present in the audiovisual archive, and demonstrate that retrieval performance can be significantly improved when content-based methods are applied to search. To the best of our knowledge, this is the first time that the practice of an audiovisual archive has been taken into account for quantitative retrieval evaluation. To arrive at our main result, we propose an evaluation methodology tailored to the specific needs and circumstances of the audiovisual archive, which are typically missed by existing evaluation initiatives. We utilize logged searches, content purchases, session information, and simulators to create realistic query sets and relevance judgments. To reflect the retrieval practice of both the archive and the video retrieval community as closely as possible, our experiments with three video search engines incorporate archive-created catalog entries as well as state-of-the-art multimedia content analysis results. A detailed query-level analysis indicates that individual content-based retrieval methods such as transcript-based retrieval and concept-based retrieval yield approximately equal performance gains. When combined, we find that content-based video retrieval incorporated into the archives practice results in significant performance increases for shot retrieval and for retrieving entire television programs. The time has come for audiovisual archives to start accommodating content-based video retrieval methods into their daily practice.
SIGIR 2012 Workshop on Time-Aware Information Access
May 19, 2012 13:55 Filed in: SIGIR 2012
Web
content increasingly reflects the current state of the
physical and social world, manifested both in
traditional news media sources along with
user-generated publishing sites such as Twitter,
Foursquare, and Facebook. At the same time, web
searching increasingly reflects problems grounded in
the real world.
As a result of this blending of the web with the real world, we observe that the web, both in its composition and use, has incorporated many of the dynamics of the real world. Many of the problems associated with searching dynamic collections are not well understood, such as defining time-sensitive relevance, understanding user query behavior over time and understanding why certain web content changes.
TAIA2012 aims to bring together practitioners and researchers to discuss their recent breakthroughs and the challenges with addressing time-aware search, both from the algorithmic and the architectural perspectives.
Deadline for submissions: June 4, 2012.
See http://bit.ly/TAIA2012 for details.
As a result of this blending of the web with the real world, we observe that the web, both in its composition and use, has incorporated many of the dynamics of the real world. Many of the problems associated with searching dynamic collections are not well understood, such as defining time-sensitive relevance, understanding user query behavior over time and understanding why certain web content changes.
TAIA2012 aims to bring together practitioners and researchers to discuss their recent breakthroughs and the challenges with addressing time-aware search, both from the algorithmic and the architectural perspectives.
Deadline for submissions: June 4, 2012.
See http://bit.ly/TAIA2012 for details.