Video Summarization by Learning Submodular Mixtures of Objectives

Michael Gygli, Helmut Grabner, Luc Van Gool; The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015, pp. 3090-3098

Abstract


We present a novel method for summarizing raw, casually captured videos. The objective is to create a short summary that still conveys the story. It should thus be both, interesting and representative for the input video. Previous methods often used simplified assumptions and only optimized for one of these goals. Alternatively, they used hand-defined objectives that were optimized sequentially by making consecutive hard decisions. This limits their use to a particular setting. Instead, we introduce a new method that (i) uses a supervised approach in order to learn the importance of global characteristics of a summary and (ii) jointly optimizes for multiple objectives and thus creates summaries that posses multiple properties of a good summary. Experiments on two challenging and very diverse datasets demonstrate the effectiveness of our method, where we outperform or match current state-of-the-art.

Related Material


[pdf]
[bibtex]
@InProceedings{Gygli_2015_CVPR,
author = {Gygli, Michael and Grabner, Helmut and Van Gool, Luc},
title = {Video Summarization by Learning Submodular Mixtures of Objectives},
booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2015}
}