A Comparative Study of Modern Inference Techniques for Discrete Energy Minimization Problems

J. Kappes, B. Andres, F. Hamprecht, C. Schnorr, S. Nowozin, D. Batra, S. Kim, B. Kausler, J. Lellmann, N. Komodakis, C. Rother; The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2013, pp. 1328-1335

Abstract


Seven years ago, Szeliski et al. published an influential study on energy minimization methods for Markov random fields (MRF). This study provided valuable insights in choosing the best optimization technique for certain classes of problems. While these insights remain generally useful today, the phenominal success of random field models means that the kinds of inference problems we solve have changed significantly. Specifically, the models today often include higher order interactions, flexible connectivity structures, large label-spaces of different cardinalities, or learned energy tables. To reflect these changes, we provide a modernized and enlarged study. We present an empirical comparison of 24 state-of-art techniques on a corpus of 2,300 energy minimization instances from 20 diverse computer vision applications. To ensure reproducibility, we evaluate all methods in the OpenGM2 framework and report extensive results regarding runtime and solution quality. Key insights from our study agree with the results of Szeliski et al. for the types of models they studied. However, on new and challenging types of models our findings disagree and suggest that polyhedral methods and integer programming solvers are competitive in terms of runtime and solution quality over a large range of model types.

Related Material


[pdf]
[bibtex]
@InProceedings{Kappes_2013_CVPR,
author = {Kappes, J. and Andres, B. and Hamprecht, F. and Schnorr, C. and Nowozin, S. and Batra, D. and Kim, S. and Kausler, B. and Lellmann, J. and Komodakis, N. and Rother, C.},
title = {A Comparative Study of Modern Inference Techniques for Discrete Energy Minimization Problems},
booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2013}
}