Modeling Mutual Visibility Relationship in Pedestrian Detection

Wanli Ouyang, Xingyu Zeng, Xiaogang Wang; The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2013, pp. 3222-3229


Detecting pedestrians in cluttered scenes is a challenging problem in computer vision. The difficulty is added when several pedestrians overlap in images and occlude each other. We observe, however, that the occlusion/visibility statuses of overlapping pedestrians provide useful mutual relationship for visibility estimation the visibility estimation of one pedestrian facilitates the visibility estimation of another. In this paper, we propose a mutual visibility deep model that jointly estimates the visibility statuses of overlapping pedestrians. The visibility relationship among pedestrians is learned from the deep model for recognizing co-existing pedestrians. Experimental results show that the mutual visibility deep model effectively improves the pedestrian detection results. Compared with existing image-based pedestrian detection approaches, our approach has the lowest average miss rate on the CaltechTrain dataset, the Caltech-Test dataset and the ETH dataset. Including mutual visibility leads to 4% 8% improvements on multiple benchmark datasets.

Related Material

author = {Ouyang, Wanli and Zeng, Xingyu and Wang, Xiaogang},
title = {Modeling Mutual Visibility Relationship in Pedestrian Detection},
booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2013}