Header logo is

Learning to Filter Object Detections

2017

Conference Paper

ps


Most object detection systems consist of three stages. First, a set of individual hypotheses for object locations is generated using a proposal generating algorithm. Second, a classifier scores every generated hypothesis independently to obtain a multi-class prediction. Finally, all scored hypotheses are filtered via a non-differentiable and decoupled non-maximum suppression (NMS) post-processing step. In this paper, we propose a filtering network (FNet), a method which replaces NMS with a differentiable neural network that allows joint reasoning and re-scoring of the generated set of hypotheses per image. This formulation enables end-to-end training of the full object detection pipeline. First, we demonstrate that FNet, a feed-forward network architecture, is able to mimic NMS decisions, despite the sequential nature of NMS. We further analyze NMS failures and propose a loss formulation that is better aligned with the mean average precision (mAP) evaluation metric. We evaluate FNet on several standard detection datasets. Results surpass standard NMS on highly occluded settings of a synthetic overlapping MNIST dataset and show competitive behavior on PascalVOC2007 and KITTI detection benchmarks.

Author(s): Prokudin, Sergey and Kappler, Daniel and Nowozin, Sebastian and Gehler, Peter
Book Title: Pattern Recognition: 39th German Conference, GCPR 2017, Basel, Switzerland, September 12–15, 2017, Proceedings
Pages: 52--62
Year: 2017
Publisher: Springer International Publishing

Department(s): Perceiving Systems
Research Project(s): Efficient and Scalable Inference
Bibtex Type: Conference Paper (inproceedings)
Paper Type: Conference

DOI: 10.1007/978-3-319-66709-6_5

Address: Cham
URL: https://doi.org/10.1007/978-3-319-66709-6_5
Attachments: Paper

BibTex

@inproceedings{Prokudin2017,
  title = {Learning to Filter Object Detections},
  author = {Prokudin, Sergey and Kappler, Daniel and Nowozin, Sebastian and Gehler, Peter},
  booktitle = {Pattern Recognition: 39th German Conference, GCPR 2017, Basel, Switzerland, September 12--15, 2017, Proceedings},
  pages = {52--62},
  publisher = {Springer International Publishing},
  address = {Cham},
  year = {2017},
  doi = {10.1007/978-3-319-66709-6_5},
  url = {https://doi.org/10.1007/978-3-319-66709-6_5}
}