Robust Object Tracking Based on Tracking-Learning-Detection

Georg Nebehay


Current state-of-the-art methods for object tracking perform adaptive tracking-by-detection, meaning that a detector predicts the position of an object and adapts its parameters to the object's appearance at the same time. While suitable for cases when the object does not disappear from the scene, these methods tend to fail on occlusions. In this work, we build on a novel approach called Tracking-Learning-Detection (TLD) that overcomes this problem. In methods based on TLD, a detector is trained with examples found on the trajectory of a tracker that itself does not depend on the object detector. By decoupling object tracking and object detection we achieve high robustness and outperform existing adaptive tracking-by-detection methods. We show that by using simple features for object detection and by employing a cascaded approach a considerable reduction of computing time is achieved. We evaluate our approach both on existing standard single-camera datasets as well as on newly recorded sequences in multi-camera scenarios.

Published In

Master's thesis, 2012.
Download the PDF PDF logo


Download the code from our GitHub repository.GitHub logo

Project Page

More information is available at the Project page.


    author = {Nebehay, G.},
    school = {Faculty of Informatics, TU Vienna},
    title = {Robust Object Tracking Based on {Tracking-Learning}-Detection},
    year = {2012}
Back to publication list