Online Learning with Bayesian Classification Trees

Conf. on Computer Vision and Pattern Recognition (CVPR) 2016 /
By Samuel Rota Bulò, Peter Kontschieder


Randomized classification trees are among the most popular machine learning tools and found successful applications in many areas. Although this classifier was originally designed as offline learning algorithm, there has been an increased interest in the last years to provide an online variant. In this paper, we propose an online learning algorithm for classification trees that adheres to Bayesian principles. In contrast to state-of-the-art approaches that produce large forests with complex trees, we aim at constructing small ensembles consisting of shallow trees with high generalization capabilities. Experiments on benchmark machine learning and body part recognition datasets show superior performance over state-of-the-art approaches.

Examples for body part recognition, showing pairs of ground truth (left) with obtained results (right).