Abstract
Depth map has attracted great attention for image and video processing in recent years. Depth map gives one more dimensional information about the images besides color (intensity). Depth is independent of color, which is the advantage for extracting the background covered by objects with irregular repetitive motions e.g. rotation. A new algorithm for background extraction using Gaussian Mixture Models (GMM) combined with depth map is presented. The per-pixel mixture model and single Gaussian model are used to model the recent observation in color and depth space respectively. We also incorporate the color-depth consistency check mechanism into the algorithm to improve the accuracy. Our results show much greater robustness than prior state of the art method to handle challenging scenes.