Hierarchical Grid-Based Learning Approach for Recovering Unknown Depths in Kinect Depth Maps

Saygili G., Balim C., Kalkan H., Hendriks E. A.

10th International Conference on Image Analysis and Recognition (ICIAR), Povoa do Varzim, Portekiz, 26 - 28 Haziran 2013, cilt.7950, ss.658-667 identifier identifier

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Cilt numarası: 7950
  • Doi Numarası: 10.1007/978-3-642-39094-4_75
  • Basıldığı Şehir: Povoa do Varzim
  • Basıldığı Ülke: Portekiz
  • Sayfa Sayıları: ss.658-667


The Microsoft Kinect depth sensor provides depth maps of indoor environments with unknown depth gaps because of infrared (IR) reflectance properties of the objects inside the scene and occlusion. In this paper, we propose a grid-based hierarchical learning algorithm for predicting the depth values of the gaps inside the Kinect's depth map. The scene is divided into hierarchical grids and the depth of each grid is modeled using supervised learning. The learned models can be directly applied to upcoming frames without repeating the learning procedure and occluded regions in the background can be recovered. The proposed algorithm outperforms an inpainting-based approach quantitatively and successfully recovers the objects that are occluded at the background.