Hierarchical Grid-Based Learning Approach for Recovering Unknown Depths in Kinect Depth Maps

Saygili G., Balim C., Kalkan H., Hendriks E. A.

10th International Conference on Image Analysis and Recognition (ICIAR), Povoa do Varzim, Portugal, 26 - 28 June 2013, vol.7950, pp.658-667 identifier identifier

  • Publication Type: Conference Paper / Full Text
  • Volume: 7950
  • Doi Number: 10.1007/978-3-642-39094-4_75
  • City: Povoa do Varzim
  • Country: Portugal
  • Page Numbers: pp.658-667
  • Süleyman Demirel University Affiliated: Yes


The Microsoft Kinect depth sensor provides depth maps of indoor environments with unknown depth gaps because of infrared (IR) reflectance properties of the objects inside the scene and occlusion. In this paper, we propose a grid-based hierarchical learning algorithm for predicting the depth values of the gaps inside the Kinect's depth map. The scene is divided into hierarchical grids and the depth of each grid is modeled using supervised learning. The learned models can be directly applied to upcoming frames without repeating the learning procedure and occluded regions in the background can be recovered. The proposed algorithm outperforms an inpainting-based approach quantitatively and successfully recovers the objects that are occluded at the background.