Depth completion using infinity Laplacian based on steering positive definite metric operator plus convolutional stage. (English) Zbl 07929846
Liang, Qilian (ed.) et al., Communications, signal processing, and systems. Proceedings of the 11th international conference, virtual, July 23–24, 2022. Vol. 3. Cham: Springer. Lect. Notes Electr. Eng. 874, 106-113 (2023).
Summary: Depth completion is an important task for autonomous vehicles, video games, and many others applications. Frequently depth maps present holes or data with low confidence level. This paper is devoted to the guided depth completion problem using a scene color reference image to guide the completion of a sparse depth map. In this paper we propose a model to complete the depth map based on an interpolator model and convolution stages enforcing color features of the reference image. In one hand, the interpolator we used is the infinity Laplacian (which is the simplest interpolator that holds a set of axioms). In the other hand, The convolutional stage is constructed using either Gabor filters (GF) or steering filters (SF). We tested different configuration of our proposal to find the best performance: i) SF Stage-infinity Laplacian-GF Stage. ii) SF Stage-Steering kernel-GF Stage. iii) SF Stage-infinity Laplacian (based on Steering Positive Definite Operator)-GF Stage. These models were assessed in the publicly available KITTI Depth Completion Suite. Best performance was obtained by the model iii) outperforming our model previous version, and others contemporaneous models.
For the entire collection see [Zbl 1537.94008].
For the entire collection see [Zbl 1537.94008].
MSC:
| 94A08 | Image processing (compression, reconstruction, etc.) in information and communication theory |
| 68U10 | Computing methodologies for image processing |
References:
| [1] | Caselles, V.; Igual, L.; Sander, O., An axiomatic approach to scalar data interpolation on surfaces, Numer. Math., 102, 3, 383-411 (2006) · Zbl 1092.65007 · doi:10.1007/s00211-005-0656-8 |
| [2] | Saygili, G., Van Der Maaten, L., Hendriks, E.: Hybrid kinect depth map refinement for transparent objects. In: 2014 22nd International Conference on Pattern Recognition, pp. 2751-2756 (2014). doi:10.1109/ICPR.2014.474 |
| [3] | Liu, L.; Liao, Y.; Wang, Y.; Geiger, A.; Liu, Y., Learning steering Kernels for guided depth completion, IEEE Trans. Image Process., 30, 2850-2861 (2021) · doi:10.1109/TIP.2021.3055629 |
| [4] | Minh, H., San Biagio, M., Murino, V.: Log-Hilbert-Schmidt metric between positive definite operators on Hilbert spaces. In: Proceedings of the 27th Advances in Neural Information Processing Systems, pp. 1-12 (2014) |
| [5] | Takeda, H.; Farsiu, S.; Milanfar, P., Kernel regression for image processing and reconstruction, IEEE Trans. Image Process., 16, 2, 349-366 (2007) · doi:10.1109/TIP.2006.888330 |
| [6] | Lazcano, V., Calderero, F.: Reconfigurable hybrid model convolutional stage - infinity Laplacian applied to depth completion. In: AICCC 2021: 2021 4th Artificial Intelligence and Cloud Computing Conference, pp. 108-114, December 2021 |
| [7] | Lazcano, V., Calderero, F., Ballester, C.: Biased-infinity Laplacian applied to depth completion using a balanced anisotropic metric. In: Liang, Q., Wang, W., Liu, X., Na, Z., Zhang, B. (eds.) Communications, Signal Processing, and Systems, CSPS 2021. LNEE, vol. 878. Springer, Singapore (2022). doi:10.1007/978-981-19-0390-8_132 |
| [8] | Manfredi, J., Oberman, A., Svirodov, A.: Nonlinear elliptic partial differential equations and p-harmonic functions on graphs. Differ. Integr. Eqn. 28, 12 (2012) |
| [9] | Lazcano, V.; Calderero, F.; Smys, S.; Tavares, JMRS; Balas, VE, Hybrid pipeline infinity Laplacian plus convolutional stage applied to depth completion, Computational Vision and Bio-Inspired Computing, 119-134 (2022), Singapore: Springer, Singapore · doi:10.1007/978-981-16-9573-5_8 |
| [10] | Teutscher, D., Mangat, P., Wassermüller, O.: PDC: piecewise depth completion utilizing superpixels. In: IEEE International Intelligent Transportation Systems Conference (ITSC), Indianapolis, USA, pp. 2752-2758, (2021). doi:10.1109/ITSC48978.2021.9564656 |
| [11] | Uhrig, J., Schneider, N., Schneider, L., Franke, U., Brox, T., Geiger, A.: Sparsity invariant CNNs. In: International Conference on 3D Vision (3DV), pp. 11-20 (2017) |
| [12] | Lazcano, V., Calderero, F., Ballester, C.: Depth image completion using anisotropic operators. In: Proceedings of the 12th International Conference on Soft Computing and Pattern Recognition (SoCPaR 2020) (2020) |
| [13] | Yan, Z., et al.: RigNet: repetitive image guided network for depth completion. arxiv.org (2021) |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
