Self-recalibration of a structured light system via plane-based homography. (English) Zbl 1158.68536
Summary: Self-recalibration of the relative pose in a vision system plays a very important role in many applications and much research has been conducted on this issue over the years. However, most existing methods require information of some points in general three-dimensional positions for the calibration, which is hard to be met in many practical applications. In this paper, we present a new method for the self-recalibration of a structured light system by a single image in the presence of a planar surface in the scene. Assuming that the intrinsic parameters of the camera and the projector are known from initial calibration, we show that their relative position and orientation can be determined automatically from four projection correspondences between an image and a projection plane. In this method, analytical solutions are obtained from second order equations with a single variable and the optimization process is very fast. Another advantage is the enhanced robustness in implementation via the use of over constrained systems. Computer simulations and real data experiments are carried out to validate our method.
MSC:
| 68U10 | Computing methodologies for image processing |
Keywords:
self-recalibration; plane-based homography; eigenvalue decomposition; relative pose; cheirality constraint; structured light systemReferences:
| [1] | Huang, T. S.; Netravali, A. N., Motion and structure from feature correspondences: a review, Proc. IEEE, 82, 2, 252-268 (1994) |
| [2] | Zhang, Z.; Luong, Q.-T.; Faugeras, O., Motion of an uncalibrated stereo rig: self-calibration and metric reconstruction, IEEE Trans. Robot. Autom., 12, 1, 103-113 (1996) |
| [3] | Zomet, A.; Wolf, L.; Shashua, A., Omni-rig: linear self-recalibration of a rig with varying internal and external parameters, Proc. 8th IEEE Int. Conf. Comput. Vision, 1, 135-141 (2001) |
| [4] | R. Hartley, R. Gupta, T. Chang, Stereo from uncalibrated cameras, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, Urbana, IL, 1992, pp. 761-764.; R. Hartley, R. Gupta, T. Chang, Stereo from uncalibrated cameras, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, Urbana, IL, 1992, pp. 761-764. |
| [5] | Faugeras, O., What can be seen in three dimensions with an uncalibrated stereo rig?, (Santa Margherita, L., IEEE Proceedings of the European Conference on Computer Vision (1992)), 563-578 |
| [6] | Vieville, T.; Zeller, C.; Robert, L., Using collineations to compute motion and structure in an uncalibrated image sequence, Int. J. Comput. Vision, 20, 3, 213-242 (1996) |
| [7] | Pollefeys, M.; Van Gool, L., A stratified approach to metric selfcalibration, (IEEE Proceedings of the Conference on Computer Vision and Pattern Recognition (1997), Puerto Rico), 407-412 |
| [8] | Longuet-Higgins, H. C., A computer algorithm for reconstructing a scene from two projections, Nature, 293, 10, 133-135 (1981) |
| [9] | Nister, D., An efficient solution to the five-point relative pose problem, IEEE Trans. Pattern Anal. Mach. Intell., 26, 6, 756-770 (2004) |
| [10] | J. Philip, Critical Point Configurations of the 5-, 6-, 7-, and 8-point Algorithms for Relative Orientation, TRITA-MAT-1998-MA-13, February, 1998.; J. Philip, Critical Point Configurations of the 5-, 6-, 7-, and 8-point Algorithms for Relative Orientation, TRITA-MAT-1998-MA-13, February, 1998. |
| [11] | Hay, J. C., Optical motion and space perception: an extension of Gibson’s analysis, Psychol. Rev., 73, 6, 550-565 (1966) |
| [12] | Tsai, R.; Huang, T., Estimating three-dimensional motion parameters of a rigid planar patch, IEEE Trans. Acoust. Speech and Signal Process, ASSP-29, 525-534 (1981) |
| [13] | Tsai, R.; Huang, T.; Zhu, W., Estimating three dimensional motion parameters of a rigid planar patch, II: singular value decomposition, IEEE Trans. Acoust. Speech Signal Process, ASSP-30, 525-534 (1982) |
| [14] | Longuet-Higgins, H. C., The visual ambiguity of a moving plane, Proc. Roy. Soc. London Series B, 223, 1231, 165-175 (1984) |
| [15] | Longuet-Higgins, H. C., The reconstruction of a plane surface from two perspective projections, Proc. Roy. Soc. London Series B, 227, 1249, 399-410 (1986) |
| [16] | Z. Zhang, A.R. Hanson, Scaled Euclidean 3D reconstruction based on externally uncalibrated cameras, in: IEEE International Symposium on Computer Vision, Coral Gables, FL, November 1995, pp. 37-42.; Z. Zhang, A.R. Hanson, Scaled Euclidean 3D reconstruction based on externally uncalibrated cameras, in: IEEE International Symposium on Computer Vision, Coral Gables, FL, November 1995, pp. 37-42. |
| [17] | Chen, S. Y.; Li, Y. F., Self-recalibration of a color-encoded light system for automated three-dimensional measurements, Meas. Sci. Technol., 14, 1, 33-40 (2003) |
| [18] | Zhang, B.; Li, Y. F., Dynamic recalibration of an active vision system via generic homography, (Proceedings of IEEE International Conference on Robotics and Automation (April 2005), Barcelona: Barcelona Spain), 3917-3922 |
| [19] | Negahdaripour, S., Closed form relationship between the two interpretations of a moving plane, J. Opt. Soc. Am., 7, 2, 279-285 (1990) |
| [20] | Negahdaripour, S., Multiple interpretations of the shape and motion of objects from two perspective images, IEEE Trans. Pattern Anal. Mach. Intell., 12, 11, 1025-1039 (1990) |
| [21] | Hartley, Richard, Chirality, Int. J. Comput. Vision, 26, 1, 41-61 (1998) |
| [22] | Maybank, S., Theory of Reconstruction from Image Motion (1992), Springer: Springer New York, Inc., Secaucus, NJ |
| [23] | T. Tian, C. Tomasi, D. Heeger, Comparison of approaches to egomotion computation, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, June 1996, pp. 315-320.; T. Tian, C. Tomasi, D. Heeger, Comparison of approaches to egomotion computation, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, June 1996, pp. 315-320. |
| [24] | Hartley, R. I., Estimation of Relative Camera Positions for Uncalibrated Cameras (1992), ECCV, pp. 579-587 |
| [25] | Griffin, P. M.; Narasimhan, L. S.; Yee, S. R., Generation of uniquely encoded light patterns for range data acquisition, Pattern Recognition, 25, 6, 609-616 (1992) |
| [26] | Zhang, Z., A flexible new technique for camera calibration, IEEE Trans. Pattern Anal. Mach. Intell., 22, 11, 1330-1334 (2000) |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
