Radial multi-focal tensors applications to omnidirectional camera calibration. (English) Zbl 1235.68291
Summary: The 1D radial camera maps all points on a plane, containing the principal axis, onto the radial line which is the intersection of that plane and the image plane. It is a sufficiently general model to express both central and non-central cameras, since the only assumption it makes is of known center of distortion. In this paper, we study the multi-focal tensors arising out of 1D radial cameras. There exist no two-view constraints (like the fundamental matrix) for 1D radial cameras. However, the 3-view and 4-view cases are interesting. For the 4-view case we have the radial quadrifocal tensor, which has 15 d.o.f and 2 internal constraints. For the 3-view case, we have the radial trifocal tensor, which has 7 d.o.f and no internal constraints. Under the assumption of a purely rotating central camera, this can be used to do a non-parametric estimation of the radial distortion of a 1D camera. Even in the case of a non-rotating camera it can be used to do parametric estimation, assuming a planar scene. Finally we examine the mixed trifocal tensor, which models the case of two 1D radial cameras and one standard pin-hole camera. Of the above radial multifocal tensors, only the radial trifocal tensor is useful practically, since it doesn’t require any knowledge of the scene and is extremely robust. We demonstrate results based on real-images for this. For the quadrifocal tensor, too, we present a way to do a metric reconstruction of the scene and to undistort the image (given a sufficiently dense set of point-correspondences). We also show results on synthetic images. However, it must be noted that currently the quadrifocal and mixed trifocal tensors are useful only from a theoretical stand-point.
MSC:
| 68T45 | Machine vision and scene understanding |
Keywords:
calibration; non-standard cameras; auto-calibration; radial distortion; multi-view tensors; quadrifocal tensor; trifocal tensor; fish-eye lenses; catadioptric camerasSoftware:
SIFTReferences:
| [1] | Agapito, L. d., Hartley, R., & Hayman, E. (1999). Linear selfcalibration of a rotating and zooming camera. In CVPR. |
| [2] | Baker, S., & Nayar, S. (1999). A theory of single-viewpoint catadioptric image formation. I J C V, 35(2), 1–22. |
| [3] | Bakstein, H., & Pajdla, T. (2002). Panoramic mosaicing with a field of view lens. In Proc. IEEE workshop on omnidirectional vision (pp. 60–67). |
| [4] | Benosman, R., & Kang, S. B. (2001). Panoramic vision: sensors, theory and applications. Berlin: Springer. · Zbl 1027.68132 |
| [5] | Brown, D. C. (1971). Close-range camera calibration. Photogrammetric Engineering, 37(8), 855–866. |
| [6] | Devernay, F., & Faugeras, O. D. (2001). Straight lines have to be straight. Machine Vision and Applications, 13(1), 14–24. · doi:10.1007/PL00013269 |
| [7] | Espuny, F. (2007). A closed-form solution for the generic self-calibration of central cameras from two rotational flows. In VISAPP (1) (pp. 26–31). |
| [8] | Espuny, F., & Burgos Gil, J. I. (2008). Generic self-calibration of central cameras from two real rotational flows. · Zbl 1235.68262 |
| [9] | Faugeras, O. D., Quan, L., & Sturm, P. (2000). Self-calibration of a 1d projective camera and its application to the self-calibration of a 2d projective camera. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(10), 1179–1185. · doi:10.1109/34.879801 |
| [10] | Fitzgibbon, A. W. (2001). Simultaneous linear estimation of multiple view geometry and lens distortion. In CVPR01 (Vol. I, pp. 125–132). |
| [11] | Geyer, C., & Daniilidis, K. (2001). Structure and motion from uncalibrated catadioptric views. In CVPR. · Zbl 0987.68601 |
| [12] | Goshtasby, A. (1989). Correction of image deformation from lens distortion using Bezier patches. CVGIP. Image Understanding, 47(3), 385–394. |
| [13] | Grossberg, M., & Nayar, S. (2001). A general imaging model and a method for finding its parameters. In ICCV. |
| [14] | Grossmann, E., Lee, E. J., Hislop, P., Nister, D., & Stewenius, H. (2006). Are two rotational flows sufficient to calibrate a smooth non-parametric sensor? In CVPR06 (pp. 1222–1229). |
| [15] | Grossmann, E., Gaspar, J. António, & Orabona, F. (2010). Discrete camera calibration from pixel streams. Computer Vision and Image Understanding, 114, 198–209. · doi:10.1016/j.cviu.2009.03.009 |
| [16] | Hartley, R. I. (1993). Invariants of lines in space. In DARPA93 (pp. 737–744). |
| [17] | Hartley, R. (1994). Self-calibration from multiple views with a rotating camera. In ECCV (pp. 471–478). |
| [18] | Hartley, R. I., & Kang, S. B. (2007). Parameter-free radial distortion correction with center of distortion estimation. 29(8), 1309–1321. |
| [19] | Hartley, R. I., & Schaffalitzky, F. (2004). Reconstruction from projections using Grassmann tensors. In ECCV04 (Vol. I, pp. 363–375). · Zbl 1098.68775 |
| [20] | Hartley, R. I., & Zisserman, A. (2000). Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge. · Zbl 0956.68149 |
| [21] | Hughes, C., Denny, P., Glavin, M., & Jones, E. (2010a). Equidistant fish-eye calibration and rectification by vanishing point extraction. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(12), 2289–2296. · doi:10.1109/TPAMI.2010.159 |
| [22] | Hughes, C., McFeely, R., Denny, P., Glavin, M., & Jones, E. (2010b). Equidistant f-theta fish-eye perspective with application in distortion centre estimation. Image and Vision Computing, 28(3), 538–551. · doi:10.1016/j.imavis.2009.09.001 |
| [23] | Kang, S. B. (2000). Radial distortion snakes. In IAPR workshop on machine vision applications (MVA2000), Tokyo, Japan (pp. 603–606). |
| [24] | Kannala, J., & Brandt, S. (2004). A generic camera calibration method for fish-eye lenses. In ICPR. |
| [25] | Kannala, J., Brandt, S. S., & Heikkilä, J. (2008). Self-calibration of central cameras by minimizing angular error. In VISAPP (1) (pp. 28–35). |
| [26] | Li, H. D., & Hartley, R. (2006). Plane-based calibration and auto-calibration of a fish-eye camera. In ACCV06 (Vol. I, pp. 21–30). |
| [27] | Lowe, D. (2004). Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2), 91–110. · doi:10.1023/B:VISI.0000029664.99615.94 |
| [28] | Micusik, B., & Pajdla, T. (2003). Estimation of omnidirectional camera model from epipolar geometry. In CVPR03 (Vol. I, pp. 485–490). |
| [29] | Nister, D., Stewenius, H., & Grossmann, E. (2005). Non-parametric self-calibration. In JCCV (Vol. I, pp. 120–127). |
| [30] | Pollefeys, M., Koch, R., & Van Gool, L. (1999). Self-calibration and metric reconstruction in spite of varying and unknown internal camera parameters. In IJCV. |
| [31] | Quan, L., & Kanade, T. (1997). Affine structure from line correspondences with uncalibrated affine cameras. In PAMI. |
| [32] | Ramalingam, S., Sturm, P., & Lodha, S. K. (2005). Towards generic self-calibration of central cameras. In Proc. ICCV workshop on omnidirectional vision, camera networks and nonclassical cameras (OMNIVIS). |
| [33] | Ramalingam, S., Sturm, P., & Lodha, S. (2010). Generic self-calibration of central cameras. Computer Vision and Image Understanding, 114(2), 210–219. · doi:10.1016/j.cviu.2009.07.007 |
| [34] | Rufli, M., Scaramuzza, D., & Siegwart, R. (2008). Automatic detection of checkerboards on blurred and distorted images. In IEEE/RSJ international conference on intelligent robots and systems (IROS), Sept. 2008 (pp. 3121–3126). |
| [35] | Sagawa, R., Sakai, T., Echigo, T., Yagi, K., Shiba, M., Higuchi, K., Arakawa, T., & Yagi, Y. (2008). Omnidirectional vision attachment for medical endoscopes. In OMNIVIS08. |
| [36] | Scaramuzza, D., & Martinelli, A. (2006). A flexible technique for accurate omnidirectional camera calibration and structure from motion. In Proceedings of IEEE international conference on computer vision systems. |
| [37] | Shah, S., & Aggarwal, J. K. (1996). Intrinsic parameter calibration procedure for a (high-distortion) fish-eye lens camera with distortion model and accuracy estimation. Pattern Recognition, 29(11), 1175–1788. · doi:10.1016/0031-3203(96)00038-6 |
| [38] | Stein, G. P. (1997). Lens distortion calibration using point correspondences. In CVPR97 (pp. 602–608). |
| [39] | Sturm, P., & Ramalingam, S. (2004). A generic concept for camera calibration. In ECCV (Vol. 2, pp. 1–13). · Zbl 1098.68866 |
| [40] | Swaminathan, R., & Nayar, S. K. (2000). Nonmetric calibration of wide-angle lenses and polycameras. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(10), 1172–1178. · doi:10.1109/34.879797 |
| [41] | Tardif, J. P., Sturm, P. F., & Roy, S. (2006). Self-calibration of a general radially symmetric distortion model. In ECCV06 (Vol. IV, pp. 186–199). |
| [42] | Tardif, J. P., Sturm, P. F., & Roy, S. (2007). Plane-based self-calibration of radial distortion. In ICCV07 (pp. 1–8). |
| [43] | Thirthala, S., & Pollefeys, M. (2005a). Multi-view geometry of 1d radial cameras and its application to omnidirectional camera calibration. In ICCV05 (Vol. II, pp. 1539–1546). |
| [44] | Thirthala, S., & Pollefeys, M. (2005b). The radial trifocal tensor: A tool for calibrating the radial distortion of wide-angle cameras. In CVPR. |
| [45] | Thirthala, S., & Pollefeys, M. (2005c). Trifocal tensor for heterogenous cameras. In OMNIVIS05. |
| [46] | Tisseur, F., & Meerbergen, K. (2000). The quadratic eigenvalue problem (Technical Report No. 370). Manchester, England. · Zbl 0985.65028 |
| [47] | Triggs, B. (1995). Matching constraints and the joint image. In ICCV (pp. 338–343). |
| [48] | Triggs, B. (1997). Autocalibration and the absolute quadric. In CVPR (pp. 609–614). |
| [49] | Tsai, R. Y. (1987). A versatile camera calibration technique for high-accuracy 3d machine vision metrology using off-the-shelf tv cameras and lenses. IEEE Journal on Robotics and Automation, 3(4), 323–344. · doi:10.1109/JRA.1987.1087109 |
| [50] | Weng, J., Cohen, P., & Herniou, M. (1992). Camera calibration with distortion models and accuracy evaluation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(10), 965–980. · doi:10.1109/34.159901 |
| [51] | Xiong, Y., & Turkowski, K. (1997). Creating image-based vr using a self-calibrating fisheye lens. In CVPR (pp. 237–243). |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
