Fast phase-based registration of multimodal image data. (English) Zbl 1161.94316
Summary: An interesting problem in pattern recognition is that of image registration, which plays an important role in many vision-based recognition and motion analysis applications. Of particular interest among registration problems are multimodal registration problems, where the images exist in different feature spaces. State-of-the-art phased-based approaches to multimodal image registration methods have provided good accuracy but have high computational cost. This paper presents a fast phase-based approach to registering multimodal images for the purpose of initial coarse-grained registration. This is accomplished by simultaneously performing both globally exhaustive dynamic phase sub-cloud matching and polynomial feature space transformation estimation in the frequency domain using the fast Fourier transform (FFT). A multiscale phase-based feature extraction method is proposed that determines both the location and size of the dynamic sub-clouds being extracted. A simple outlier pruning based on resampling is used to remove false keypoint matches. The proposed phase-based approach to registration can be performed very efficiently without the need for initial estimates or equivalent keypoints from both images. Experimental results show that the proposed method can provide accuracies comparable to the state-of-the-art phase-based image registration methods for the purpose of initial coarse-grained registration while being much faster to compute.
MSC:
| 94A08 | Image processing (compression, reconstruction, etc.) in information and communication theory |
| 94A12 | Signal theory (characterization, reconstruction, filtering, etc.) |
| 65T50 | Numerical methods for discrete and fast Fourier transforms |
Keywords:
image registration; phase; fast Fourier transform; multimodal; keypoints; dynamic sub-cloudsReferences:
| [1] | Pickering, M.; Arnold, J.; Frater, M.: An adaptive search algorithm for block matching motion estimation, IEEE transactions on circuits and systems for video technology 7, No. 6, 906-912 (1997) |
| [2] | Cheung, C.; Po, L.: Adjustable partial distortion search algorithm for fast block motion estimation, IEEE transactions on circuits and systems for video technology 13, No. 1, 100-110 (2003) |
| [3] | C. Hsu, Y. Wu, A. Chen, Content-based image retrieval by feature point matching, in: Proceedings of SPIE, Storage and Retrieval for Media Databases, vol. 4315, 2001, pp. 39 – 49. |
| [4] | C. Hsu, M. Shih, Content-based image retrieval by interest-point matching and geometric hashing, in: Proceedings of SPIE, Electronic Imaging and Multimedia Technology III, vol. 4925, September 2002, pp. 80 – 90. |
| [5] | Li, W.; Leung, H.: A maximum likelihood approach for image registration using control point and intensity, IEEE transactions on image processing 13, No. 8, 1115-1127 (2004) |
| [6] | A. Collignon, F. Maes, D. Delaere, D. Vandermeulen, P. Suetens, G. Marchal, Automated multi-modality image registration based on information theory, in: Proceedings of the IPMI, 1995, pp. 263 – 274. |
| [7] | Viola, P.; Wells, W.: Alignment by maximization of mutual information, International journal of computer vision 24, No. 2, 137-154 (1997) |
| [8] | Studholme, C.; Hill, D.; Hawkes, D.: An overlap invariant entropy measure of 3D medical image alignment, Pattern recognition 32, No. 1, 71-86 (1999) |
| [9] | Chen, H.; Varshney, P.; Arora, M.: Mutual information based image registration for remote sensing data, International journal of remote sensing 24, No. 18, 3701-3706 (2003) |
| [10] | Hong, L.; Jain, A.: Integrating faces and fingerprints for personal identification, IEEE transactions on pattern analysis and machine intelligence 20, No. 12, 1295-1307 (1998) |
| [11] | Mattes, D.; Haynor, D. R.; Vesselle, H.; Lewellen, T. K.; Eubank, W.: PET-CT image registration in the chest using free-form deformations, IEEE transactions on medical imaging 22, No. 1, 120-128 (2003) |
| [12] | Chen, L.; Teo, T.; Rau, J.; Liu, J.; Hsu, W.: Building reconstruction from LIDAR data and aerial imagery, , 2846-2849 (2005) |
| [13] | Vosselman, G.: Fusion of laser scanning data, maps and aerial photographs for building reconstruction, Proceedings of the IEEE international geoscience and remote sensing symposium 1, 85-88 (2002) |
| [14] | M. Mellor, M. Brady, Non-rigid multimodal image registration using local phase, Lecture Notes in Computer Science: Medical Image Computing and Computer-Assisted Intervention, 2004, pp. 789 – 796. |
| [15] | Mellor, M.; Brady, M.: Phase mutual information as a similarity measure for registration, Media 9, 330-343 (2005) |
| [16] | Wang, C.; Sun, H.; Yada, S.; Rosenfeld, A.: Some experiments in relaxation image matching using corner features, Pattern recognition 16, 167-182 (1983) |
| [17] | Ton, J.; Jain, A.: Registering landsat images by point matching, IEEE transactions on geoscience and remote sensing 27, No. 5, 642-651 (1989) |
| [18] | Chen, Y.; Medioni, G.: Object modelling by registration of multiple range images, Image vision computing 10, No. 3, 145-155 (1992) |
| [19] | T. Jost, H. Hugli, A multi-resolution ICP with heuristic closest point search for fast and robust 3d registration of range images, in: Proceedings of the International Conference of 3D Digital Imaging and Modeling, 2003. |
| [20] | Castro, E.; Morandi, C.: Registration of translated and rotated images using finite Fourier transforms, IEEE transactions on pattern analysis and machine intelligence 9, No. 5, 700-703 (1987) |
| [21] | Reddy, B.; Chatterji, B.: An fftbased technique for translation, rotation and scale invariant image registration, IEEE transactions on image processing 5, No. 8, 1266-1271 (1996) |
| [22] | Zavorin, I.; Le Moigne, J.: Use of multiresolution wavelet feature pyramids for automatic registration of multisensor imagery, IEEE transactions on image processing 14, No. 6, 770-782 (2005) |
| [23] | Fitch, A.; Kadyrov, A.; Christmas, W.; Kittler, J.: Fast robust correlation, IEEE transactions on image processing 14, No. 8, 1063-1073 (2005) |
| [24] | Kybic, J.; Unser, M.: Fast parametric elastic image registration, IEEE transactions on image processing 12, No. 11, 1427-1442 (2003) |
| [25] | Li, Z.; Bao, Z.; Li, H.; Liao, G.: Image autocoregistration and insar interferogram estimation using joint subspace projection, IEEE transactions on image processing 44, No. 2, 288-297 (2006) |
| [26] | Orchard, J.: Efficient global weighted least-squares translation registration in the frequency domain, , 116-124 (2005) |
| [27] | Refice, A.; Bovenga, F.; Nutricato, R.: MST-based stepwise connection strategies for multipass radar data, with application to coregistration and equalization, IEEE transactions on geoscience and remote sensing 44, No. 8, 2029-2040 (2006) |
| [28] | Ali, M.; Clausi, D.: Automatic registration of SAR and visible band remote sensing images, IEEE international geoscience and remote sensing symposium 3, 1331-1333 (2002) |
| [29] | Eugenio, F.; Marques, F.; Marcello, J.: A contour-based approach to automatic and accurate registration of multitemporal and multisensor satellite imagery, Proceedings of the IEEE international geoscience and remote sensing symposium 6, 3390-3392 (2002) |
| [30] | Govindu, V.; Shekhar, C.: Alignment using distributions of local geometric properties, IEEE transactions on pattern analysis and machine intelligence 21, No. 10, 1031-1043 (1999) |
| [31] | Li, H.; Manjunath, B.; Mitra, S.: A contour-based approach to multisensor image registration, IEEE transactions on image processing 4, No. 3, 320-334 (1995) |
| [32] | Netanyahu, N.; Le Moigne, J.; Masek, J.: Georegistration of landsat data via robust matching of multiresolution features, IEEE transactions on geoscience and remote sensing 42, No. 7, 1586-1600 (2004) |
| [33] | A. Wong, W. Bishop, J. Orchard, Efficient multi-modal least-squares alignment of medical images using quasi-orientation maps, in: Proceedings of the International Conference on Image Processing, Computer Vision, and Pattern Recognition, June 2006. |
| [34] | Xiaolong, D.; Khorram, S.: A feature-based image registration algorithm using improved chain-code representation combined with invariant moments, IEEE transactions on geoscience and remote sensing 37, No. 5, Part 2, 2351-2362 (1999) |
| [35] | Wong, A.; Clausi, D.: ARRSI: automatic registration of remote sensing images, IEEE transactions on geoscience and remote sensing 45, No. 5, Part II, 1483-1493 (2007) |
| [36] | Brown, M.; Lowe, D.: Automatic panoramic image stitching using invariant features, International journal of computer vision 74, No. 1, 59-73 (2007) |
| [37] | Lowe, D.: Distinctive image features from scale-invariant keypoints, International journal of computer vision 60, No. 2, 91-110 (2004) |
| [38] | M. Oghabian, S. Mehdipour, N. Alam, The impact of RF inhomogeneity on MR image non-uniformity, in: Proceedings of the Image and Vision Computing New Zealand, 2003. |
| [39] | J. Fauqueur, N. Kingsbury, R. Anderson, Multiscale keypoint detection using the dual-tree complex wavelet transform, in: Proceedings of the IEEE Conference on Image Processing, 2006. |
| [40] | Smith, S.; Brady, J.: SUSAN — a new approach to low level image processing, International journal of computer vision 23, 45-78 (1997) |
| [41] | C. Harris, M. Plessey, A combined corner and edge detector, in: Proceedings of the 4th Alvey Vision Conference, 1988, pp. 147 – 151. |
| [42] | Trajkovic, M.; Hedley, M.: Fast corner detection, Image and vision computing 16, No. 2, 75-87 (1998) |
| [43] | A. Noble, Descriptions of Image Surfaces, Ph.D. Thesis, Oxford University, 1989. |
| [44] | P. Kovesi, Phase congruency detects corners and edges, in: Proceedings of the Australian Pattern Recognition Society Conference, 2003, pp. 309 – 318. |
| [45] | Essannouni, F.; Thami, R. Oulad Haj; Salam, A.; Aboutajdine, D.: An efficient fast full search block matching algorithm using FFT algorithms, International journal of computer science and network security 6, No. 3B, 130-133 (2006) |
| [46] | S. Heldmann, O. Mahnke, D. Potts, J. Modersitzki, B. Fischer, Fast computation of mutual information in a variational image registration approach, in: Proceedings of the BVM, 2004, pp. 448 – 452. |
| [47] | Fischler, M.; Bolles, R.: Random sample consensus: a paradigm for model Fitting with applications to image analysis and automated cartography, Communications of the ACM 24, 381-395 (1981) |
| [48] | Stewart, C.: Robust parameter estimation in computer vision, SIAM review 41, No. 3, 513-537 (1999) · Zbl 0933.68144 · doi:10.1137/S0036144598345802 |
| [49] | Arun, K.; Huang, T.; Blostein, S.: Least-squares Fitting of two 3-D point sets, IEEE transactions on pattern analysis and machine intelligence 9, No. 5, 698-700 (1987) |
| [50] | Umeyama, S.: Least-squares estimation of transformation parameters between two point patterns, IEEE transactions on pattern analysis and machine intelligence 13, No. 4, 376-380 (1991) |
| [51] | Hartley, R.; Zisserman, A.: Multiple view geometry in computer vision, (2001) · Zbl 0956.68149 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
