×

A robust multigrid approach for variational image registration models. (English) Zbl 1236.94018

Summary: Variational registration models are non-rigid and deformable imaging techniques for accurate registration of two images. As with other models for inverse problems using the Tikhonov regularization, they must have a suitably chosen regularization term as well as a data fitting term. One distinct feature of registration models is that their fitting term is always highly nonlinear and this nonlinearity restricts the class of numerical methods that are applicable. This paper first reviews the current state-of-the-art numerical methods for such models and observes that the nonlinear fitting term is mostly ’avoided’ in developing fast multigrid methods. It then proposes a unified approach for designing fixed point type smoothers for multigrid methods. The diffusion registration model (second-order equations) and a curvature model (fourth-order equations) are used to illustrate our robust methodology. Analysis of the proposed smoothers and comparisons to other methods are given. As expected of a multigrid method, being many orders of magnitude faster than the unilevel gradient descent approach, the proposed numerical approach delivers fast and accurate results for a range of synthetic and real test images.

MSC:

94A08 Image processing (compression, reconstruction, etc.) in information and communication theory
65F10 Iterative numerical methods for linear systems
65M55 Multigrid methods; domain decomposition for initial value and initial-boundary value problems involving PDEs
68U10 Computing methodologies for image processing

Software:

LFA
Full Text: DOI

References:

[1] Maintz, J.; Viergever, M., A survey of medical image registration, Med. Image Analysis, 2, 1, 1-36 (1998)
[2] Hajnal, J.; Hill, D.; Hawkes, D., (Medical Image Registration. Medical Image Registration, The Biomedical Engineering Series (2001), CRC Press)
[3] J. Modersitzki, Numerical Methods for Image Registration, Oxford, 2004.; J. Modersitzki, Numerical Methods for Image Registration, Oxford, 2004. · Zbl 1055.68140
[4] Fischer, B.; Modersitzki, J., Fast diffusion registration, Contemporary Mathematics, 313, 117-129 (2002) · Zbl 1047.68150
[5] Fischer, B.; Modersitzki, J., Curvature based image registration, Journal of Mathematical Imaging and Vision, 18, 81-85 (2003) · Zbl 1034.68110
[6] Fischer, B.; Modersitzki, J., A unified approach to fast image registration and a new curvature based registration technique, Linear Algebra and its Applications, 380, 107-124 (2004) · Zbl 1072.68631
[7] Fischer, B.; Modersitzki, J., Ill-posed medicine—an introduction to image registration, Inverse Problems, 24, 1-19 (2008) · Zbl 1138.92347
[8] -Schauf, C. F.; Henn, S.; Hömke, L.; Witsch, K., Total variation based image registration, (Tai, X.-C.; Lie, K.-A.; Chan, T. F.; Osher, S., Proceedings of the International Conference on PDE-Based Image Processing and Related Inverse Problems Series: Mathematics and Visualization (2006), Springer Verlag), 305-323
[9] -Schauf, C. F.; Henn, S.; Witsch, K., Multigrid based total variation image registration, Comput. Visual. Sci., 11, 101-113 (2008)
[10] Gao, S.; Zhang, L.; Wang, H.; de Crevoisier, R.; Kuban, D.; Mohan, R.; Dong, L., A deformable image registration method to handle distended rectums in prostate cancer radiotherapy, Medical Physics, 33, 9, 3304-3312 (2006)
[11] Haber, E.; Modersitzki, J., Numerical solutions for volumn preserving image registration, Inverse Problems, 20, 1621-1638 (2004) · Zbl 1065.65084
[12] Haber, E.; Modersitzki, J., A multilevel method for image registration, SIAM Journal of Scientific Computing, 27, 5, 1594-1607 (2006) · Zbl 1141.65367
[13] Haber, E.; Heldmann, S.; Modersitzki, J., Adaptive mesh refinement for non parametric image registration, SIAM Journal of Scientific Computing, 30, 6, 3012-3027 (2008) · Zbl 1175.94017
[14] Henn, S.; Witsch, K., Iterative multigrid regularization techniques for image matching, SIAM Journal of Scientific Computing, 23, 4, 1077-1093 (2001) · Zbl 0999.65057
[15] Henn, S.; Witsch, K., Image registration based on multiscale energy information, Multiscale Modeling and Simulation, 4, 2, 584-609 (2005) · Zbl 1093.94004
[16] Henn, S., A multigrid method for a fourth-order diffusion equation with application to image processing, SIAM Journal of Scientific Computing, 27, 3, 831-849 (2005) · Zbl 1096.65105
[17] Hömke, L., A multigrid method for anisotropic PDEs in elastic image registration, Numerical Linear Algebra with Applications, 13, 215-229 (2006) · Zbl 1224.49051
[18] Köstler, H.; Ruhnau, K.; Wienands, R., Multigrid solution of the optical flow system using a combined diffusion- and curvature-based regularizer, Numerical Linear Algebra with Applications, 15, 201-218 (2008) · Zbl 1212.65366
[19] -Ruiz, J. L.; -Sanchez, J. M., Optimal parameters selection for non-parametric image registration methods, LNCS, 4179, 564-575 (2006)
[20] Lu, W.; Chen, M. L.; Olivera, G. H.; Ruchala, K. J.; Mackie, T. R., Fast free-form deformable registration via calculus of variations, Physics in Medicine and Biology, 49, 3067-3087 (2004)
[21] Stürmer, M.; Köstler, H.; Rüde, U., A fast full multigrid solver for applications in image processing, Numerical Linear Algebra with Applications, 15, 187-200 (2008) · Zbl 1212.65368
[22] Zikic, D.; Wein, W.; Khamene, A., Fast deformable registration of 3D-ultrasound data using a variational approach, LNCS, 4190, 915-923 (2006)
[23] Chumchob, N.; Chen, K., A variational approach for discontinuity-preserving image registration, East-West Journal of Mathematics, Special volume 2010, 266-282 (2010) · Zbl 1227.94006
[24] Chumchob, N.; Chen, K.; Brito, C., A fourth order variational image registration model and its fast multigrid algorithm, SIAM Journal of Multiscale Modeling and Simulation, 9, 89-128 (2011) · Zbl 1218.65022
[25] Rudin, L.; Osher, S.; Fatemi, E., Nonlinear total variation based noise removal algorithms, Physica D, 60, 259-268 (1992) · Zbl 0780.49028
[26] Chan, T.; Shen, J., Image Processing and Analysis — Variational, PDE, Wavelet, and Stochastic Methods (2005), SIAM Publications: SIAM Publications Philadelphia, USA · Zbl 1095.68127
[27] Chan, T.; Chen, K.; Carter, J., Iterative methods for solving the dual formulation arising from image restoration, Electronic Transactions on Numerical Analysis, 26, 299-311 (2007) · Zbl 1178.68620
[28] Chen, K.; Tai, X.-C., A nonlinear multigrid method for total variation minimization from image restoration, Journal of Scientific Computing, 32, 2, 115-138 (2007) · Zbl 1129.65046
[29] Brandt, A., Multi-level adaptive solutions to BVPs, Mathematial Computing, 31, 333-390 (1977) · Zbl 0373.65054
[30] Trottenberg, U.; Oosterlee, C.; Schuller, A., Multigrid (2001), Academic Press · Zbl 0976.65106
[31] Bruhn, A.; Weickert, J.; Feddern, C.; Kohlberger, T.; Schnörr, C., Variational optical flow computation in real time, IEEE Transactions on Image Processing, 14, 5, 608-615 (2005)
[32] Bruhn, A.; Weickert, J., Multigrid platform for real-time motion computation with discontinuity-preserving variational methods, International Journal of Computer Vision, 70, 3, 257-277 (2006) · Zbl 1477.68336
[33] Larrey-Ruiz, J.; Verdú-Monedero, R.; Morales-Sánchez, J., A fourier domain framework for variational image registration, Journal of Mathematical Imaging and Vision, 32, 57-72 (2008) · Zbl 1455.94028
[34] Verdú-Monedero, R.; Larrey-Ruiz, J., Frequency implementation of the Euler-Lagrange equations for variational image registration, IEEE Signal Processing Letters, 15, 321-324 (2008)
[35] Lu, T.; Neittaanmäki, P.; Tai, X.-C., A parallel splitting up method and its application to Navier-Stokes equations, Applied Mathematical Letters, 4, 2, 25-29 (1991) · Zbl 0718.65066
[36] Weickert, J.; ter Haar Romeny, B.; Viergever, M., Effcient and reliable schemes for nonlinear diffusion filtering, IEEE Transactions on Image Processing, 7, 398-410 (1998)
[37] Briggs, W.; Henson, V.; McCormick, S., A Multigrid Tutorial (2000), SIAM Publications: SIAM Publications Philadelphia, USA · Zbl 0958.65128
[38] Hackbusch, W., Multi-Grid Methods and Applications (1985), Springer-Verlag: Springer-Verlag Berlin, Heidelberg, New York · Zbl 0585.65030
[39] Wesseling, P., Multigrid Methods (2004), Edwards: Edwards Philadelphis, PA, USA · Zbl 0675.65100
[40] Wienands, R.; Joppich, W., Practical Fourier Analysis for Multigrid Method (2005), Chapman & Hall/CRC: Chapman & Hall/CRC USA · Zbl 1062.65133
[41] Chen, K., Matrix Preconditioning Techniques and Applications (2005), Cambridge University Press: Cambridge University Press UK · Zbl 1079.65057
[42] Badshah, N.; Chen, K., Multigrid method for the Chan-Vese model in variational segmentation, Communications in Computational Physics, 4, 2, 294-316 (2008) · Zbl 1364.65189
[43] Brito-Loeza, C.; Chen, K., Multigrid method for a modified curvature driven diffusion model for image inpainting, Journal of Computational Mathematics, 26, 6, 856-875 (2008) · Zbl 1174.68006
[44] Chan, T.; Chen, K., On a nonlinear multigrid algorithm with primal relaxation for the image total variation minimization, Journal of Numerical Algorithms, 41, 387-411 (2006) · Zbl 1096.94003
[45] -Schauf, C. F.; Henn, S.; Witsch, K., Nonlinear multigrid methods for total variation image denoising, Comput. Visual. Science, 7, 199-206 (2004) · Zbl 1071.65093
[46] Savage, J.; Chen, K., An improved and accelerated nonlinear multigrid method for total-variation denoising, International Journal of Computer Mathematics, 82, 8, 1001-1015 (2005) · Zbl 1072.65096
[47] Savage, J.; Chen, K., On multigrids for solving a class of improved total variation based staircasing reduction models, (Tai, X.-C.; Lie, K.-A.; Chan, T. F.; Osher, S., Proceedings of the International Conference on PDE-Based Image Processing and Related Inverse Problems Series: Mathematics and Visualization (2006), Springer Verlag), 69-94
[48] Bruhn, A.; Weickert, J., (Towards Ultimate Motion Estimation: Combining Highest Accuracy with Real-Time Performance. Towards Ultimate Motion Estimation: Combining Highest Accuracy with Real-Time Performance, Proceeding of 10th International Conference on Computer Vision ICCV 2005, vol. 1 (2005), IEEE Computer Society Press: IEEE Computer Society Press Beijing, People’s Republic of China), 749-755
[49] Rheinboldt, W., Methods for Solving Systems of Nonlinear Equations (1998), SIAM Publications: SIAM Publications Philadelphia, USA · Zbl 0906.65051
[50] Saad, Y., Iterative Methods for Sparse Linear Systems (2003), SIAM Publications: SIAM Publications Philadelphia, USA · Zbl 1002.65042
[51] Badshah, N.; Chen, K., On two multigrid algorithms for modelling variational multiphase image segmentation, IEEE Transactions on Image Processing, 18, 5, 1097-1106 (2009) · Zbl 1371.94041
[52] Chan, T.; Chen, K., An optimization-based multilevel algorithm for total variation image denoising, Multiscale Mod. Simu., 5, 2, 615-645 (2006) · Zbl 1120.68108
[53] Haber, E.; Horesh, R.; Modersitzki, J., Numerical optimization for constrained image registration, Numerical Linear Algebra with Applications, 17, 343-359 (2010) · Zbl 1240.94012
[54] Hamilton, S.; Benzi, M.; Haber, E., New multigrid smoothers for the oseen problem, Numerical Linear Algebra with Applications, 17, 556-576 (2010) · Zbl 1240.76003
[55] Seynaeve, B.; Rosseel, E.; Nicolaï, B.; Vandewalle, S., Fourier mode analysis of multigrid methods for partial differential equations with random coefficients, Journal of Computational Physics, 224, 132-149 (2007) · Zbl 1120.65309
[56] Chen, J.; Haber, E.; Oldenburg, D., Three-dimensional numerical modelling and inversion of magnetometric resistivity data, Geophysical Journal of Inter., 149, 3, 679-697 (2002)
[57] Chumchob, N.; Chen, K., A robust affine image registration method, International Journal of Numerical Analysis and Modeling, 6, 2, 311-334 (2009) · Zbl 1158.94302
[58] Haber, E.; Oldenburg, D., A GCV based method for nonlinear ill-posed problems, Computational Geosciences, 4, 1, 41-63 (2000) · Zbl 0947.65103
[59] Lelièvre, P.; Oldenburg, D., Magnetic forward modelling and inversion for high susceptibility, Geophysical Journal of Inter., 166, 1, 76-90 (2006)
[60] Newman, G. A.; Hoversten, G. M., Solution strategies for two- and three-dimensional electromagnetic inverse problems, Inverse Problems, 16, 1357-1375 (2000) · Zbl 0970.35166
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.