Applications of PDEs inpainting to magnetic particle imaging and corneal topography. (English) Zbl 1447.35311
The authors provide a comprehensive review of different methods of impainting (i.e. filling the gaps in two-dimensional images) based on the solution of partial differential equations when the uncorrupted image provides co-ordinate-dependent parameters and initial conditions. As examples, these methods are applied numerically to test images, which mimics that distributions of response variables, which obtained in the course of the magnetic particles imaging (the superparamagnetic nanoparticles are used as tracers in some medium placed in the magnetic field) and the corneal topography.
Reviewer: Eugene Postnikov (Kursk)
MSC:
| 35Q68 | PDEs in connection with computer science |
| 68U10 | Computing methodologies for image processing |
| 82D80 | Statistical mechanics of nanostructures and nanoparticles |
| 92C55 | Biomedical imaging and signal processing |
| 94A08 | Image processing (compression, reconstruction, etc.) in information and communication theory |
Keywords:
PDEs inpainting; medical imaging; magnetic particle imaging; radial curvature image; anterior surface of a corneaReferences:
| [1] | ; the spline interpolation algorithm specified in the MATLABRgriddatafunction. We applied and tested the six PDEs inpainting techniques in the following two |
| [2] | L. Alvarez, F. Guichard, P.L. Lions, J.M. Morel,Axioms and fundamental equations of image processing, Arch. Ration. Mech. An.123(1993), 199-257. · Zbl 0788.68153 |
| [3] | M. Bertalmio, A.L. Bertozzi, G. Sapiro,Navier-Stokes, fluid dynamics, and image and video inpainting, Proceedings of the 2001 IEEE Computer Society Conference on |
| [4] | M. Bertalmio, G. Sapiro, V. Caselles, C. Ballester,Image Inpainting, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, ACM Press/Addison-Wesley Publishing Co. 2000, 417-424. |
| [5] | E. Bertolazzi, F. Mazzia,The object oriented C++ library QIBSH++ for Hermite quasi interpolation, 2019. |
| [6] | A. Bertozzi, S. Esedoglu, A. Gillette,Analysis of a two-scale Cahn-Hilliard model for binary image inpainting, Multiscale Model. Sim.6(2007), 913-936. · Zbl 1149.35309 |
| [7] | A. Blake, A. Zisserman,Visual reconstruction, Artificial Intelligence Series, The MIT Press, 2003. |
| [8] | J. Bosch, M. Stoll,A fractional inpainting model based on the vector-valued Cahn-Hilliard equation, SIAM J. Imaging Sci.8(2015), 2352-2382. · Zbl 1328.65214 |
| [9] | C. Bracco, C. Giannelli, F. Mazzia, A. Sestini,Bivariate hierarchical Hermite spline quasi-interpolation, BIT Num. Math.56(2016), 1165-1188. · Zbl 1364.65026 |
| [10] | K. Bredies, T. Pock, B. Wirth,A convex, lower semicontinuous approximation of Euler’s elastica energy, SIAM J. Math. Anal.47(2015), 566-613. · Zbl 1319.49018 |
| [11] | C. Brito-Loeza, K. Chen,Multigrid method for a modified curvature driven diffusion model for image inpainting, J. Comput. Math.26(2008), 856-875. · Zbl 1174.68006 |
| [12] | C. Brito-Loeza, K. Chen,Fast numerical algorithms for Euler’s elastica inpainting model, International Journal of Modern Mathematics5(2010), 157-182. · Zbl 1205.68475 |
| [13] | M. Burger, L. He, C.B. Schönlieb,Cahn-Hilliard inpainting and a generalization for grayvalue images, SIAM J. Imaging Sci.2(2009), 1129-1167. · Zbl 1180.49007 |
| [14] | M. Carriero, A. Leaci, F. Tomarelli,Free gradient discontinuity and image inpainting, J. Math. Sci.181(2012), 805-819. · Zbl 1260.49025 |
| [15] | V. Caselles, J.M. Morel, C. Sbert,An axiomatic approach to image interpolation, IEEE T. Image Process.7(1998), 376-386. · Zbl 0993.94504 |
| [16] | T.F. Chan, S.H. Kang, J. Shen,Euler’s elastica and curvature-based inpainting, SIAM J. Appl. Math.63(2006), 564-592. · Zbl 1028.68185 |
| [17] | L. Cherfils, H. Fakih, A. Miranville,On the Bertozzi-Esedoglu-Gillette-Cahn-Hilliard equation with logarithmic nonlinear terms, SIAM J. Imaging Sci.8(2015), 1123-1140. · Zbl 1381.35082 |
| [18] | L. Cherfils, H. Fakih, A. Miranville,A Cahn-Hilliard system with a fidelity term for color image inpainting, J. Math. Imaging Vis.54(2016), 117-131. · Zbl 1381.94014 |
| [19] | L.R. Croft, P. Goodwill, M. Ferguson, K. Krishnan, S. Conolly,Relaxation in x-space magnetic particle imaging, T.M. Buzug, J. Borgert (eds.), Magnetic Particle Imaging, vol. SPPHY 140, Springer-Verlag, Berlin Heidelberg, 2012, pp. 149-153. |
| [20] | E. De Giorgi,Area-minimizing oriented boudaries, Sem. di Mat. de Scuola Norm. Sup. Pisa, 1960-1961, 1-56 [in Italian]; Engl. transl. in: L. Ambrosio, G. Dal Maso, M. Forti, M. Miranda, S. Spagnolo (eds.),Ennio De Giorgi: Selected Papers, Springer, Berlin, |
| [21] | J. D’Errico,Interpolates (& extrapolates) nan elements in a 2d array,https://www. mathworks.com/matlabcentral/fileexchange/4551, 2012 (accessed January 23, 2017). |
| [22] | S. Esedoglu, J. Shen,Digital inpainting based on the Mumford-Shah-Euler image model, Eur. J. Appl. Math.13(2002), 353-370. · Zbl 1017.94505 |
| [23] | D. Garcia,Robust smoothing of gridded data in one and higher dimensions with missing values, Comput. Stat. Data An.54(2010), 1167-1178. · Zbl 1277.62036 |
| [24] | D. Garcia,Inpaint over missing data in 1-D, 2-D, 3-D,... ND arrays,http://it. mathworks.com/matlabcentral/fileexchange/27994-inpaint-over-missing-datain-1-d-2-d-3-d-n-d-arrays, 2017 (accessed November 20, 2017). |
| [25] | B. Gleich, J. Weizenecker,Tomographic imaging using the nonlinear response of magnetic particles, Nature435(2005), 1214-1217. |
| [26] | P.W. Goodwill, S.M. Conolly,The X-space formulation of the magnetic particle imaging process: 1-D signal, resolution, bandwidth, SNR, SAR, and magnetostimulation, IEEE |
| [27] | P.W. Goodwill, S.M. Conolly,Multidimensional X-space magnetic particle imaging, IEEE T. Med. Imaging30(2011), 1581-1590. |
| [28] | M. Grüttner, T. Knopp, J. Franke, M. Heidenreich, J. Rahmer, A. Halkola, C. Kaethner, J. Borgert, T.M. Buzug,On the formulation of the image reconstruction problem in magnetic particle imaging, Biomed. Tech.58(2013), 583-591. |
| [29] | A. Iurino,BS hermite quasi-interpolation methods for curves and surfaces, Ph.D. thesis, Dipartimento di Matematica, Università degli Studi di Bari Aldo Moro, Bari, May 2014. |
| [30] | IVIS Technologies,Corneal tomography and topography,http://www.ivistechnologies. it/presentations.php, 2017 (accessed June 5, 2017). |
| [31] | IVIS Technologies,Ivis technologies,http://www.ivistechnologies.it, 2017 (accessed June 5, 2017). |
| [32] | G. Kanizsa,Organization in Vision, Praeger Pub Text, 1979. |
| [33] | T. Knopp, T.M. Buzug,Magnetic particle imaging: an introduction to imaging principles and scanner instrumentation, Springer Science & Business Media, 2012. |
| [34] | T. Knopp, N. Gdaniec, M. Möddel,Magnetic particle imaging: From proof of principle to preclinical applications, Phys. Med. Biol.62(2017), R124-R178. |
| [35] | T. Knopp, A. Weber,Sparse reconstruction of the magnetic particle imaging system matrix, IEEE T. Med. Imaging32(2013), 1473-1480. |
| [36] | R. Lamour, F. Mazzia,Computation of consistent initial values for properly stated index 3 DAEs, BIT Num. Math.49(2009), 161-175. · Zbl 1162.65376 |
| [37] | J. Lampe, J. Bassoy, J. Rahmer, J. Weizenecker, H. Voss, B. Gleich, J. Borgert,Fast reconstruction in magnetic particle imaging, Phys. Med. Biol.57(2012), 1113-1134. |
| [38] | S. Masnou, J.M. Morel,Level lines based disocclusion, Proceedings 1998 International Conference on Image Processing, vol. 2, IEEE, 1998, pp. 259-263. |
| [39] | F. Mazzia, A. Sestini,The BS class of Hermite spline quasi-interpolants on nonuniform knot distributions, Bit Numer. Math.49(2009), 611-628. · Zbl 1181.65017 |
| [40] | F. Mazzia, A. Sestini,Quadrature formulas descending from BS Hermite spline quasi-interpolation, J. Comput. Appl. Math.236(2012), 4105-4118. · Zbl 1246.65123 |
| [41] | R.M. Mininni, A. Miranville, S. Romanelli,Higher-order Cahn-Hilliard equations with dynamic boundary conditions, J. Math. Anal. Appl.449(2017), 1321-1339. · Zbl 1366.35062 |
| [42] | L. Modica, S. Mortola,γ-convergence limit for a family of elliptic functionals, Boll. Un. Mat. Ital. A (5)14(1977), 526-529 [in Italian]. · Zbl 0364.49006 |
| [43] | L. Modica, S. Mortola,An example ofγ-convergence, Boll. Un. Mat. Ital. B (5)14(1977), 285-299 [in Italian]; Engl. transl. in: J. Jost, X. Li-Jost,Calculus of Variations, Cambridge · Zbl 0356.49008 |
| [44] | J.M. Morel, S. Solimini,Variational methods in image segmentation: with seven image processing experiments, Progress in nonlinear differential equations and their applications, Birkhäuser, 1995. |
| [45] | D. Mumford, J. Shah,Optimal approximations by piecewise smooth functions and associated variational problems, Commun. Pur. Appl. Math.42(1989), 577-685. · Zbl 0691.49036 |
| [46] | R. Orendorff, D. Hensley, J. Konkle, P. Goodwill, S. Conolly,Computationally efficient image reconstruction via optimization for X-space MPI, 5th International Workshop on |
| [47] | P. Perona, J. Malik,Scale-space and edge detection using anisotropic diffusion, IEEE T. Pattern. Anal.12(1990), 629-639. |
| [48] | L.I. Rudin, S. Osher,Total variation based image restoration with free local constrains, IEEE Comput. Soc. Press 1st International Conference on Image Processing, 1994, |
| [49] | L.I. Rudin, S. Osher, E. Fatemi,Nonlinear total variation based noise removal algorithms, Physica D60(1992), 259-268. · Zbl 0780.49028 |
| [50] | C.B. Schönlieb,Higher-order total variation inpainting,https://it.mathworks.com/ matlabcentral/fileexchange/34356-higher-order-total-variation-inpainting, · Zbl 1216.94016 |
| [51] | C.B. Schönlieb,Partial differential equation methods for image inpainting, Cambridge Monographs on Applied and computational Mathematics, Cambridge University Press, 2015. · Zbl 1335.94002 |
| [52] | C.B. Schönlieb, A. Bertozzi,Unconditionally stable schemes for higher order inpainting, Commun. Math. Sci.9(2011), 413-457. · Zbl 1216.94016 |
| [53] | J. Shen, T.F. Chan,Non-texture inpainting by curvature-driven diffusions, J. Vis. Commun. Image R.12(2001), 436-449. |
| [54] | J. Shen, T.F. Chan,Mathematical models for local nontexture inpaintings, SIAM J. Appl. Math.62(2002), 1019-1043. · Zbl 1050.68157 |
| [55] | X.C Tai, J. Hahn, J. Chung,A fast algorithm for Euler’s elastica model using augmented Lagrangian method, SIAM J. Imaging Sci.4(2011), 313-344. · Zbl 1215.68262 |
| [56] | A. Tateo, A. Andrisani, A. Iurino, G. Settanni, P.F. Stifanelli, P. Larizza, F. Mazzia, R.M. Mininni, S. Tangaro, R. Bellotti,A hybrid approach for FFP velocity gridding in |
| [57] | A. Tateo, A. Iurino, G. Settanni, A. Andrisani, P.F. Stifanelli, P. Larizza, F. Mazzia, R.M. Mininni, S. Tangaro, R. Bellotti,Hybrid X-space: a new approach for MPI recon |
| [58] | L. Vese,A study in the bv space of a denoising-deblurring variational problem, Appl. Math. Opt.44(2001), 131-161. · Zbl 1003.35009 |
| [59] | Z. Wang, A.C. Bovik, H.R. Sheikh, E.P. Simoncelli,Image quality assessment: From error visibility to structural similarity, IEEE T. Image Process.13(2004), 600-612. |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
