×

Regularization matrices for discrete ill-posed problems in several space dimensions. (English) Zbl 1513.65112

Summary: Many applications in science and engineering require the solution of large linear discrete ill-posed problems that are obtained by the discretization of a Fredholm integral equation of the first kind in several space dimensions. The matrix that defines these problems is very ill conditioned and generally numerically singular, and the right-hand side, which represents measured data, is typically contaminated by measurement error. Straightforward solution of these problems is generally not meaningful due to severe error propagation. Tikhonov regularization seeks to alleviate this difficulty by replacing the given linear discrete ill-posed problem by a penalized least-squares problem, whose solution is less sensitive to the error in the right-hand side and to roundoff errors introduced during the computations. This paper discusses the construction of penalty terms that are determined by solving a matrix nearness problem. These penalty terms allow partial transformation to standard form of Tikhonov regularization problems that stem from the discretization of integral equations on a cube in several space dimensions.

MSC:

65F22 Ill-posedness and regularization problems in numerical linear algebra
65K10 Numerical optimization and variational techniques

References:

[1] BrezinskiC, Redivo-ZagliaM, RodriguezG, SeatzuS. Extrapolation techniques for ill‐conditioned linear systems. Numer Math. 1998;81:1-29. · Zbl 0921.65032
[2] EnglHW, HankeM, NeubauerA. Regularization of inverse problems. Dordrecht: Kluwer; 1996. · Zbl 0859.65054
[3] HansenPC. Rank‐deficient and discrete ill‐posed problems. Philadelphia: SIAM; 1998.
[4] CalvettiD, ReichelL, ShuibiA. Invertible smoothing preconditioners for linear discrete ill‐posed problems. Appl Numer Math. 2005;54:135-149. · Zbl 1072.65057
[5] DonatelliM, NeumanA, ReichelL. Square regularization matrices for large linear discrete ill‐posed problems. Numer Linear Algebra Appl. 2012;19:896-913. · Zbl 1289.65096
[6] GazzolaS, NovatiP, RussoMR. On Krylov projection methods and Tikhonov regularization. Electron Trans Numer Anal. 2015;44:83-123. · Zbl 1312.65065
[7] ReichelL, YeQ. Simple square smoothing regularization operators. Electron Trans Numer Anal. 2009;33:63-83. · Zbl 1171.65033
[8] BouhamidiA, JbilouK. Sylvester Tikhonov‐regularization methods in image restoration. J Comput Appl Math. 2007;206:86-98. · Zbl 1131.65036
[9] DonatelliM, ReichelL. Square smoothing regularization matrices with accurate boundary conditions. J Comput Appl Math. 2014;272:334-349. · Zbl 1294.65099
[10] HansenPC, JensenTK. Smoothing norm preconditioning for regularizing minimum residual methods. SIAM J Matrix Anal Appl. 2006;29:1-14. · Zbl 1154.65028
[11] KilmerME, HansenPC, EspañolMI. A projection‐based approach to general‐form Tikhonov regularization. SIAM J Sci Comput. 2007;29:315-330. · Zbl 1140.65030
[12] MorigiS, ReichelL, SgallariF. Orthogonal projection regularization operators. Numer Algoritm. 2007;44:99-114. · Zbl 1124.65043
[13] NoscheseS, ReichelL. Inverse problems for regularization matrices. Numer Algoritm. 2012;60:531-544. · Zbl 1254.65053
[14] ReichelL, YuX. Tikhonov regularization via flexible Arnoldi reduction. BIT. 2015;55:1145-1168. · Zbl 1332.65058
[15] HuangG, NoscheseS, ReichelL. Regularization matrices determined by matrix nearness problems. Linear Algebra Appl. 2016;502:41-57. · Zbl 1338.65296
[16] CalvettiD, LewisB, ReichelL. A hybrid GMRES and TV‐norm based method for image restoration. In Advanced Signal Processing Algorithms, Architectures, and Implementations XII. In: LukFT (ed.), editor. Proceedings of the Society of Photo‐Optical Instrumentation Engineers (SPIE). Vol. 4791. Bellingham, WA: The International Society for Optical Engineering, 2002; p. 192-200.
[17] HochstenbachME, ReichelL, YuX. A Golub-Kahan‐type reduction method for matrix pairs. J Sci Comput. 2015;65:767-789. · Zbl 1329.65082
[18] LanzaA, MorigiS, ReichelL, SgallariF. A generalized Krylov subspace method for ℓ_p‐ℓ_q minimization. SIAM J Sci Comput. 2015;37:S30-S50. · Zbl 1343.65077
[19] ReichelL, YuX. Matrix decompositions for Tikhonov regularization. Electron Trans Numer Anal. 2015;43:223-243. · Zbl 1327.65076
[20] HornRA, JohnsonCR. Topics in matrix analysis. Cambridge: Cambridge University Press; 1991. · Zbl 0729.15001
[21] LewisB, ReichelL. Arnoldi-Tikhonov regularization methods. J Comput Appl Math. 2009;226:92-102. · Zbl 1166.65016
[22] DykesL, NoscheseS, ReichelL. Rescaling the GSVD with application to ill‐posed problems. Numer Algoritm. 2015;68:531-545. · Zbl 1314.65058
[23] JbilouK, MessaoudiA, SadokH. Global FOM and GMRES algorithms for matrix equations. Appl Numer Math. 1999;31:49-63. · Zbl 0935.65024
[24] JbilouK, SadokH, TinzefteA. Oblique projection methods for linear systems with multiple right‐hand sides. Electron Trans Numer Anal. 2005;20:119-138. · Zbl 1121.65313
[25] HochstenbachME, ReichelL. An iterative method for Tikhonov regularization with a general linear regularization operator. J Integral Equations Appl. 2010;22:463-480.
[26] KindermannS. Convergence analysis of minimization‐based noise level‐free parameter choice rules for linear ill‐posed problems. Electron Trans Numer Anal. 2011;38:233-257. · Zbl 1287.65043
[27] ReichelL, RodriguezG. Old and new parameter choice rules for discrete ill‐posed problems. Numer Algoritm. 2013;63:65-87. · Zbl 1267.65045
[28] HansenPC. Regularization tools version 4.0 for MATLAB 7.3. Numer Algoritm. 2007;46:189-194. · Zbl 1128.65029
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.