×

Digital affine shear transforms: fast realization and applications in image/video processing. (English) Zbl 1387.94025

Shearlets, like their curvelet predecessors, can capture variation over low dimensional sets more effectively than wavelets, which can capture pointwise variation succinctly, but require more coefficients to encode variation along a curve, surface, etc. In contrast to curvelets, shearlets have a group structure generated by parabolic dilation, translation, and shear, and are akin to wavelets in this sense. Earlier work of the author showed that an affine shear tight frame can be regarded as a subsampled system of an affine wavelet tight frame that has an MRA structure.
One writes \(f_{U;k}=|\det{U}|^{1/2} f(Ux-k)\) for \(k, x\in\mathbb{R}^d\) and \(U\) a \(d\times d\) matrix. Specific matrices appearing in wavelet and shearlet systems include \(A_\lambda=\text{diag}(\lambda^2,\lambda I_{d-1})\); \(M_\lambda=\lambda^2 I_d\); \(E_n\), a block matrix whose \(n\times n\) upper-left block has \((n-k)\)-th column equal to the \(k\)th column of \(I_n\), whose lower right \((d-n)\times (d-n)\) block is \(I_{d-n}\), and whose remaining blocks are zero; \(D_\lambda=\text{diag}(1, \lambda I_{d-1})\); and \(S^{\vec\tau}\), the \(d\times d\) matrix whose first row is \((1,\vec\tau)\) and whose other rows are the corresponding rows of \(I_d\) where \(\vec\tau=(\tau_2,\dots, \tau_d)\in \mathbb{R}^{d-1}\).
A (quasi-stationary) \(d\)-dimensional affine wavelet system consists of all shifts by \(k\in\mathbb{Z}^d\) of the generators \[ \text{AS}(\varphi, \{\Psi_j\}_{J}^\infty )= \{\varphi_{M_\lambda^J}\, \} \cup\{\psi_{S^{-\vec\ell}A^{j}_\lambda E_n}^{j,\vec{\ell}}: n=1,\dots, d,|\vec\ell|\leq \vec{s}_j\}_{j=J}^\infty \] with particular choices \(\vec{s}_j\in \mathbb{N}_0^{d-1}\) and \(\lambda>0\).
A (quasi-stationary) \(d\)-dimensional affine wavelet system consists of all shifts by \(k\in\mathbb{Z}^d\) of the generators \[ \text{WS}(\varphi^{J},{\Psi}_j\}_{j=J}^\infty =\{\varphi_{M_{\lambda}^J},\, \cup \psi_{M_\lambda^J E_{n}}^{j,\vec{\ell}}: n=1,\dots, d,|\vec\ell|\leq \vec{s}_j\}_{j=J}^\infty \]
It is shown in Theorem 2.1 that the affine shearlet system \(\text{AS}(\varphi, \{\Psi_j\}_{j=J}^\infty\) forms a tight frame if certain Fourier domain identities apply to the generators. In Sect. 2.2 systems of generators satisfying the desired identities are constructed starting from a regular partition of unity in frequency. Theorem 2.3 shows that \(\text{AS}(\varphi, \{\Psi_j\}_{j=J}^\infty)\) generates an affine shearlet tight frame if and only if \(\text{WS}(\varphi^{J},\Psi_j\}_{j=J}^\infty)\) generates an affine wavelet tight frame, starting from some base scale \(J_0\), provided frequency supports of different generators are disjoint. The relation between wavelet and shearlet generators is \(\psi^{j,\vec\ell}=\lambda^{-(d-1)j}\psi^{j,\vec\ell}(S^{-\vec\ell}D_\lambda^{-j}\cdot)\).
Section 3 focuses on developing the frame criteria in discrete coordinates starting from a fixed sample scale. The decomposition and reconstruction steps for the digital affine shearlet stransform are laid out in Algorithms 1 and 2 and redundancy rates are estimated essentially by \(d 2^d\), but are shown to be lower in practice. Main computations are done in the discrete Fourier domain. Performance in denoising or inpainting applications is reported in terms of PNSR, defined as \(\text{PNSR}(u,\tilde u)= 10\log_{10} \Bigl(\frac{255^2}{\text{MSE}(u,\tilde u)}\Bigr)\) where \(u\) is a denoised or inpainted approximate reconstruction. In Sect. 4, the author’s implementation (DAS) is compared with the dual-tree complex wavelet transform (DT-\(\mathbb{C}\)WT), standard shearlet transform (DNST), curvelets (FDCT) and another inpainting system (TP-\(\mathbb{C}\)TF\(_6\)), and shows consistent results with these systems at different noise levels with moderate improvement in most cases studied.

MSC:

94A08 Image processing (compression, reconstruction, etc.) in information and communication theory
94A12 Signal theory (characterization, reconstruction, filtering, etc.)
42B05 Fourier series and coefficients in several variables
42C40 Nontrigonometric harmonic analysis involving wavelets and other special systems
65T60 Numerical methods for wavelets
68U10 Computing methodologies for image processing
68W35 Hardware implementations of nonnumerical algorithms (VLSI algorithms, etc.)
68W40 Analysis of algorithms
41A25 Rate of convergence, degree of approximation
Full Text: DOI

References:

[1] B. G. Bodmann, G. Kutyniok, and X. Zhuang, {\it Gabor shearlets}, Appl. Comput. Harmon. Anal., 38 (2015), pp. 87-114. · Zbl 1304.42084
[2] E. J. Candès and D. L. Donoho, {\it New tight frames of curvelets and optimal representations of objects with piecewise \(C^2\) singularities}, Comm. Pure Appl. Math., 57 (2004), pp. 219-266. · Zbl 1038.94502
[3] E. J. Candès, L. Demannet, D. Donoho, and L. Ying, {\it Fast discrete curvelet transforms}, Multiscale Model. Simul., 5 (2006), pp. 861-899. · Zbl 1122.65134
[4] C. K. Chui, {\it An Introduction to Wavelets}, Academic Press, New York, 1992. · Zbl 0925.42016
[5] A. L. Cunha, J. Zhou, and M. N. Do, {\it The nonsubsampled contourlet transform: Theory, design, and applications}, IEEE Trans. Image Process., 15 (2006), pp. 3089-3101.
[6] I. Daubechies, {\it Ten Lectures on Wavelets}, CBMS-NSF Regional Conf. Ser. in Appl. Math. 61, SIAM, Philadelphia, PA, 1992. · Zbl 0776.42018
[7] D. L. Donoho, {\it Sparse components of images and optimal atomic decomposition}, Constr. Approx., 17 (2001), pp. 353-382. · Zbl 0995.65150
[8] G. Easley, D. Labate, and W. Lim, {\it Sparse directional image representations using the discrete shearlet transform}, Appl. Comput. Harmon. Anal., 25 (2008), pp. 25-46. · Zbl 1147.68794
[9] K. Guo, D. Labate, W. Lim, G. Weiss, and E. Wilson, {\it Wavelets with composite dilations}, Electron. Res. Annount. AMS, 10 (2004), pp. 78-87. · Zbl 1066.42023
[10] K. Guo, G. Kutyniok, and D. Labate, {\it Sparse multidimensional representations using anisotropic dilation and shear operators}, in Wavelets and Splines (Athens, GA, 2005), Nashboro Press, Nashville, TN, 2006, pp. 189-201. · Zbl 1099.65148
[11] K. Guo and D. Labate, {\it Optimal sparse multidimensional representation using shearlets}, SIAM J. Math. Anal., 9 (2007), pp. 298-318. · Zbl 1197.42017
[12] K. Guo and D. Labate, {\it The construction of smooth Parseval frames of shearlets}, Math. Model. Nat. Phenom., 8 (2013), pp. 82-105. · Zbl 1266.42076
[13] B. Han, {\it On dual wavelet tight frames}, Appl. Comput. Harmon. Anal., 4 (1997), pp. 380-413. · Zbl 0880.42017
[14] B. Han, {\it Nonhomogeneous wavelet systems in high dimensions}, Appl. Comput. Harmon. Anal., 32 (2012), pp. 169-196. · Zbl 1241.42028
[15] B. Han, {\it Properties of discrete framelet transforms}, Math. Model. Nat. Phenom., 8 (2013), pp. 18-47. · Zbl 1268.42073
[16] S. Häuser and G. Steidl, {\it Fast Finite Shearlet Transform: A Tutorial}, arXiv:1202.1773, 2014.
[17] B. Han and Z. Zhao, {\it Tensor product complex tight framelets with increasing directionality}, SIAM J. Imaging Sci., 7 (2014), pp. 997-1034. · Zbl 1295.42023
[18] B. Han, Z. Zhao, and X. Zhuang, {\it Directional tensor product complex tight framelets with low redundancy}, Appl. Comput. Harmon. Anal., 41 (2016), pp. 603-637. · Zbl 1346.42046
[19] B. Han and X. Zhuang, {\it Smooth affine shear tight frames with MRA structures}, Appl. Comput. Harmon. Anal., 39 (2015), pp. 300-338. · Zbl 1393.42032
[20] E. J. King, G. Kutyniok, and X. Zhuang, {\it Analysis of data separation and recovery problems using clustered sparsity}, J. Math. Imaging Vision, 48 (2014), pp. 205-234. · Zbl 1362.94007
[21] G. Kutyniok, M. Sharam, and X. Zhuang, {\it ShearLab: A rational design of a digital parabolic scaling algorithm}, SIAM J. Imaging Sci., 5 (2012), pp. 1291-1332. · Zbl 1257.42048
[22] W.-Q. Lim, {\it Nonseparable shearlet transform}, IEEE Trans. Image Process., 22 (2013), pp. 2056-2065. · Zbl 1373.94251
[23] Y. M. Lu and M. N. Do, {\it Multidimensional directional filter banks and surfacelets}, IEEE Trans. Image Process., 16 (2007), pp. 918-931.
[24] S. Mallat, {\it A Wavelet Tour of Signal Processing}, Academic Press, New York, 2008. · Zbl 0998.94510
[25] P. S. Negi and D. Labate, 3{\it -D discrete shearlet transform and video processing}, IEEE Trans. Image Process., 21 (2012), pp. 2944-2954. · Zbl 1373.94518
[26] I. W. Selesnick, R. G. Baraniuk, and N. G. Kingsbury, {\it The dual-tree complex wavelet transform}, IEEE Signal Process. Mag., 22 (2005), pp. 123-151.
[27] Y. Shen, B. Han, and E. Braverman, {\it Image Inpainting Using Directional Tensor Product Complex Tight Framelets}, arXiv:1407.3234, 2014.
[28] X. Zhuang, {\it Smooth affine shear tight frames: Digitization and applications}, in Wavelets and Sparsity XVI, Proc. SPIE 9597, SPIE, Bellingham, WA, 2015.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.