×

Design and processing of invertible orientation scores of 3D images. (English) Zbl 1433.94012

Summary: The enhancement and detection of elongated structures in noisy image data are relevant for many biomedical imaging applications. To handle complex crossing structures in 2D images, 2D orientation scores \(U: \mathbb {R} ^ 2\times S ^ 1 \to \mathbb {C}\) were introduced, which already showed their use in a variety of applications. Here we extend this work to 3D orientation scores \(U: \mathbb {R} ^ 3 \times S ^2 \to \mathbb C\). First, we construct the orientation score from a given dataset, which is achieved by an invertible coherent state type of transform. For this transformation we introduce 3D versions of the 2D cake wavelets, which are complex wavelets that can simultaneously detect oriented structures and oriented edges. Here we introduce two types of cake wavelets: the first uses a discrete Fourier transform, and the second is designed in the 3D generalized Zernike basis, allowing us to calculate analytical expressions for the spatial filters. Second, we propose a nonlinear diffusion flow on the 3D roto-translation group: crossing-preserving coherence-enhancing diffusion via orientation scores (CEDOS). Finally, we show two applications of the orientation score transformation. In the first application we apply our CEDOS algorithm to real medical image data. In the second one we develop a new tubularity measure using 3D orientation scores and apply the tubularity measure to both artificial and real medical data.

MSC:

94A08 Image processing (compression, reconstruction, etc.) in information and communication theory
42C40 Nontrigonometric harmonic analysis involving wavelets and other special systems

Software:

DLMF

References:

[1] Aarts, RM; Janssen, AJEM, On-axis and far-field sound radiation from resilient flat and dome-shaped radiators, J. Acoust. Soc. Am., 125, 1444-1455, (2009) · doi:10.1121/1.3075594
[2] Ali, ST, A general theorem on square-integrability: vector coherent states, J. Math. Phys., 39, 3954, (1998) · Zbl 0928.22013 · doi:10.1063/1.532478
[3] Ali, S.T., Antoine, J.P., Gazeau, J.P.: Coherent States, Wavelets, and Their Generalizations. Graduate Texts in Contemporary Physics. Springer, New York (2000) · Zbl 1064.81069 · doi:10.1007/978-1-4612-1258-4
[4] Antoine, JP; Murenzi, R.; Vandergheynst, P., Directional wavelets revisited: Cauchy wavelets and symmetry detection in patterns, Appl. Comput. Harmon. Anal., 6, 314-345, (1999) · Zbl 0936.42017 · doi:10.1006/acha.1998.0255
[5] Barbieri, D.; Citti, G., Reproducing kernel Hilbert spaces of CR functions for the Euclidean motion group, Anal. Appl., 13, 331-346, (2014) · Zbl 1335.46022 · doi:10.1142/S021953051450047X
[6] Barbieri, D.; Citti, G.; Cocci, G.; Sarti, A., A cortical-inspired geometry for contour perception and motion integration, J. Math. Imaging Vis., 49, 511-529, (2014) · Zbl 1291.92074 · doi:10.1007/s10851-013-0482-z
[7] Batard, T.; Sochen, N., A class of generalized laplacians on vector bundles devoted to multi-channel image processing, J. Math. Imaging Vis., 48, 517-543, (2014) · Zbl 1378.94003 · doi:10.1007/s10851-013-0426-7
[8] Bekkers, E.; Duits, R.; Mashtakov, A.; Sanguinetti, G., A PDE approach to data-driven sub-Riemannian geodesics in SE(2), SIAM J. Imaging Sci., 8, 2740-2770, (2015) · Zbl 1336.58014 · doi:10.1137/15M1018460
[9] Bekkers, E.J.: Retinal Image Analysis Using Sub-Riemannian Geometry in SE(2). Ph.D. Thesis, University of Technology, Eindhoven (2017)
[10] Bekkers, EJ; Duits, R.; Berendschot, T.; Haar Romeny, BM, A multi-orientation analysis approach to retinal vessel tracking, J. Math. Imaging Vis., 49, 583-610, (2014) · Zbl 1291.92075 · doi:10.1007/s10851-013-0488-6
[11] Bekkers, E.J., Zhang, J., Duits, R., ter Haar Romeny, B.M.: Curvature based biomarkers for diabetic retinopathy via exponential curve fits in SE(2). In: Proceedings of the Ophthalmic Medical Image Analysis First International Workshop, pp. 113-120 (2015)
[12] Born, M., Wolf, E.: Principles of Optics, 7th edn. Cambridge University Press, Cambridge (1999) · Zbl 1430.78001 · doi:10.1017/CBO9781139644181
[13] Boscain, U.; Chertovskih, RA; Gauthier, JP; Remizov, AO, Hypoelliptic diffusion and human vision: a semidiscrete new twist, SIAM J. Imaging Sci., 7, 669-695, (2014) · Zbl 1343.94002 · doi:10.1137/130924731
[14] Bouix, S.; Siddiqi, K.; Tannenbaum, A., Flux driven automatic centerline extraction, Med. Image Anal., 9, 209-221, (2005) · doi:10.1016/j.media.2004.06.026
[15] Brunner, TA, Impact of lens aberrations on optical lithography, IBM J. Res. Dev., 41, 57-67, (1997) · doi:10.1147/rd.411.0057
[16] Burgeth, B.; Didas, S.; Weickert, J.; Laidlaw, D. (ed.); Weickert, J. (ed.), A general structure tensor concept and coherence-enhancing diffusion filtering for matrix fields, 305-323, (2009), Berlin · Zbl 1171.68788 · doi:10.1007/978-3-540-88378-4_15
[17] Burgeth, B.; Pizarro, L.; Didas, S.; Weickert, J.; Florack, L. (ed.); Duits, R. (ed.); Jongbloed, G. (ed.); Lieshout, MC (ed.); Davies, L. (ed.), 3D-coherence-enhancing diffusion filtering for matrix fields, 49-63, (2012), London · Zbl 1245.94014
[18] Caruyer, E.; Lenglet, C.; Sapiro, G.; Deriche, R., Design of multishell sampling schemes with uniform coverage in diffusion MRI, Magn. Reson. Med., 69, 1534-1540, (2013) · doi:10.1002/mrm.24736
[19] Chen, D., Cohen, L.D.: Automatic vessel tree structure extraction by growing minimal paths and a mask. In: 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI), pp. 802-805 (2014)
[20] Chung, M.K.: Heat kernel smoothing on unit sphere. In: 3rd IEEE International Symposium on Biomedical Imaging: Nano to Macro, 2006, pp. 992-995 (2006)
[21] Citti, G.; Franceschiello, B.; Sanguinetti, G.; Sarti, A., Sub-Riemannian mean curvature flow for image processing, SIAM J. Imaging Sci., 9, 212-237, (2016) · Zbl 1352.68272 · doi:10.1137/15M1013572
[22] Citti, G.; Sarti, A., A cortical based model of perceptual completion in the roto-translation space, J. Math. Imaging Vis., 24, 307-326, (2006) · Zbl 1478.92100 · doi:10.1007/s10851-005-3630-2
[23] Descoteaux, M.; Angelino, E.; Fitzgibbons, S.; Deriche, R., Regularized, fast, and robust analytical Q-ball imaging, Magn. Reson. Med., 58, 497-510, (2007) · doi:10.1002/mrm.21277
[24] Dirksen, P.; Braat, JJM; Janssen, AJEM; Juffermans, CAH, Aberration retrieval using the extended Nijboer-Zernike approach, J. Microlithogr. Microfabr. Microsyst., 2, 61-67, (2003)
[25] Duits, R.: Perceptual Organization in Image Analysis. Ph.D. Thesis, Technische Universiteit Eindhoven (2005)
[26] Duits, R., Burgeth, B.: Scale spaces on lie groups. In: Scale Space and Variational Methods in Computer Vision, pp. 300-312. Springer, Berlin (2007)
[27] Duits, R.; Duits, M.; Almsick, M.; Haar Romeny, BM, Invertible orientation scores as an application of generalized wavelet theory, PRIA, 17, 42-75, (2007)
[28] Duits, R.; Felsberg, M.; Granlund, G.; Haar Romeny, BM, Image analysis and reconstruction using a wavelet transform constructed from a reducible representation of the euclidean motion group, Int. J. Comput. Vis., 72, 79-102, (2007) · doi:10.1007/s11263-006-8894-5
[29] Duits, R.; Franken, E., Left-invariant diffusions on the space of positions and orientations and their application to crossing-preserving smoothing of HARDI images, Int. J. Comput. Vis., 92, 231-264, (2010) · Zbl 1235.92032 · doi:10.1007/s11263-010-0332-z
[30] Duits, R.; Franken, E., Left-invariant parabolic evolutions on SE(2) and contour enhancement via invertible orientation scores Part I: linear left-invariant diffusion equations on SE(2), Q. Appl. Math., 68, 255-292, (2010) · Zbl 1202.35334 · doi:10.1090/S0033-569X-10-01172-0
[31] Duits, R.; Führ, H.; Janssen, B.; Bruurmijn, M.; Florack, L.; Assen, H., Evolution equations on Gabor transforms and their applications, Appl. Comput. Harmon. Anal., 35, 483-526, (2013) · Zbl 1296.35204 · doi:10.1016/j.acha.2012.11.007
[32] Duits, R.; Janssen, MHJ; Hannink, J.; Sanguinetti, GR, Locally adaptive frames in the roto-translation group and their applications in medical imaging, J. Math. Imaging Vis., 56, 367-402, (2016) · Zbl 1350.42050 · doi:10.1007/s10851-016-0641-0
[33] Dunkl, C.F.: Orthogonal Polynomials of Several Variables. Cambridge University Press, Cambridge (2014) · Zbl 1317.33001 · doi:10.1017/CBO9781107786134
[34] Faraut, J., Harzallah, K.: Deux Cours d’Analyse Harmonique. Birkhauser, Basel (1987) · Zbl 0622.43001
[35] Felsberg, Michael, Adaptive Filtering Using Channel Representations, 31-48, (2012), London · Zbl 1245.94018
[36] Franken, E.: Enhancement of Crossing Elongated Structures in Images. Ph.D. Thesis, Technische Universiteit Eindhoven (2008)
[37] Franken, E.; Duits, R., Crossing-preserving coherence-enhancing diffusion on invertible orientation scores, Int. J. Comput. Vis., 85, 253-278, (2009) · doi:10.1007/s11263-009-0213-5
[38] Freeman, WT; Adelson, EH, The design and use of steerable filters, IEEE Trans. Pattern Anal. Mach. Intell., 13, 891-906, (1991) · doi:10.1109/34.93808
[39] Führ, Hartmut, 2. Wavelet Transforms and Group Representations, 15-58, (2005), Berlin, Heidelberg · Zbl 1060.43002
[40] Gräf, M.; Potts, D., On the computation of spherical designs by a new optimization approach based on fast spherical fourier transforms, Numer. Math., 119, 699-724, (2011) · Zbl 1232.65045 · doi:10.1007/s00211-011-0399-7
[41] Griffiths, D.J.: Introduction to Quantum Mechanics, 2nd edn. Cambridge University Press, Cambridge (2016)
[42] Isham, CJ; Klauder, JR, Coherent states for n-dimensional Euclidean groups E(n) and their application, J. Math. Phys., 32, 607-620, (1991) · Zbl 0735.22012 · doi:10.1063/1.529402
[43] Janssen, A.J.: Generalized 3d Zernike Functions for Analytic Construction of Band-Limited Line-Detecting Wavelets. ArXiv preprint arXiv:1510.04837 (2015)
[44] Janssen, M.H.J., Duits, R., Breeuwer, M.: Invertible orientation scores of 3D images. In: Scale Space and Variational Methods in Computer Vision, Lecture Notes in Computer Science, vol. 9087, pp. 563-575. Springer (2015) · Zbl 1453.94011
[45] Janssen, Michiel H. J.; Dela Haije, Tom C. J.; Martin, Frank C.; Bekkers, Erik J.; Duits, Remco, The Hessian of Axially Symmetric Functions on SE(3) and Application in 3D Image Analysis, 643-655, (2017), Cham · Zbl 1489.68324
[46] Kalitzin, SN; Haar Romeny, BM; Viergever, MA, Invertible apertured orientation filters in image analysis, Int. J. Comput. Vis., 31, 145-158, (1999) · doi:10.1023/A:1008013815039
[47] Law, M.W.K., Chung, A.C.S.: Three dimensional curvilinear structure detection using optimally oriented flux. In: Computer Vision—ECCV 2008, pp. 368-382. Springer, Berlin (2008)
[48] Lee, TS, Image representation using 2D Gabor wavelets, IEEE Trans. Pattern Anal. Mach. Intell., 18, 959-971, (1996) · doi:10.1109/34.541406
[49] Louis, A., Orthogonal function series expansions and the null space of the Radon transform, SIAM J. Math. Anal., 15, 621-633, (1984) · Zbl 0533.42018 · doi:10.1137/0515047
[50] Louis, A., Maass, D., Rieder, A.: Wavelets: Theory and Application. Wiley, New York (1997) · Zbl 0897.42019
[51] Mallat, S.: A Wavelet Tour of Signal Processing. Academic Press, London (1999) · Zbl 0998.94510
[52] Mashtakov, A.; Duits, R.; Sachkov, Y.; Bekkers, EJ; Beschastnyi, I., Tracking of lines in spherical images via sub-Riemannian geodesics in SO(3), J. Math. Imaging Vis., 58, 239-264, (2017) · Zbl 1387.68222 · doi:10.1007/s10851-017-0705-9
[53] Mashtakov, AP; Ardentov, AA; Sachkov, YL, Parallel algorithm and software for image inpainting via sub-Riemannian minimizers on the group of rototranslations, Numer. Math. Theory Methods Appl., 6, 95-115, (2013) · Zbl 1289.94013
[54] Muhlich, M.; Aach, T., Analysis of multiple orientations, IEEE Trans. Image Process., 18, 1424-1437, (2009) · Zbl 1371.94521 · doi:10.1109/TIP.2009.2019307
[55] Olver, F.W.J.: NIST Handbook of Mathematical Functions. Cambridge University Press, Cambridge (2010) · Zbl 1198.00002
[56] Pechaud, M., Keriven, R., Peyre, G.: Extraction of tubular structures over an orientation domain. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 336-342 (2009)
[57] Petitot, J., The neurogeometry of pinwheels as a sub-Riemannian contact structure, J. Physiol., 97, 265-309, (2003)
[58] Portegies, JM; Fick, RHJ; Sanguinetti, GR; Meesters, SPL; Girard, G.; Duits, R., Improving fiber alignment in hardi by combining contextual pde flow with constrained spherical deconvolution, PLoS ONE, 10, 1-33, (2015) · doi:10.1371/journal.pone.0138122
[59] Prandi, Dario; Boscain, Ugo; Gauthier, Jean-Paul, Image Processing in the Semidiscrete Group of Rototranslations, 627-634, (2015), Cham · Zbl 1406.94005
[60] Rajan, S., Das, T., Krishnakumar, R.: An analytical method for the detection of exudates in retinal images using invertible orientation scores. In: Proceedings of the World Congress on Engineering, vol. 1 (2016)
[61] Reisert, M.: Group Integration Techniques in Pattern Analysis—A Kernel View. Ph.D. Thesis, Albert-Ludwigs- University (2008)
[62] Ruijters, D.; Vilanova, A., Optimizing GPU volume rendering, J. WSCG, 14, 9-16, (2006)
[63] Scharr, Hanno, Diffusion-Like Reconstruction Schemes from Linear Data Models, 51-60, (2006), Berlin, Heidelberg
[64] Sharma, U.; Duits, R., Left-invariant evolutions of wavelet transforms on the similitude group, Appl. Comput. Harmon. Anal., 39, 110-137, (2015) · Zbl 1345.94009 · doi:10.1016/j.acha.2014.09.001
[65] Sifre, L., Mallat, P.S.: Rigid-Motion Scattering For Image Classification. Ph.D. Thesis, Ecole Polytechnique, CMAP, Paris (2014)
[66] Steidl, Gabriele; Teuber, Tanja, Anisotropic Smoothing Using Double Orientations, 477-489, (2009), Berlin, Heidelberg · Zbl 1371.94352
[67] van Almsick, M.: Context Models of Lines and Contours. Ph.D. Thesis, Technische Universiteit Eindhoven (2007)
[68] Vogt, T., Lellmann, J.: Measure-Valued Variational Models with Applications to Diffusion-Weighted Imaging. ArXiv preprint arXiv:1710.00798 (2017)
[69] Weickert, J., Coherence-enhancing diffusion filtering, Int. J. Comput. Vis., 31, 111-127, (1999) · Zbl 1505.94010 · doi:10.1023/A:1008009714131
[70] Zhang, J.; Dashtbozorg, B.; Bekkers, E.; Pluim, JPW; Duits, R.; Haar Romeny, BM, Robust retinal vessel segmentation via locally adaptive derivative frames in orientation scores, IEEE Trans. Med. Imaging, 35, 2631-2644, (2016) · doi:10.1109/TMI.2016.2587062
[71] Zweck, J.; Williams, LR, Euclidean group invariant computation of stochastic completion fields using shiftable-twistable functions, J. Math. Imaging Vis., 21, 135-154, (2004) · Zbl 1433.68525 · doi:10.1023/B:JMIV.0000035179.47895.bc
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.