×

Anisotropic diffusion on sub-manifolds with application to Earth structure classification. (English) Zbl 1316.62067

Summary: We introduce a method to re-parameterize massive high dimensional data, generated by nonlinear mixing, into its independent physical parameters. Our method enables the identification of the original parameters and their extension to new observations without any knowledge of the true physical model. The suggested approach in this paper is related to spectral independent components analysis (ICA) via the construction of an anisotropic diffusion kernel whose eigenfunctions comprise the independent components. However, we use a novel anisotropic diffusion process, utilizing only a small observed subset \(\bar Y\), that approximates the isotropic diffusion on the parametric manifold \(\mathcal M_X\) of the full set \(Y\). We employ a Nyström-type extension of the independent components of \(\bar Y\) to the independent components of \(Y\), and provide a validation scheme for our algorithm parameters choice. We demonstrate our method on synthetic examples and on real application examples.

MSC:

62H11 Directional data; spatial statistics
60J60 Diffusion processes
62H25 Factor analysis and principal components; correspondence analysis
65C60 Computational problems in statistics (MSC2010)

Software:

FastICA
Full Text: DOI

References:

[1] Hyvärinen, A.; Karhunen, J.; Oja, E., Independent Components Analysis (2001), John Wiley and Sons: John Wiley and Sons New York
[2] Saul, L. K.; Weinberger, K. Q.; Ham, J. H.; Sha, F.; Lee, D. D., Spectral Methods for Dimensionality Reduction Semisupervised Learning (2006), MIT Press: MIT Press Cambridge, MA
[3] Singer, A., Spectral independent component analysis, Applied and Computational Harmonic Analysis, 21, 1, 128-134 (2006) · Zbl 1095.94010
[4] Singer, A.; Coifman, R. R., Non linear independent component analysis with diffusion maps, Applied and Computational Harmonic Analysis, 25, 2, 226-239 (2008) · Zbl 1144.62044
[5] Katznelson, Y., An Introduction to Harmonic Analysis (1976), Dover: Dover New York · Zbl 0169.17902
[6] Abramowitz, M.; Stegun, I. A., Handbook of Mathematical Functions with Formulas, Graphs and Mathematical Tables (1972), Dover: Dover New York · Zbl 0543.33001
[7] Aronszajn, N., Theory of reproducing kernels, Trans. Amer. Math. Soc., 68, 3, 337-404 (1950) · Zbl 0037.20701
[8] Fowlkes, C.; Belongie, S.; Chung, F.; Malik, J., Spectral grouping using the Nyström method, TPAMI, 26, 2, 214-225 (2004)
[9] Coifman, R. R.; Lafon, S., Geometric harmonics: A novel tool for multiscale out-of-sample extension of empirical functions, Applied and Computational Harmonic Analysis, 21, 1, 31-52 (2006) · Zbl 1095.68095
[10] Lafon, S.; Keller, Y.; Coifman, R. R., Data fusion and multicue data matching by diffusion maps, TPAMI, 28, 11, 1784-1797 (2006)
[11] Szlam, A. D.; Maggioni, M.; Coifman, R. R., Regularization on graphs with function-adapted diffusion processes, JMLR, 9, 1711-1739 (2008) · Zbl 1225.68217
[12] Rosasco, L.; Belkin, M.; De Vito, E., On learning with integral operators, JMLR, 11, 905-934 (2010) · Zbl 1242.62059
[13] Q. Li, D. Omeragic, L. Chou, L. Yang, K. Duong, J. Smits, J. Yang, T. Lau, C. Liu, R. Dworak, V. Dreuillault, H. Ye, New directional electromagnetic tool for proactive geosteering and accurate formation evaluation while drilling, in: SPWLA 46th Annual Logging Symposium, 2005.; Q. Li, D. Omeragic, L. Chou, L. Yang, K. Duong, J. Smits, J. Yang, T. Lau, C. Liu, R. Dworak, V. Dreuillault, H. Ye, New directional electromagnetic tool for proactive geosteering and accurate formation evaluation while drilling, in: SPWLA 46th Annual Logging Symposium, 2005.
[14] Coifman, R. R.; Lafon, S., Diffusion maps, Applied and Computational Harmonic Analysis, 21, 1, 5-30 (2006) · Zbl 1095.68094
[15] Johnstone, I. M., On the distribution of the largest eigenvalue in principal components analysis, Annals of Statistics, 29, 295-327 (2001) · Zbl 1016.62078
[16] Nadler, B., Finite Sample Approximation Results for principal component analysis: A matrix perturbation approach, Annals of Statistics, 36, 6, 2791-2817 (2008) · Zbl 1168.62058
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.