×

Linear geometric ICA: Fundamentals and algorithms. (English) Zbl 1053.68081

Summary: Geometric algorithms for linear Independent Component Analysis (ICA) have recently received some attention due to their pictorial description and their relative case of implementation. The geometric approach to ICA was proposed first by C. Puntonet and A. Prieto [Neural Process. Lett. 2 (1995)]. We will reconsider geometric ICA in a theoretic framework showing that fixed points of geometric ICA fulfill a geometric convergence condition, which the mixed images of the unit vectors satisfy too. This leads to a conjecture claiming that in the nongaussian unimodal symmetric case, there is only one stable fixed point, implying the uniqueness of geometric ICA after convergence. Guided by the principles of ordinary geometric ICA, we then present a new approach to linear geometric ICA based on histograms observing a considerable improvement in separation quality of different distributions and a sizable reduction in computational cost, by a factor of 100, compared to the ordinary geometric approach. Furthermore, we explore the accuracy of the algorithm depending on the number of samples and the choice of the mixing matrix, and compare geometric algorithms with classical ICA algorithms, namely, Extended Infomax and FastICA. Finally, we discuss the problem of high-dimensional data sets within the realm of geometrical ICA algorithms.

MSC:

68T05 Learning and adaptive systems in artificial intelligence
68W05 Nonnumerical algorithms
Full Text: DOI

References:

[1] DOI: 10.1162/neco.1995.7.6.1129 · doi:10.1162/neco.1995.7.6.1129
[2] DOI: 10.1239/aap/1035228132 · Zbl 0980.62066 · doi:10.1239/aap/1035228132
[3] DOI: 10.1016/0165-1684(94)90029-9 · Zbl 0791.62004 · doi:10.1016/0165-1684(94)90029-9
[4] Cottrell M., Annales de l’Institut Henri Poincaré 23 (1) pp 1– (1987)
[5] DOI: 10.1109/72.761722 · doi:10.1109/72.761722
[6] DOI: 10.1162/neco.1997.9.7.1483 · doi:10.1162/neco.1997.9.7.1483
[7] DOI: 10.1016/0165-1684(91)90079-X · Zbl 0729.73650 · doi:10.1016/0165-1684(91)90079-X
[8] DOI: 10.1162/089976699300016719 · doi:10.1162/089976699300016719
[9] DOI: 10.1162/neco.1992.4.5.691 · doi:10.1162/neco.1992.4.5.691
[10] DOI: 10.1007/BFb0100534 · doi:10.1007/BFb0100534
[11] DOI: 10.1007/BF00205972 · Zbl 0653.92026 · doi:10.1007/BF00205972
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.