×

A theoretical contribution to the fast implementation of null linear discriminant analysis with random matrix multiplication. (English) Zbl 1374.65084

Summary: The null linear discriminant analysis method is a competitive approach for dimensionality reduction. The implementation of this method, however, is computationally expensive. Recently, a fast implementation of null linear discriminant analysis method was proposed in the paper of A. Sharma et al. [“A feature selection method using improved regularized linear discriminant analysis”, Machine Vision and Applications 25, No. 3, 775–786 (2014)]. In this method, a random matrix multiplication with scatter matrix is used to produce the orientation matrix. In this paper, we consider whether the random matrix can be replaced by an arbitrary full rank matrix of appropriate size, and focus on the necessary and sufficient condition to guarantee full column rank of the orientation matrix. We investigate how to choose the matrix properly, such that the two criteria of the null linear discriminant analysis method are satisfied. Furthermore, we give a necessary and sufficient condition to guarantee full column rank of the orientation matrix, and describe the geometric characterization of this condition. Numerical experiments justify our theoretical analysis.

MSC:

65F60 Numerical computation of matrix exponential and similar matrix functions

Software:

ORL face; Matlab

References:

[1] RaoC. The utilization of multiple measurements in problems of biological classification. Journal of Royal Statistical Society (Series B)1948; 10:159-203. · Zbl 0034.07902
[2] ChenL, LiaoH, KoM, LinJ, YuG. A new LDA‐based face recognition system which can solve the small sample size problem. Pattern Recognition2000; 33:1713-1726.
[3] FukunagaK. Introduction to Statistical Pattern Recognition. Academic Press Inc., Hartcourt Brace Jovanovich Publishers: SanDiego, CA 92101-4495, USA, 1990. · Zbl 0711.62052
[4] SharmaA, PaliwalK. A new perspective to null linear discriminant analysis method and its fast implementation using random matrix multiplication with scatter matrices. Pattern Recognition2012; 45:2205-2213. · Zbl 1234.62100
[5] ParkC, ParkH. A comparision of generalized linear discriminant analysis algorithms. Pattern Recognition2008; 41:1083-1097. · Zbl 1132.68656
[6] GolubGH, Van LoanCF. Matrix Computations (4th edition). John Hopkins University Press: Baltimore, MD, 2013. · Zbl 1268.65037
[7] Alvarez‐GinarteY, MonteroL, Manuel Garcia‐de la VegaJ, Bencomo MartinezA, PupoA, AgramonteA. Integration of ligand and structure‐based virtual screening for identification of leading anabolic steroids. The Journal of Steroid Biochemistry and Molecular Biology2013; 138:348-358.
[8] LyonsaJ, BiswaseN, SharmabA, DehzangicA, PaliwalaK. Protein fold recognition by alignment of amino acid residues using kernelized dynamic time warping. Journal of Theoretical Biology2014; 354:137-145. · Zbl 1412.92248
[9] LuG, ZhengW. Complexity‐reduced implementations of complete and null‐space‐based linear discriminant analysis. Neural Networks2013; 46:165-171. · Zbl 1296.62133
[10] SharmaA, PaliwalK, ImotoS, MiyanoS. A feature selection method using improved regularized linear discriminant analysis. Machine Vision and Applications2014; 25:775-786.
[11] The ORL Database of faces. Available from: http://www.cl.cam.ac.uk/Research/DTG/attarchive:pub/data/ attfaces.tar.Z, 2002.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.