Hadamard powers and kernel perceptrons. (English) Zbl 1517.15002
Summary: We study a relation between Hadamard powers and polynomial kernel perceptrons. The rank of Hadamard powers for the special case of a Boolean matrix and for the generic case of a real matrix is computed explicitly. These results are interpreted in terms of the classification capacities of perceptrons.
MSC:
| 15A03 | Vector spaces, linear dependence, rank, lineability |
| 15A45 | Miscellaneous inequalities involving matrices |
| 15B34 | Boolean and Hadamard matrices |
References:
| [1] | Aĭzerman, M. A.; Braverman, È. M.; Rozonoèr, L. I., Theoretical foundations of the potential function method in pattern recognition learning, Autom. Remote Control, 25, 821-837 (1965) · Zbl 0151.24701 |
| [2] | Ando, T., Concavity of certain maps on positive definite matrices and applications to Hadamard products, Linear Algebra Appl., 26, 203-241 (1979) · Zbl 0495.15018 |
| [3] | Anthony, M., Classification by polynomial surfaces, Discrete Appl. Math., 61, 91-103 (1995) · Zbl 0838.94022 |
| [4] | Belton, A.; Guillot, D.; Khare, A.; Putinar, M., Simultaneous kernels of matrix Hadamard powers, Linear Algebra Appl., 576, 142-157 (2019) · Zbl 1429.15030 |
| [5] | Bernstein, D. S., Scalar, Vector, and Matrix Mathematics. Theory, Facts, and Formulas (2018), Princeton University Press: Princeton University Press Princeton, NJ · Zbl 1396.15001 |
| [6] | Bhatia, R.; Elsner, L., Positivity preserving Hadamard matrix functions, Positivity, 11, 583-588 (2007) · Zbl 1130.15011 |
| [7] | Cortes, C.; Vapnik, V., Support-vector networks, Mach. Learn., 20, 273-297 (1995) · Zbl 0831.68098 |
| [8] | Faliva, M., Hadamard matrix product, graph and system theories: Motivations and role in econometrics, (Proceedings of the Conferences on Matrices and Graphs: Theory and Applications to Economics. Proceedings of the Conferences on Matrices and Graphs: Theory and Applications to Economics, Brescia, Italy, 8 June 1993 and 22 June 1995 (1996), World Scientific: World Scientific Singapore), 152-175 · Zbl 0915.05028 |
| [9] | Fallat, S. M.; Johnson, C. R., Hadamard powers and totally positive matrices, Linear Algebra Appl., 423, 420-427 (2007) · Zbl 1123.15014 |
| [10] | Fiedler, M.; Markham, T. L., An inequality for the Hadamard product of an M-matrix and an inverse M-matrix, Linear Algebra Appl., 101, 1-8 (1988) · Zbl 0648.15009 |
| [11] | Guillot, D.; Khare, A.; Rajaratnam, B., Complete characterization of Hadamard powers preserving Loewner positivity, monotonicity, and convexity, J. Math. Anal. Appl., 425, 489-507 (2015) · Zbl 1310.15078 |
| [12] | Horn, R. A.; Johnson, C. R., Topics in Matrix Analysis (1991), Cambridge University Press: Cambridge University Press Cambridge · Zbl 0729.15001 |
| [13] | Horn, R. A.; Johnson, C. R., Matrix Analysis (2012), Cambridge University Press: Cambridge University Press New York, NY, USA |
| [14] | Horn, R. A.; Yang, Z., Rank of a Hadamard product, Linear Algebra Appl., 591, 87-98 (2020) · Zbl 1439.15007 |
| [15] | Jain, T., Hadamard powers of some positive matrices, Linear Algebra Appl., 528, 147-158 (2017) · Zbl 1398.15038 |
| [16] | Jain, T., Hadamard powers of rank two, doubly nonnegative matrices, Adv. Oper. Theory, 5, 839-849 (2020) · Zbl 1446.15015 |
| [17] | Marcus, M.; Franklin, S., Rank and inertia of a complex Hadamard power, Linear Multilinear Algebra, 32, 149-166 (1992) · Zbl 0755.15014 |
| [18] | Mathias, R., The singular values of the Hadamard product of a positive semidefinite and a skew-symmetric matrix, Linear Multilinear Algebra, 31, 57-70 (1992) · Zbl 0759.15011 |
| [19] | Oxtoby, J. C., Measure and Category. A Survey of the Analogies Between Topological and Measure Spaces, Grad. Texts Math., vol. 2 (1980), Springer: Springer Cham · Zbl 0435.28011 |
| [20] | Panwar, V. S.; Reddy, A. S., Positivity of Hadamard powers of a few band matrices, Electron. J. Linear Algebra, 38, 85-90 (2022) · Zbl 1490.15049 |
| [21] | Pishro-Nik, H., Introduction to Probability, Statistics, and Random Processes (2014), Kappa Research |
| [22] | Polya, G.; Szegö, G., Problems and Theorems in Analysis. vol. II: Theory of Functions, Zeros, Polynomials, Determinants, Number Theory, Geometry (1976), Springer: Springer Cham · Zbl 0311.00002 |
| [23] | Schölkopf, B.; Smola, A. J., Learning with Kernels (2002), MIT Press: MIT Press Cambridge, MA |
| [24] | Schur, J., Bemerkungen zur Theorie der beschränkten Bilinearformen mit unendlich vielen Veränderlichen, J. Reine Angew. Math., 140, 1-28 (1911) · JFM 42.0367.01 |
| [25] | Styan, G. P.H., Hadamard products and multivariate statistical analysis, Linear Algebra Appl., 6, 217-240 (1973) · Zbl 0255.15002 |
| [26] | Wang, C.; Williams, A. C., The threshold order of a Boolean function, Discrete Appl. Math., 31, 51-69 (1991) · Zbl 0728.94015 |
| [27] | Yale, P. B., Geometry and Symmetry, Dover Books Adv. Math. (1988), Dover Publications, Inc.: Dover Publications, Inc. New York · Zbl 0701.51001 |
| [28] | Zhang, X. D., A Matrix Algebra Approach to Artificial Intelligence (2020), Springer: Springer Singapore · Zbl 1455.68010 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
