×

On a smoothness problem in ridge function representation. (English) Zbl 1342.26037

A ridge fuction on \(\mathbb {R}^n\) is of the form \(g(a\cdot x)\), where \(g:\mathbb{R}\to\mathbb{R}\) and \(a\in\mathbb{R}^n\setminus\{ 0\} \). Recently the following problem was extensively studied: Assume \(f\in C^k(\mathbb{R}^n)\) is a finite sum of ridge functions, (1) \(f(x)=\sum_{i=1}^r g_i (a^i\cdot x)\), where \(a^1,\dots,a^r\) are pairwise linearly independent. “What can we say about the smoothness of \(g^i\)?”
It is not difficult to see that if \(a^1,\dots,a^r\) are linearly independent, then all \(g^i\) belong to the class \(C^k (\mathbb{R})\) (see S. V. Konyagin and A. A. Kuleshov [Math. Notes 98, No. 2, 336–338 (2015; Zbl 1329.26027); translation from Mat. Zametki 98, No. 2, 308–309 (2015)]). A. Pinkus [Indag. Math., New Ser. 24, No. 4, 725–738 (2013; Zbl 1305.26036)] proved that if a priori we assume that the functions \(g^i\) satisfy some mild regularity condition (e.g., the Lebesgue measurability), then \(g^i \in C^k(\mathbb{R})\).
In this paper, the authors modify the above question: “Can we write \(f\) as a sum (2) \(f(x)=\sum_{i=1}^r f_i(a^i\cdot x)\) but with the \(f_i \in C^k(\mathbb{R})\), \(i=1,\dots,r\) ?” Let \(p\) be the number of those \(a^i\) which form a maximal linearly independent system. The following two theorems are main results of the paper:
Theorem 2.3. Assume that \(r\geq 3\) and \(p=r-1\). If \(f\geq 2\), then \(f\) has a representation (2), where \(f_i \in C^k(\mathbb{R})\), \(i=1,\dots,r\). It also holds for \(k=1\) if we additionally assume, that the first order partial derivatives of \(f\) are Hölder continuous.
Theorem 3.1. Assume \(k\geq r-p+1\). There exist functions \(f_i \in C^k(\mathbb{R})\) and a polynomial \(P\) of total degree at most \(r-p+1\) such that \(f(x)=\sum_{i=1}^r f_i (a^i\cdot x)+P(x)\).
The authors do not know if the polynomial term is really necessary.

MSC:

26B40 Representation and superposition of functions
39B22 Functional equations for real functions
Full Text: DOI

References:

[1] Aczél, J., Functional Equations and Their Applications (1966), Academic Press: Academic Press New York · Zbl 0139.09301
[2] Buhmann, M. D.; Pinkus, A., Identifying linear combinations of ridge functions, Adv. in Appl. Math., 22, 103-118 (1999) · Zbl 0931.41011
[3] Diaconis, P.; Shahshahani, M., On nonlinear functions of linear combinations, SIAM J. Sci. Stat. Comput., 5, 175-191 (1984) · Zbl 0538.41041
[4] Donoho, D. L.; Johnstone, I. M., Projection-based approximation and a duality method with kernel methods, Ann. Statist., 17, 58-106 (1989) · Zbl 0699.62067
[5] Friedman, J. H.; Stuetzle, W., Projection pursuit regression, J. Amer. Statist. Assoc., 76, 817-823 (1981)
[6] Ismailov, V. E., Characterization of an extremal sum of ridge functions, J. Comput. Appl. Math., 205, 105-115 (2007) · Zbl 1115.41018
[7] Ismailov, V. E., Approximation by ridge functions and neural networks with a bounded number of neurons, Appl. Anal., 94, 2245-2260 (2015) · Zbl 1326.41028
[8] John, F., Plane Waves and Spherical Means Applied to Partial Differential Equations (1955), Interscience: Interscience New York · Zbl 0067.32101
[9] Konyagin, S. V.; Kuleshov, A. A., On the continuity of finite sums of ridge functions, Mat. Zametki. Mat. Zametki, Math. Notes, 98, 336-338 (2015), (in Russian); English transl. in: · Zbl 1329.26027
[10] Kroó, A., On approximation by ridge functions, Constr. Approx., 13, 447-460 (1997) · Zbl 0895.41015
[11] Lin, V. Ya.; Pinkus, A., Fundamentality of ridge functions, J. Approx. Theory, 75, 295-311 (1993) · Zbl 0813.41017
[12] Logan, B. F.; Shepp, L. A., Optimal reconstruction of a function from its projections, Duke Math. J., 42, 645-659 (1975) · Zbl 0343.41020
[13] Maiorov, V. E., On best approximation by ridge functions, J. Approx. Theory, 99, 68-94 (1999) · Zbl 0939.41014
[14] Natterer, F., The Mathematics of Computerized Tomography (1986), Wiley: Wiley New York · Zbl 0617.92001
[15] Pinkus, A., Approximation theory of the MLP model in neural networks, Acta Numer., 8, 143-195 (1999) · Zbl 0959.68109
[16] Pinkus, A., Smoothness and uniqueness in ridge function representation, Indag. Math. (N.S.), 24, 725-738 (2013) · Zbl 1305.26036
[17] Pinkus, A., Ridge Functions, Cambridge Tracts in Math., vol. 205 (2015), Cambridge University Press: Cambridge University Press Cambridge · Zbl 1331.41001
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.