×

Machine learning of higher-order programs. (English) Zbl 0814.03034

The paper uses the notion of a learning machine for (computable) functions. This is an algorithmic device with the elements of a set as step-by-step input and with programs as output (from time to time). We say, e.g., that the machine identifies \(f\) if almost all output programs compute \(f\) when the input is the graph of \(f\). Two infinite hierarchies of (learning) criteria for identification are recalled and the relations (inclusions) of the relevant classes \((\text{Ex}^{\text{a}}, \text{Bc}^{\text{a}})\) of sets of recursive functions are summarized.
Then the authors recall limiting programs and introduce generator programs; e.g., a total program is a \(0\)-generator for \(f\) if almost all its outputs are programs computing \(f\). As a part of motivation, they show that some global properties (e.g. monotonicity of \(f\)) cannot be proved (in a first-order extension of Peano arithmetic) from any (ordinary) program for \(f\) while they can be proved from a higher-order (i.e. limiting or generator) program.
The main results are concerned with comparing the learning power in the cases of higher-order programs and ordinary programs; i.e. the classes \(\text{Lim Ex}^{\text{a}}\), \(\text{Lim Bc}^{\text{a}}\), \(\text{Gen Ex}^{\text{a}}\), \(\text{Gen Bc}^{\text{a}}\) are compared with \(\text{Ex}^{\text{a}}\), \(\text{Bc}^{\text{a}}\) and among themselves. Some of the relevant problems (inclusions) are left open.

MSC:

03D80 Applications of computability and recursion theory
68Q05 Models of computation (Turing machines, etc.) (MSC2010)
68T05 Learning and adaptive systems in artificial intelligence
Full Text: DOI

References:

[1] Introduction to mathematical logic (1986)
[2] An introduction to the general theory of algorithms (1978)
[3] DOI: 10.1016/S0020-0255(80)80006-5 · Zbl 0459.03021 · doi:10.1016/S0020-0255(80)80006-5
[4] DOI: 10.1007/BFb0012761 · doi:10.1007/BFb0012761
[5] DOI: 10.1142/S0129054192000097 · Zbl 0772.68068 · doi:10.1142/S0129054192000097
[6] Language learning and concept acquistion (1986)
[7] DOI: 10.1007/BF01761704 · Zbl 0295.02019 · doi:10.1007/BF01761704
[8] DOI: 10.1145/321386.321395 · Zbl 0155.01503 · doi:10.1145/321386.321395
[9] Recursively enumerable sets and degrees (1987)
[10] DOI: 10.1016/S0019-9958(75)90261-2 · Zbl 0375.02028 · doi:10.1016/S0019-9958(75)90261-2
[11] Degrees of unsolvability (1971) · Zbl 0245.02037
[12] Theory of algorithms and programs 210 pp 82– (1974)
[13] DOI: 10.2307/1970028 · Zbl 0119.25105 · doi:10.2307/1970028
[14] DOI: 10.1145/356914.356918 · doi:10.1145/356914.356918
[15] Review of ”Limiting recursion” by E. M. Gold and ”Trial and error predicates and the solution to a problem of Mostowski” by H. Putnam 36 pp 342– (1971)
[16] Subrecursion: functions and hierarchies (1984) · Zbl 0539.03018
[17] Mathematical significance of consistency proofs 23 pp 155– (1958)
[18] On the interpretation of nonfinitist proofs 17 pp 241– (1951)
[19] Introduction to automata theory languages and computation (1979)
[20] DOI: 10.1016/S0019-9958(67)91165-5 · Zbl 0259.68032 · doi:10.1016/S0019-9958(67)91165-5
[21] Limiting recursion 30 pp 28– (1965)
[22] DOI: 10.1090/S0002-9947-1965-0175771-6 · doi:10.1090/S0002-9947-1965-0175771-6
[23] Fundamenta Mathematicae 49 pp 35– (1960)
[24] DOI: 10.1016/0304-3975(83)90061-0 · Zbl 0524.03025 · doi:10.1016/0304-3975(83)90061-0
[25] On axiomatizability within a system 18 pp 30– (1953)
[26] Theory of recursive functions and effective computability (1967) · Zbl 0183.01401
[27] Gödel numberings of partial recursive functions 23 pp 331– (1958)
[28] Bulletin of the American Mathematical Society 63 pp 140– (1957)
[29] Intensional subrecursion and complexity theory (1992)
[30] Trial and error predicates and the solution to a problem of Mostowski 30 pp 49– (1965)
[31] Systems that learn, an introduction to learning theory for cognitive and computer scientists (1986)
[32] DOI: 10.1090/S0002-9947-1976-0403933-6 · doi:10.1090/S0002-9947-1976-0403933-6
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.