×

Nonmonotonic inferences and neural networks. (English) Zbl 1073.68082

Summary: There is a gap between two different modes of computation: the symbolic mode and the subsymbolic (neuron-like) mode. The aim of this paper is to overcome this gap by viewing symbolism as a high-level description of the properties of (a class of) neural networks. Combining methods of algebraic semantics and nonmonotonic logic, the possibility of integrating both modes of viewing cognition is demonstrated. The main results are (a) that certain activities of connectionist networks can be interpreted as nonmonotonic inferences, and (b) that there is a strict correspondence between the coding of knowledge in Hopfield networks and the knowledge representation in weight-annotated Poole systems. These results show the usefulness of nonmonotonic logic as a descriptive and analytic tool for analyzing emerging properties of connectionist networks. Assuming an exponential development of the weight function, the present account relates to optimality theory – a general framework that aims to integrate insights from symbolism and connectionism. The paper concludes with some speculations about extending the present ideas.

MSC:

68T27 Logic in artificial intelligence
68Q10 Modes of computation (nondeterministic, parallel, interactive, probabilistic, etc.)
68T05 Learning and adaptive systems in artificial intelligence
68T30 Knowledge representation
03B60 Other nonclassical logic
Full Text: DOI

References:

[20] Hinton, G. E. and T. J. Sejnowski: 1986, ’Learning and Relearning in Boltzman Machines’, in D. E. Rumelhart, J. L. McClelland, and the PDP research group, pp. 282–317.
[23] Kean, M. L.: 1975, The Theory of Markedness in Generative Grammar, Ph.D. thesis, MIT, Cambridge, Mass.
[33] Prince, A. and P. Smolensky: 1993, Optimality Theory: Constraint Interaction in Generative Grammar. Technical Report CU-CS-696-93, Department of Computer Science, University of Colorado at Boulder, and Technical Report TR-2, Rutgers Center for Cognitive Science, Rutgers University, New Brunswick, NJ.
[34] Rumelhart, D. E., J. L. McClelland, and the PDP research group: 1986, Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Volume I and II. MIT Press/Bradford Books, Cambridge, MA.
[44] Smolensky, P., and G. Legendre (to appear), The Harmonic Mind: From Neural Computation to optimality-theoretic grammar, Blackwell, Oxford. · Zbl 1239.91141
[45] Smolensky, P., G. Legendre, and Y. Miyata: 1992, ’Principles for An Integrated Connectionist/Symbolic Theory of Higher Cognition’, Technical Report CU-CS-600-92, Department of Computer Science, Institute of Cognitive Science, University of Colorado Boulder.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.