Generalized relations in linguistics & cognition. (English) Zbl 1408.91187
Summary: Categorical compositional models of natural language exploit grammatical structure to calculate the meaning of phrases and sentences from the meanings of individual words. More recently, similar compositional techniques have been applied to conceptual space models of cognition.
Compact closed categories, particularly the category of finite dimensional vector spaces, have been the most common setting for categorical compositional models. When addressing a new problem domain, such as conceptual space models of meaning, a key problem is finding a compact closed category that captures the features of interest.
We propose categories of generalized relations as a source of new, practical models for cognition and NLP. We demonstrate using detailed examples that phenomena such as fuzziness, metrics, convexity, semantic ambiguity can all be described by relational models. Crucially, by exploiting a technical framework described in previous work of the authors, we also show how the above-mentioned phenomena can be combined into a single model, providing a flexible family of new categories for categorical compositional modelling.
Compact closed categories, particularly the category of finite dimensional vector spaces, have been the most common setting for categorical compositional models. When addressing a new problem domain, such as conceptual space models of meaning, a key problem is finding a compact closed category that captures the features of interest.
We propose categories of generalized relations as a source of new, practical models for cognition and NLP. We demonstrate using detailed examples that phenomena such as fuzziness, metrics, convexity, semantic ambiguity can all be described by relational models. Crucially, by exploiting a technical framework described in previous work of the authors, we also show how the above-mentioned phenomena can be combined into a single model, providing a flexible family of new categories for categorical compositional modelling.
MSC:
| 91F20 | Linguistics |
| 18D15 | Closed categories (closed monoidal and Cartesian closed categories, etc.) |
Software:
Mathematics Genealogy ProjectReferences:
| [1] | Coecke, B.; Sadrzadeh, M.; Clark, S., Mathematical foundations for distributed compositional model of meaning, Lambek Festschrift. Lambek Festschrift, Linguist. Anal., 36, 345-384, (2010) |
| [2] | Grefenstette, E.; Sadrzadeh, M., Experimental support for a categorical compositional distributional model of meaning, (The 2014 Conference on Empirical Methods on Natural Language Processing, (2011)), 1394-1404 |
| [3] | Kartsaklis, D.; Sadrzadeh, M., Prior disambiguation of word tensors for constructing sentence vectors, (The 2013 Conference on Empirical Methods on Natural Language Processing, (2013), ACL), 1590-1601 |
| [4] | Clark, S.; Coecke, B.; Grefenstette, E.; Pulman, S.; Sadrzadeh, M., A quantum teleportation inspired algorithm produces sentence meaning from word meaning and grammatical structure, Malays. J. Math. Sci., 8, 15-25, (2014) |
| [5] | Abramsky, S.; Coecke, B., A categorical semantics of quantum protocols, (Proceedings of the 19th Annual IEEE Symposium on Logic in Computer Science, 2004, (2004), IEEE), 415-425 |
| [6] | Coecke, B.; Paquette, É. O.; Pavlović, D., Classical and quantum structuralism, (Gay, S.; Mackie, I., Semantic Techniques in Quantum Computation, (2010), Cambridge University Press), 29-69 · Zbl 1192.81016 |
| [7] | Sadrzadeh, M.; Clark, S.; Coecke, B., The Frobenius anatomy of word meanings I: subject and object relative pronouns, J. Logic Comput., (2013), ext044 · Zbl 1320.68207 |
| [8] | Kartsaklis, D.; Sadrzadeh, M., A Frobenius model of information structure in categorical compositional distributional semantics, (The 14th Meeting on the Mathematics of Language, (2015)), 62 · Zbl 1376.91140 |
| [9] | Selinger, P., Dagger compact closed categories and completely positive maps, Electron. Notes Theor. Comput. Sci., 170, 139-163, (2007) · Zbl 1277.18008 |
| [10] | Piedeleu, R.; Kartsaklis, D.; Coecke, B.; Sadrzadeh, M., Open system categorical quantum semantics in natural language processing, (6th Conference on Algebra and Coalgebra in Computer Science. 6th Conference on Algebra and Coalgebra in Computer Science, CALCO 2015, (2015)), 270-289 · Zbl 1366.68349 |
| [11] | Coecke, B.; Kissinger, A., Picturing Quantum Processes. A First Course in Quantum Theory and Diagrammatic Reasoning, (2017), Cambridge University Press · Zbl 1405.81001 |
| [12] | Bonchi, F.; Sobocinski, P.; Zanasi, F., Full abstraction for signal flow graphs, ACM SIGPLAN Not., 50, 1, 515-526, (2015) · Zbl 1346.68143 |
| [13] | Baez, J. C.; Erbele, J., Categories in control, Theory Appl. Categ., 30, 24, 836-881, (2015) · Zbl 1316.18009 |
| [14] | Baez, J. C.; Fong, B.; Pollard, B. S., A compositional framework for Markov processes, J. Math. Phys., 57, 3, (2016) · Zbl 1336.60147 |
| [15] | Baez, J. C.; Fong, B., A compositional framework for passive linear networks · Zbl 1402.18005 |
| [16] | Sobocinski, P., Graphical linear algebra, mathematical blog |
| [17] | Coecke, B.; Grefenstette, E.; Sadrzadeh, M., Lambek vs. Lambek: functorial vector space semantics and string diagrams for Lambek calculus, Ann. Pure Appl. Logic, 164, 11, 1079-1100, (2013) · Zbl 1280.03026 |
| [18] | Bolt, J.; Coecke, B.; Genovese, F.; Lewis, M.; Marsden, D.; Piedeleu, R., Interacting conceptual spaces, (Proceedings of the 2016 Workshop on Semantic Spaces at the Intersection of NLP, Physics and Cognitive Science, (2016)), 11-19 |
| [19] | Gärdenfors, P., Conceptual Spaces: The Geometry of Thought, (2004), MIT Press |
| [20] | Gärdenfors, P., The Geometry of Meaning: Semantics Based on Conceptual Spaces, (2014), MIT Press · Zbl 1303.00038 |
| [21] | Ludwig, G., An Axiomatic Basis of Quantum Mechanics. 1. Derivation of Hilbert Space, (1985), Springer-Verlag · Zbl 0582.46065 |
| [22] | Barrett, J., Information processing in generalized probabilistic theories, Phys. Rev. A, 75, (2007) |
| [23] | Fong, B., The Algebra of Open and Interconnected Systems, (2016), University of Oxford, Ph.D. thesis |
| [24] | Marsden, D.; Genovese, F., Custom hypergraph categories via generalized relations, (7th Conference on Algebra and Coalgebra in Computer Science (CALCO 2017), (2017)) · Zbl 1433.68205 |
| [25] | Coecke, B.; Genovese, F.; Lewis, M.; Marsden, D., Generalized relations in linguistics & cognition, (International Workshop on Logic, Language, Information, and Computation (WOLLIC), (2017)) · Zbl 1408.91186 |
| [26] | Dostal, M.; Sadrzadeh, M., Many Valued Generalised Quantifiers for Natural Language in the DisCoCat Model, (2016), Queen Mary University of London, Tech. rep. |
| [27] | Bankova, D., Comparing Meaning in Language and Cognition - p-Hypononymy, Concept Combination, Asymmetric Similarity, (2015), University of Oxford, Master’s thesis |
| [28] | Bankova, D.; Coecke, B.; Lewis, M.; Marsden, D., Graded entailment for compositional distributional semantics |
| [29] | Lambek, J., Type grammar revisited, (Logical Aspects of Computational Linguistics, (1999), Springer), 1-27 · Zbl 0934.03043 |
| [30] | Schütze, H., Automatic word sense discrimination, Comput. Linguist., 24, 1, 97-123, (1998) |
| [31] | Bolt, J.; Coecke, B.; Genovese, F.; Lewis, M.; Marsden, D.; Piedeleu, R., Interacting conceptual spaces I: grammatical composition of concepts |
| [32] | Coecke, B.; Paquette, E. O., Categories for the practising physicist, (New Structures for Physics, (2010), Springer), 173-286 · Zbl 1253.81009 |
| [33] | Kissinger, A., Finite matrices are complete for (dagger-)hypergraph categories |
| [34] | Sadrzadeh, M.; Clark, S.; Coecke, B., The Frobenius anatomy of word meanings II: possessive relative pronouns, J. Logic Comput., (2014), exu027 · Zbl 1344.68253 |
| [35] | Rosch, E.; Mervis, C. B., Family resemblances: studies in the internal structure of categories, Cogn. Psychol., 7, 4, 573-605, (1975) |
| [36] | Barsalou, L. W., Ideals, central tendency, and frequency of instantiation as determinants of graded structure in categories, J. Exper. Psychol., Learn., Mem., Cogn., 11, 4, 629, (1985) |
| [37] | Hampton, J. A., Overextension of conjunctive concepts: evidence for a unitary model of concept typicality and class inclusion, J. Exper. Psychol., Learn., Mem., Cogn., 14, 1, 12, (1988) |
| [38] | Hampton, J. A., Disjunction of natural concepts, Mem. Cogn., 16, 6, 579-591, (1988) |
| [39] | Dale, R.; Kehoe, C.; Spivey, M. J., Graded motor responses in the time course of categorizing atypical exemplars, Mem. Cogn., 35, 1, 15-28, (2007) |
| [40] | Osherson, D. N.; Smith, E. E., Gradedness and conceptual combination, Cognition, 12, 3, 299-318, (1982) |
| [41] | Hofmann, D.; Seal, G. J.; Tholen, W., Monoidal Topology: A Categorical Approach to Order, Metric, and Topology, vol. 153, (2014), Cambridge University Press · Zbl 1297.18001 |
| [42] | Coonce, H. B., The mathematics genealogy project, website provided by North Dakota State University |
| [43] | Shepard, R. N., Toward a universal law of generalization for psychological science, Science, 237, 4820, 1317-1323, (1987) · Zbl 1226.91051 |
| [44] | Tversky, A., Features of similarity, Psychol. Rev., 84, 4, 327, (1977) |
| [45] | Marsden, D., A graph theoretic perspective on CPM(Rel), (Proceedings 12th International Workshop on Quantum Physics and Logic. Proceedings 12th International Workshop on Quantum Physics and Logic, QPL 2015, Oxford, UK, July 15-17, 2015, (2015)), 273-284 · Zbl 1477.18038 |
| [46] | MacLane, S.; Moerdijk, I., Sheaves in Geometry and Logic: A First Introduction to Topos Theory, (2012), Springer Science & Business Media |
| [47] | Borceux, F., Handbook of Categorical Algebra, vol. 2, Categories and Structures, (1994), Cambridge University Press · Zbl 0843.18001 |
| [48] | Barr, M., Exact categories, (Exact Categories and Categories of Sheaves, (1971), Springer), 1-120 · Zbl 0223.18009 |
| [49] | Stubbe, I., Categorical Structures Enriched in A Quantaloid: Categories and Semicategories, (2003), Université Catholique de Louvain, Ph.D. thesis |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
