×

Monotonic inference with unscoped episodic logical forms: from principles to system. (English) Zbl 07847927

Summary: We describe the foundations and the systematization of natural logic-like monotonic inference using unscoped episodic logical forms (ULFs) that as reported by Kim et al. (Proceedings of the 1st and 2nd Workshops on Natural Logic Meets Machine Learning (NALOMA), Groningen, 2021a, b) introduced and first evaluated. In addition to providing a more detailed explanation of the theory and system, we present results from extending the inference manager to address a few of the limitations that as reported by Kim et al. (Proceedings of the 1st and 2nd Workshops on Natural Logic Meets Machine Learning (NALOMA), Groningen, 2021b) naive system has. Namely, we add mechanisms to incorporate lexical information from the hypothesis (or goal) sentence, enable the inference manager to consider multiple possible scopings for a single sentence, and match against the goal using English rather than the ULF.

MSC:

03-XX Mathematical logic and foundations
68-XX Computer science
Full Text: DOI

References:

[1] Abzianidze, L. (2016). Natural solution to fracas entailment problems. In: Proceedings of the Fifth Joint Conference on Lexical and Computational Semantics, (pp. 64-74).
[2] Angeli, G., & Manning, C.D. (2014). NaturalLI: Natural logic inference for common sense reasoning. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), (pp. 534-545). Association for Computational Linguistics, Doha, Qatar. doi:10.3115/v1/D14-1059. https://aclanthology.org/D14-1059
[3] Barker, C. (2021) . Rethinking scope islands. Linguistic Inquiry, 1-55. doi:10.1162/ling_a_00419doi:10.1162/ling_a_00419/1889100/ling_a_00419.pdf
[4] Barker, C.; Lappin, S.; Fox, C., Scope, Handbook of Contemporary Semantics, 40-76, (2015), Wiley Blackwell · doi:10.1002/9781118882139.ch2
[5] Burge, T., Belief de re, The Journal of Philosophy, 74, 6, 338-362, (1977) · doi:10.2307/2025871
[6] Chen, Z., Gao, Q., Moss, L.S.: NeuralLog: Natural language inference with joint neural and logical reasoning. In: Proceedings of *SEM 2021: The Tenth Joint Conference on Lexical and Computational Semantics, (pp. 78-88). Association for Computational Linguistics, Online (2021). doi:10.18653/v1/2021.starsem-1.7. https://aclanthology.org/2021.starsem-1.7
[7] Chen, Z.; Gao, Q., Probing linguistic information for logical inference in pre-trained language models, Proceedings of the AAAI Conference on Artificial Intelligence, 36, 10, 10509-10517, (2022) · doi:10.1609/aaai.v36i10.21294
[8] Cooper, R., Crouch, D., Eijck, J.V., Fox, C., Genabith, J.V., Jaspars, J., Kamp, H., Milward, D., Pinkal, M., Poesio, M., & Pulman, S. (1996). Using the framework. Technical Report LRE 62-051 D-16, The FraCaS Consortium
[9] Donnellan, KS, Reference and definite descriptions, The philosophical review, 75, 3, 281-304, (1966) · doi:10.2307/2183143
[10] Fodor, J.; Sag, I., Referential and quantificational indefinites, Linguistics and Philosophy, 5, 355-398, (1982) · doi:10.1007/BF00351459
[11] Gordon, J., & Schubert, L. (2010). Quantificational sharpening of commonsense knowledge. In: Proceedings of the AAAI 2010 Fall Symposium on Commonsense Knowledge.
[12] Haruta, I., Mineshima, K., & Bekki, D. (2020). Combining event semantics and degree semantics for natural language inference. In: Proceedings of the 28th International Conference on Computational Linguistics, (pp. 1758-1764). International Committee on Computational Linguistics, Barcelona, Spain (Online). doi:10.18653/v1/2020.coling-main.156. https://aclanthology.org/2020.coling-main.156
[13] Hu, H., Chen, Q., & Moss, L. (2019). Natural language inference with monotonicity. In: Proceedings of the 13th International Conference on Computational Semantics - Short Papers, (pp. 8-15). Association for Computational Linguistics, Gothenburg, Sweden. doi:10.18653/v1/W19-0502. https://aclanthology.org/W19-0502
[14] Kalouli, A.-L., Crouch, R., & Paiva, V. (2020). Hy-NLI: a hybrid system for natural language inference. In: Proceedings of the 28th International Conference on Computational Linguistics, (pp. 5235-5249). International Committee on Computational Linguistics, Barcelona, Spain (Online). doi:10.18653/v1/2020.coling-main.459. https://aclanthology.org/2020.coling-main.459
[15] Kim, G.L., & Schubert, L. (2019). A type-coherent, expressive representation as an initial step to language understanding. In: Proceedings of the 13th International Conference on Computational Semantics - Long Papers, (pp. 13-30). Association for Computational Linguistics, Gothenburg, Sweden. doi:10.18653/v1/W19-0402. https://aclanthology.org/W19-0402
[16] Kim, G., Duong, V., Lu, X., & Schubert, L. (2021). A transition-based parser for unscoped episodic logical forms. In: Proceedings of the 14th International Conference on Computational Semantics (IWCS), (pp. 184-201). Association for Computational Linguistics, Groningen, The Netherlands (online). https://aclanthology.org/2021.iwcs-1.18
[17] Kim, G., Juvekar, M., & Schubert, L. (2021). Monotonic inference for underspecified episodic logic. In: Proceedings of the 1st and 2nd Workshops on Natural Logic Meets Machine Learning (NALOMA), (pp. 26-40). Association for Computational Linguistics, Groningen, the Netherlands (online). https://aclanthology.org/2021.naloma-1.5
[18] Kim, G., Juvekar, M., Ekmekciu, J., Duong, V., & Schubert, L. (2021). A (mostly) symbolic system for monotonic inference with unscoped episodic logical forms. In: Proceedings of the 1st and 2nd Workshops on Natural Logic Meets Machine Learning (NALOMA), (pp. 71-80). Association for Computational Linguistics, Groningen, the Netherlands (online). https://aclanthology.org/2021.naloma-1.9
[19] Kim, G., Kane, B., Duong, V., Mendiratta, M., McGuire, G., Sackstein, S., Platonov, G., & Schubert, L. (2019). Generating discourse inferences from unscoped episodic logical formulas. In: Proceedings of the First International Workshop on Designing Meaning Representations, (pp. 56-65). Association for Computational Linguistics, Florence, Italy. doi:10.18653/v1/W19-3306. https://aclanthology.org/W19-3306
[20] Kitaev, N., & Klein, D. (2018). Constituency parsing with a self-attentive encoder. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), (pp. 2676-2686). Association for Computational Linguistics, Melbourne, Australia. doi:10.18653/v1/P18-1249. https://aclanthology.org/P18-1249
[21] Lambek, J. (1988). Categorial and categorical grammars. In: Categorial Grammars and Natural Language Structures, (pp. 297-317). Springer
[22] Lavalle-Martínez, J.-d.-J., Montes-y-Gómez, M., Villaseñor-Pineda, L., Jiménez-Salazar, H., & Bárcenas-Patiño, I.-E. (2017). Equivalences among polarity algorithms. Studia Logica.
[23] MacCartney, B., & Manning, C.D. (2008). Modeling semantic containment and exclusion in natural language inference. In: Proceedings of the 22nd International Conference on Computational Linguistics (Coling 2008), (pp. 521-528). Coling 2008 Organizing Committee, Manchester, UK. https://aclanthology.org/C08-1066
[24] Miller, GA, WordNet: A lexical database for english, Communications of the ACM, 38, 11, 39-41, (1995) · doi:10.1145/219717.219748
[25] Mineshima, K., Martínez-Gómez, P., Miyao, Y., & Bekki, D. (2015). Higher-order logical inference with compositional semantics. In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, (pp. 2055-2061).
[26] Nayak, N., Kowarsky, M., Angeli, G., & Manning, C.D. (2014). A dictionary of nonsubsective adjectives. Technical Report CSTR 2014-04, Department of Computer Science, Stanford University. https://hci.stanford.edu/cstr/reports/2014-04.pdf
[27] Park, J.C. (1995). Quantifier scope and constituency. In: 33rd Annual Meeting of the Association for Computational Linguistics, (pp. 205-212). Association for Computational Linguistics, Cambridge, Massachusetts, USA. doi:10.3115/981658.981686. https://aclanthology.org/P95-1028
[28] Purtee, A., Schubert, L. (2012). TTT: A tree transduction language for syntactic and semantic processing. In: Proceedings of the Workshop on Applications of Tree Automata Techniques in Natural Language Processing. ATANLP ’12, (pp. 21-30). Association for Computational Linguistics, Stroudsburg, PA, USA.
[29] Rozanova, J., Ferreira, D., Thayaparan, M., Valentino, M., & Freitas, A. (2022). Decomposing natural logic inferences for neural NLI. In: Proceedings of the Fifth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP, (pp. 394-403). Association for Computational Linguistics, Abu Dhabi, United Arab Emirates (Hybrid). https://aclanthology.org/2022.blackboxnlp-1.33
[30] Ruys, E.G., & Winter, Y. (2011). Quantifier scope in formal linguistics. In: Handbook of Philosophical Logic, (pp. 159-225). Springer. doi:10.1007/978-94-007-0479-4_3
[31] Sánchez Valencia, V. (1991). Categorial Grammar and Natural Logic. Logic, Philosophy and Linguistics (LP) Series: ILTI Prepublication.
[32] Sánchez-Valencia, V., Studies on natural logic and categorial grammar, (1991), University of Amsterdam
[33] Schubert, L. (2002). Can we derive general world knowledge from texts? In: Proceedings of the Second International Conference on Human Language Technology Research. HLT ’02, (pp. 94-97). Morgan Kaufmann Publishers Inc., San Francisco, CA, USA. http://dl.acm.org/citation.cfm?id=1289189.1289263
[34] Schubert, L. (2014). From treebank parses to episodic logic and commonsense inference. In: Proceedings of the ACL 2014 Workshop on Semantic Parsing, (pp. 55-60). Association for Computational Linguistics, Baltimore, MD. http://www.aclweb.org/anthology/W14-2411
[35] Schubert, L., & Tong, M. (2003). Extracting and evaluating general world knowledge from the brown corpus. In: Proceedings of the HLT-NAACL 2003 Workshop on Text Meaning, (pp. 7-13). https://aclanthology.org/W03-0902
[36] Schubert, LK; Minker, J., The situations we talk about, Logic-based Artificial Intelligence, 407-439, (2000), Kluwer Academic Publishers · Zbl 0979.68116 · doi:10.1007/978-1-4615-1567-8_18
[37] Tian, R., Miyao, Y., & Matsuzaki, T. (2014). Logical inference on dependency-based compositional semantics. In: Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), (pp. 79-89). Association for Computational Linguistics, Baltimore, Maryland. doi:10.3115/v1/P14-1008. https://aclanthology.org/P14-1008
[38] Van Benthem, J. (1986). Essays in logical semantics. Studies in Linguistics and Philosophy, vol. 29. Springer. · Zbl 0619.03021
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.