Skip to main content
Log in

Extending the Coverage of a CCG System

  • Published:
Research on Language and Computation

Abstract

We demonstrate ways to enhance the coverage of a symbolic NLP system through data-intensive and machine learning techniques, while preserving the advantages of using a principled symbolic grammar formalism. We automatically acquire a large syntactic CCG lexicon from the Penn Treebank and combine it with semantic and morphological information from another hand-built lexicon using decision tree and maximum entropy classifiers. We also integrate statistical preprocessing methods in our system.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Ades A. E., Steedman M. J. (1982) On the Order of Words. Linguistics and Philosophy, 4, pp. 517-558.

    Google Scholar 

  • Ajdukiewicz K. (1935) Die Syntaktische Konnexität. In McCall S. (ed.), Polish Logic 1920–1939, Oxford University Press, pp. 207-231. Translated from Studia Philosophica, 1, pp. 1–27.

  • Bar-Hillel Y. (1953) A Quasi-Arithmetical Notation for Syntactic Description. Language, 29, pp. 47-58.

    Google Scholar 

  • Bierner G. (2001) Alternative Phrases: Theoretical Analysis and Practical Applications. PhD thesis, Division of Informatics, University of Edinburgh.

  • Bresnan J. W., Kaplan R. M., Peters S., Zaenen A. (1982) Cross-Serial Dependencies in Dutch. Linguistic Inquiry, 13, pp. 613-636.

    Google Scholar 

  • Carpenter B. (1992) Categorial Grammars, Lexical Rules, and the English Predicative. In Levine (ed.), Formal Grammar: Theory and Implementation, Oxford University Press, pp. 168-242.

  • Chen J., Vijay-Shanker K. (2000) Automated Extraction of TAGs from the Penn Treebank. In Proceedings of the 6th International Workshop on Parsing Technologies, Trento, Italy.

  • Chiang D. (2000) Statistical Parsing with an Automatically-Extracted Tree Adjoining Grammar. In Proceedings of the 38th Annual Meeting of the Association for Compuational Linguistics, Hong Kong, October, pp. 456-463.

  • Clark S., Hockenmaier J., Steedman M. (2002) Building Deep Dependency Structures with a Wide-Coverage CCG Parser In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, Philadelphia, July, pp. 327-334.

  • Cohen W. (1995) Fast Effective Rule Induction. In Machine Learning: Proceedings of the Twelfth International Conference, pp. 115-123.

  • Collins, M. (1999) Head-Driven Statistical Models for Natural Language Parsing. PhD thesis, University of Pennsylvania.

  • Curry H. B., Feys R. (1958) Combinatory Logic: Vol I. North Holland, Amsterdam.

    Google Scholar 

  • Doran C., Srinivas B. (2000) Developing a Wide-Coverage CCG System. In Abeillé A., Rambow O. (eds.), Tree-Adjoining Grammars, CSLI Publications, pp. 405-426.

  • Dowding J., Gawron J. M., Appelt D., Cherny L., Moore R., Moran D. (1993) Gemini: A Natural Language System for Spoken Language Understanding. In Proceedings of the 31st Annual Meeting of the Association of Computational Linguistics, Columbus, OH, pp. 54-61.

  • Free Software Foundation (1991) GNU Lesser General Public License. http://www.gnu.org/copyleft/lesser.html.

  • Grover C., Carroll J., Briscoe T. (1993) The Alvey Natural Language Tools Grammar. Technical report, The University of Edinburgh, Human Communication Research Centre.

  • Hockenmaier J. (2001) Statistical Parsing for CCG with Simple Generative Models. In Proceedings of the Student Research Workshop of the 39th Annual Meeting of the Association of Computational Linguistics and the 10th Conference of the European Chapter, Toulouse, France, pp. 7-12.

  • Hockenmaier J., Steedman M. (2002a) Acquiring Compact Lexicalized Grammars from a Cleaner Treebank In Proceedings of Third International Conference on Language Resources and Evaluation, ELRA, Las Palmas, pp. 1974-1981.

    Google Scholar 

  • Hockenmaier J., Steedman M. (2002b) Generative Models for Statistical Parsing with Combinatory Categorial Grammar In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, Philadelphia, July, pp. 335-342.

  • Joshi A. (1988) Tree Adjoining Grammars. In Dowty D., Karttunen L., Zwicky A. (eds.), Natural Language Parsing, Cambridge University Press, Cambridge, pp. 206-250.

    Google Scholar 

  • Joshi A., Vijay-Shanker K., Weir D. (1991) The Convergence of Mildly Context-Sensitive Formalisms. In Sells P., Shieber S., Wasow T. (eds.), Processing of Linguistic Structure, MIT Press, Cambridge MA, pp. 31-81.

    Google Scholar 

  • Kaplan R., Bresnan J. (1982) Lexical-Functional Grammar: A Formal System for Grammatical Representation. In The Mental Representation of Grammatical Relations, MIT Press, Cambridge, MA, pp. 173-281.

    Google Scholar 

  • Magerman D. M. (1994) Natural Language Parsing as Statistical Pattern Recognition. PhD thesis, Stanford University.

  • Marcus M. P., Santorini B., Marcinkiewicz M. A. (1993) Building a Large Annotated Corpus of English: The Penn Treebank. Computational Linguistics, 19, pp. 313-330.

    Google Scholar 

  • Mikheev A. (1999) A Knowledge-Free Method for Capitalized Word Disambiguation. In Proceedings of the 37th Annual Meeting of the Association for Compuational Linguistics, pp. 159-166.

  • Mikheev A., Grover C., Moens M. (1998) Description of the LTG system used for MUC-7. In Proceedings of the 7th Message Understanding Conference (MUC-7).

  • Pollard C., Sag I. (1994) Head Driven Phrase Structure Grammar. CSLI/Chicago University Press, Chicago.

    Google Scholar 

  • Ratnaparkhi A. (1997) A Simple Introduction to Maximum Entropy Models for Natural Language Processing. Technical Report IRCS-97-08, University of Pennsylvania, Institute for Research in Cognitive Science.

  • Ratnaparkhi A. (1998) Maximum Entropy Models for Natural Language Ambiguity Resolution. PhD thesis, University of Pennsylvania.

  • Rayner M., Hockey B. A., James F. (2000) A Compact Architecture for Dialogue Management Based on Scripts and Meta-Outputs. In Proceedings of Applied Natural Language Processing, Seattle, pp. 112-118.

  • Reynar J., Ratnaparkhi A. (1997) A Maximum Entropy Approach to Identifying Sentence Boundaries. In Proceedings of the International Conference on Spoken Language Processing, Washington D.C., pp. 16-19.

  • Srinivas B. (1997) Complexity of Lexical Descriptions and Its Relevance to Partial Parsing. PhD thesis, University of Pennsylvania. IRCS Report 97-10.

  • Steedman M. (1985) Dependency and Coordination in the Grammar of Dutch and English. Language, 61, pp. 523-568.

    Google Scholar 

  • Steedman M. (1987) Combinatory Grammars and Parasitic Gaps. Natural Language and Linguistic Theory, 5, pp. 403-439.

    Google Scholar 

  • Steedman M. (1996) Surface Structure and Interpretation. MIT Press, Cambridge MA. Linguistic Inquiry Monograph, 30.

    Google Scholar 

  • Steedman M. (2000a) Information Structure and the Syntax-phonology Interface. Linguistic Inquiry, 34.

  • Steedman M. (2000b) The Syntactic Process. The MIT Press, Cambridge MA.

    Google Scholar 

  • Vijay-Shanker K., Weir D. (1994) The Equivalence of Four Extensions of Context-free Grammar. Mathematical Systems Theory, 27, 511-546.

    Google Scholar 

  • Villavicencio A. (1997) Building a Wide-Coverage Combinatory Categorial Grammar. Master's thesis, Cambridge.

  • Watkinson S., Manandhar, S. (2001). Translating Treebank Annotation for Evaluation. In Workshop on Evaluation for Language and Dialogue Systems, ACL/EACL, Toulouse, pp. 21-28.

  • World Wide Web Consortium (1997) Extensible Markup Language (XML). Web Page, http://www.w3.org/XML/.

  • Xia F. (1999) Extracting Tree Adjoining Grammars from Bracketed Corpora. In Proceedings of the 5th Natural Language Processing Pacific Rim Symposium (NLPRS-99), Beijing.

  • XTAG-Group (1999) A Lexicalized Tree Adjoining Grammar for English. Technical Report IRCS-98-18, University of Pennsylvania.

Download references

Author information

Authors and Affiliations

Authors

About this article

Cite this article

Hockenmaier, J., Bierner, G. & Baldridger, J. Extending the Coverage of a CCG System. Research on Language and Computation 2, 165–208 (2004). https://doi.org/10.1023/B:ROLC.0000016736.80096.76

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/B:ROLC.0000016736.80096.76

Navigation