Abstract
The paper introduces the SYN2020 corpus, a newly released representative corpus of written Czech following the tradition of the Czech National Corpus SYN series. The design of SYN2020 incorporates several substantial new features in the area of segmentation, lemmatization and morphological tagging, such as a new treatment of lemma variants, a new system for identifying morphological categories of verbs or a new treatment of multiword tokens. The annotation process, including data and tools used, is described, and the tools and accuracy of the annotation are discussed as well.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
- 2.
- 3.
Prague Dependency Treebank.
- 4.
The system of notation for the glosses and abbreviations used adheres to The Leipzig Glossing Rules [4] http://www.eva.mpg.de/lingua/resources/glossing-rules.php.
- 5.
- 6.
- 7.
For amalgamated forms, see Sect. 2.3, the values were calculated on their multiword representations, i.e. before their reamalgamation.
References
Bański, P., Przepiórkowski, A.: Stand-off TEI annotation: the case of the National Corpus of Polish. In: Proceedings of the Third Linguistic Annotation Workshop (LAW III), pp. 64–67 (2009)
Bejček, E., Panevová, J., Popelka, J., Straňák, P., Ševčíková, M., Štěpánek, J., Žabokrtský, Z.: Prague Dependency Treebank 2.5–a revisited version of PDT 2.0. In: Proceedings of COLING 2012, pp. 231–246 (2012)
Bojanowski, P., Grave, E., Joulin, A., Mikolov, T.: Enriching word vectors with subword information. arXiv preprint arXiv:1607.04606 (2016)
Comrie, B., Haspelmath, M., Bickel, B.: The Leipzig Glossing Rules: Conventions for Interlinear Morpheme-by-morphene Glosses. Max Planck Institute for Evolutionary Anthropology (2008)
Goláňová, H., et al.: Novočeský lexikální archiv a excerpce v průběhu let 1911–2011. Slovo a slovesnost 72(4), 287–300 (2011)
Hajič, J.: Disambiguation of rich inflection: computational morphology of Czech. Karolinum (2004)
Hajič, J., et al.: Prague dependency treebank-consolidated 1.0. In: Proceedings of the 12th International Conference on Language Resources and Evaluation (LREC 2020), pp. 5208–5218. ELRA, Marseille, France (2020)
Jelínek, T.: FicTree: a manually annotated treebank of Czech fiction. In: Hlaváčová, J. (ed.) ITAT 2017 Proceedings, pp. 181–185 (2017)
Jelínek, T., Petkevič, V.: Systém jazykového značkování současné psané češtiny. Korpusová lingvistika Praha 2011, sv. 3: Gramatika a značkování korpusů, pp. 154–170 (2011)
Ling, W., Dyer, C., Black, A., Trancoso, I.: Two/too simple adaptations of word2vec for syntax problems. In: Proceedings of the 2015 Conference of the North American Chapter of ACL: Human Language Technologies. ACL (2015)
Martins, A., Almeida, M., Smith, N.A.: Turning on the turbo: fast third-order non-projective turbo parsers. In: Annual Meeting of the ACL, pp. 617–622, August 2013
Nivre, J., et al.: Universal dependencies v2: an evergrowing multilingual treebank collection (2020)
Petkevič, V.: Reliable morphological disambiguation of Czech: rule-based approach is necessary. Insight into the Slovak and Czech corpus linguistics, pp. 26–44 (2006)
Petkevič, V., et al.: Problémy automatické morfologické disambiguace češtiny. Naše řeč 4–5, 194–207 (2014)
Štěpánková, B., Mikulová, M., Hajič, J.: The MorfFlex Dictionary of Czech as a Source of Linguistic Data. In: Euralex XIX Proceedings Book: Lexicography for inclusion. pp. 387–391 (2020)
Straka, M., Straková, J., Hajič, J.: Czech text processing with contextual embeddings: POS tagging, lemmatization, parsing and NER. In: Ekštein, K. (ed.) TSD 2019. LNCS (LNAI), vol. 11697, pp. 137–150. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-27947-9_12
Straková, J., Straka, M., Hajič, J.: Open-source tools for morphology, lemmatization, POS tagging and named entity recognition. In: Proceedings of 52nd Annual Meeting of ACL: System Demonstrations, pp. 13–18 (2014)
Votrubec, J.: Morphological tagging based on averaged perceptron. In: WDS 2006 Proceedings of Contributed Papers, pp. 191–195. Matfyzpress, Charles University, Praha, Czechia (2006)
Xuezhe, M., Zecong, H., Jingzhou, L., Nanyun, P., Neubig, G., Hovy, E.H.: Stack-pointer networks for dependency parsing. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, pp. 1403–1414. ACL, Melbourne, Australia (2018)
Acknowledgements
This paper and the creation of the corpus SYN2020 have been supported by the Ministry of Education of the Czech Republic, through the project Czech National Corpus, no. LM2018137.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Jelínek, T., Křivan, J., Petkevič, V., Skoumalová, H., Šindlerová, J. (2021). SYN2020: A New Corpus of Czech with an Innovated Annotation. In: Ekštein, K., Pártl, F., Konopík, M. (eds) Text, Speech, and Dialogue. TSD 2021. Lecture Notes in Computer Science(), vol 12848. Springer, Cham. https://doi.org/10.1007/978-3-030-83527-9_4
Download citation
DOI: https://doi.org/10.1007/978-3-030-83527-9_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-83526-2
Online ISBN: 978-3-030-83527-9
eBook Packages: Computer ScienceComputer Science (R0)