×

Pull out all the stops: textual analysis via punctuation sequences. (English) Zbl 07440302

Summary: Whether enjoying the lucid prose of a favourite author or slogging through some other writer’s cumbersome, heavy-set prattle (full of parentheses, em dashes, compound adjectives, and Oxford commas), readers will notice stylistic signatures not only in word choice and grammar but also in punctuation itself. Indeed, visual sequences of punctuation from different authors produce marvellously different (and visually striking) sequences. Punctuation is a largely overlooked stylistic feature in stylometry, the quantitative analysis of written text. In this paper, we examine punctuation sequences in a corpus of literary documents and ask the following questions: Are the properties of such sequences a distinctive feature of different authors? Is it possible to distinguish literary genres based on their punctuation sequences? Do the punctuation styles of authors evolve over time? Are we on to something interesting in trying to do stylometry without words, or are we full of sound and fury (signifying nothing)?
In our investigation, we examine a large corpus of documents from Project Gutenberg (a digital library with many possible editorial influences). We extract punctuation sequences from each document in our corpus and record the number of words that separate punctuation marks. Using such information about punctuation-usage patterns, we attempt both author and genre recognition, and we also examine the evolution of punctuation usage over time. Our efforts at author recognition are particularly successful. Among the features that we consider, the one that seems to carry the most explanatory power is an empirical approximation of the joint probability of the successive occurrence of two punctuation marks. In our conclusions, we suggest several directions for future work, including the application of similar analyses for investigating translations and other types of categorical time series.

MSC:

68T10 Pattern recognition, speech recognition
94A17 Measures of information, entropy
68T40 Artificial intelligence for robotics
91F20 Linguistics

Software:

GitHub; spaCy

References:

[1] Altmann, E. G., Dias, L. & Gerlach, M. (2017) Generalized entropies and the similarity of texts. J. Stat. Mech. Theory Exp.1, 014002.
[2] Arun, R., Suresh, V. & Madhavan, C. E. V. (2009) Stopword graphs and authorship attribution in text corpora. In: Proceedings of the 2009 IEEE International Conference on Semantic Computing, pp. 192-196.
[3] Calhoun, A. J. (2016) Punctuation code. Available at https://github.com/adamjcalhoun/punctuation.
[4] Calhoun, A. J. (2016) Punctuation in novels. Available at https://medium.com/ @neuroecology/punctuation-in-novels-8f316d542ec4#.brev0b3w1.
[5] Calhoun, A. J. (2016) What does punctuation tell us about Republicans and Democrats? Avai-lable at https://medium.com/@neuroecology/what-does-punctuation-tell-us-about-republicans-and-democrats-bd46b9f98220.
[6] Can, F. & Patton, J. M. (2004) Change of writing style with time. Comput. Human.38, 61-82.
[7] Chaski, C. E. (2001) Empirical evaluation of language-based author identification techniques. Forensic Linguist.8, 1-65.
[8] Chevyreva, I. & Kormilitzin, A. (2016) A primer on the signature method in machine learning. arXiv:1603.03788.
[9] Chiang, H., Ge, Y. & Wu, C. (2015) Classification of Book Genres by Cover and Title. Class report, Computer Science 229, Stanford University. Available at http://cs229.stanford.edu/proj2015/127_report.pdf.
[10] Cover, T. M. & Thomas, J. A. (1991) Elements of Information Theory, John Wiley & Sons, Inc., New York City, NY, USA. · Zbl 0762.94001
[11] Duda, R. O., Hart, P. E. & Stork, D. G. (2001) Pattern Classification, John Wiley & Sons, Inc., New York City, NY, USA. · Zbl 0968.68140
[12] Ebeling, W. & Pöschel, T. (1994) Entropy and long-range correlations in literary English. Europhysics Lett.26, 241-246.
[13] Forsyth, R. S. (1999) Stylochronometry with substrings, or: a poet young and old. Literary Linguist. Comput.14, 467-477.
[14] Fowler, H. W. & Fowler, F. G. (1906) The King’s English, Oxford University Press, Oxford, UK.
[15] Gerlach, M. & Font-Clos, F. (2020) A standardized Project Gutenberg corpus for statistical analysis of natural language and quantitative linguistics. Entropy22, 126.
[16] Gerlach, M., Font-Clos, F. & Altmann, E. G. (2016) Similarity of symbol frequency distributions with heavy tails. Phys. Rev. X6, 021009.
[17] Grieve, J. (2007) Quantitative authorship attribution: an evaluation of techniques. Literary Linguist. Comput.22, 251-270.
[18] Hart, M. S. (1971) Project Gutenberg. Available at https://www.gutenberg.org.
[19] Hartman, C. O. (2015) Verse: An Introduction to Prosody, Wiley-Blackwell, Hoboken, NJ, USA.
[20] Holmes, D. I. (1998) The evolution of stylometry in humanities scholarship. Literary Linguist. Comput.50, 111-117.
[21] Honnibal, M. (2017) spaCy. Available at https://spacy.io.
[22] Hughes, J. M., Foti, N. J., Krakauer, D. C. & Rockmore, D. N. (2012) Quantitative patterns of stylistic influence in the evolution of literature. Proc. Natl. Acad. Sci. U S A 109, 7682-7686.
[23] Jackson, M. P. (2002) Pause patterns in Shakespeare’s verse: canon and chronology. Literary Linguist. Comput.17, 37-46.
[24] Kessler, B., Nunberg, G. & Schutze, H. (1996) Automatic detection of text genre. In: Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics and Eighth Conference of the European Chapter of the Association for Computational Linguistics.
[25] Kjell, B. (1994) Authorship attribution of text samples using neural networks and Bayesian classifiers. In: Proceedings of the 1994 IEEE International Conference on Systems, Man and Cybernetics, Vol. 2, pp. 1660-1664.
[26] Kullback, S. & Leibler, R. A. (1951) On information and sufficiency. Ann. Math. Stat.22, 79-86. · Zbl 0042.38403
[27] Lai, S., Xu, L., Liu, K. & Zhao, J. (2015) Recurrent convolutional neural networks for text classification. In: Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence (AAAI ’15), pp. 2267-2273.
[28] Lawler, J. (2006) Punctuation. In: Ken Brown (editor), Encyclopedia of Language & Linguistics, 2nd ed., Elsevier, Amsterdam, The Netherlands.
[29] Lesne, A. (2014) Shannon entropy: a rigorous notion at the crossroads between probability, information theory, dynamical systems and statistical physics. Math. Struct. Comput. Sci.24, e240311. · Zbl 1342.94059
[30] Lewis, T. (1979) Notes on punctuation. In: The Medusa and the Snail: More Notes of a Biology Watcher, Viking Press, New York City, NY, USA.
[31] Lin, J. (1991) Divergence measures based on the Shannon entropy. IEEE Trans. Inf. Theory 37, 145-151. · Zbl 0712.94004
[32] Lyons, T. (2014) Rough paths, signatures and the modelling of functions on streams. In: Proceedings of the International Congress of Mathematicians 2014, Korea. Available at http://www.icm2014.org/download/Proceedings_Volume_IV.pdf. · Zbl 1373.93158
[33] Mendenhall, T. C. (1887) The characteristic curves of composition. Science9, 237-249.
[34] Mosteller, F. & Wallace, D. L. (1964) Inference and Disputed Authorship: The Federalist, Addison-Wesley, Reading, MA, USA. · Zbl 0122.14106
[35] Neal, T., Sundararajan, K., Fatima, A. & Woodard, D. (2018) Surveying stylometry techniques and applications. ACM Comput. Surv.50, 86.
[36] Neidorf, L., Krieger, M. S., Yakubek, M., Chaudhuri, P. & Dexter, J. P. (2019) Large-scale quantitative profiling of the old English verse tradition. Nat. Hum. Behav.3, 560-567.
[37] Nunberg, G. (1990) The Linguistics of Punctuation, Center for the Study of Language and Information, Stanford, CA, USA.
[38] Parkes, M. B. (editor) (1992) Pause and Effect: An Introduction to the History of Punctuation in the West, University of California Press, Berkeley, CA, USA.
[39] Pullum, G. & Huddleston, R. (2001) The Cambridge Grammar of the English Language, Cambridge University Press, The Other Place, UK.
[40] Qian, C., He, T. & Zhang, R. (2017) Deep Learning Based Authorship Identification. Class report, Computer Science 224, Stanford University. Available at https://pdfs.semanticscholar.org/ab0e/be094ec0a44fb0013d640b344d8cfd7adc81.pdf?_ga=2.215953495.1190289256.1578845031-6826891.1578845031.
[41] Santini, M. (2004) A shallow approach to syntactic feature extraction for genre classification. In: Proceedings of the 7th Annual Colloquium for the UK Special Interest Group for Computational Linguistics.
[42] Santini, M.State-of-the-Art on Automatic Genre Identification, Information Technology Research Institute (ITRI) Technical Report Series 04-03, University of Brighton, UK, (2004). Available at http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.5.7680.
[43] Shannon, C. E. (1948) A mathematical theory of communication. Bell Syst. Tech. J., 379-423, 623-656. · Zbl 1154.94303
[44] Shlens, J. (2014) Notes on Kullback-Leibler divergence and likelihood theory. arXiv:1404.2000.
[45] Stamatatos, E. (2009) A survey of modern authorship attribution methods. J. Am. Soc. Inf. Sci. Tech.60, 538-556.
[46] Stamou, C. (2008) Stylochronometry: stylistic development, sequence of composition, and relative dating. Literary Linguist. Comput.23, 181-199.
[47] Truss, L. (2004) Eats, Shoots and Leaves: The Zero Tolerance Approach to Punctuation, Profile Books, London, UK.
[48] Vieira, D. S., Picoli, S. & Mendes, R. S. (2018) Robustness of sentence length measures in written texts. Physica A506, 749-754.
[49] Watson, C. (2019) Semicolon: The Past, Present, and Future of a Misunderstood Mark, Ecco Press, New York, NY, USA.
[50] Whissell, C. (1996) Traditional and emotional stylometric analysis of the songs of Beatles Paul McCartney and John Lennon. Comput. Human.30, 257-265.
[51] Yang, A. C.-C., Peng, C.-K., Yien, H.-W. and Goldberger, A. (2003) Information categorization approach to literary authorship disputes. Physica A329, 473-483. · Zbl 1046.68647
[52] Zhao, Y., Zobel, J. & Vines, P. (2006) Using relative entropy for authorship attribution. In: Proceedings of the Third Asia Conference on Information Retrieval Technology (AIRS ’06), pp. 92-105.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.