Abstract:
A new method of statistical analysis of texts is suggested. The frequency distribution of the first significant digits in numerals of English-language texts is considered. We have taken into account cardinal as well as ordinal numerals expressed both in figures, and verbally. To identify the author's use of numerals, we previously deleted from the text all idiomatic expressions and set phrases accidentally containing numerals, as well as itemizations and page numbers, etc. Benford's law is found to hold approximately for the frequencies of various first significant digits of compound literary texts by different authors; a marked predominance of the digit 1 is observed. In coherent authorial texts, characteristic deviations from Benford's law arise which are statistically stable significant author peculiarities that allow, under certain conditions, to consider the problem of authorship and distinguish between texts by different authors. The text should be large enough (at least about 200 kB). At the end of {1,2,…,9} digits row, the frequency distribution is subject to strong fluctuations and thus unrepresentative for our purpose. The aim of the theoretical explanation of the observed empirical regularity is not intended, which, however, does not preclude the applicability of the proposed methodology for text attribution. The approach suggested and the conclusions are backed by the examples of the computer analysis of works by W. M. Thackeray, M. Twain, R. L. Stevenson, J. Joyce, sisters Brontë, and J. Austen. On the basis of technique suggested, we examined the authorship of a text earlier ascribed to L. F. Baum (the result agrees with that obtained by different means). We have shown that the authorship of Harper Lee's “To Kill a Mockingbird” pertains to her, whereas the primary draft, “Go Set a Watchman”, seems to have been written in collaboration with Truman Capote. All results are confirmed on the basis of parametric Pearson's chi-squared test as well as non-parametric Mann–Whitney U test and Kruskal–Wallis test.
Keywords:
text attribution, first significant digit of numerals.
Received: 01.07.2017 Accepted: 14.08.2017
Document Type:
Article
UDC:
51-78, 519.234.3, 519.257, 81-139
Language: Russian
Citation:
A. V. Zenkov, “A novel method of stylometry based on the statistic of numerals”, Computer Research and Modeling, 9:5 (2017), 837–850
\Bibitem{Zen17}
\by A.~V.~Zenkov
\paper A novel method of stylometry based on the statistic of numerals
\jour Computer Research and Modeling
\yr 2017
\vol 9
\issue 5
\pages 837--850
\mathnet{http://mi.mathnet.ru/crm103}
\crossref{https://doi.org/10.20537/2076-7633-2017-9-5-837-850}
Linking options:
https://www.mathnet.ru/eng/crm103
https://www.mathnet.ru/eng/crm/v9/i5/p837
This publication is cited in the following 6 articles:
Lingmei Zhao, Jianjun Shi, Chenkai Zhang, Zhixiang Liu, “Authorship Detection on Classical Chinese Text Using Deep Learning”, Applied Sciences, 15:4 (2025), 1677
Andrei V. Zenkov, “Stylometry and Numerals Usage: Benford's Law and Beyond”, Stats, 4:4 (2021), 1051
Andrei Zenkov, Eugene Zenkov, Miroslav Zenkov, Larisa Sazanova, A.D. Nazarov, “Numerals in authorial Turkish-language texts and the stylometric analysis”, E3S Web Conf., 270 (2021), 01038
Andrei Zenkov, Eugene Zenkov, Ansgar Belke, E.B. Dvoryadkina, E.G. Animitsa, “A Novel Text Analysis Method: Numerals Reveal the Author”, SHS Web Conf., 93 (2021), 03026
Ansgar Belke, Andrei Zenkov, Larisa Sazanova, W. Strielkowski, E. Animitsa, E. Dvoryadkina, “Education and Sustainable development: interplay and implications”, E3S Web Conf., 208 (2020), 09010
N. D. Golev, G. V. Napreenko, “Prepositions and Case Forms of the Russian Language as a Subject of Identification Linguistics”, Vestn. Kemer. gos. univ., 21:3 (2019), 801