|
The text preprocessing influence analyze for author identification problem by bigram method
M. Yu. Kislitsyna
Abstract:
On the example of sufficiently representative number of authors and texts, a comparative analysis of the impact of text preprocessing programs on the possibility of identifying authors is carried out. The question of the sensitivity of the identification error by the proportion of changes in the source text is investigated. It is shown that the author's originality is preserved after preprocessing almost at the level of the original text.
Keywords:
machine classification, text preprocessing, bigram distribution, author identification.
Citation:
M. Yu. Kislitsyna, “The text preprocessing influence analyze for author identification problem by bigram method”, Keldysh Institute preprints, 2022, 067, 18 pp.
Linking options:
https://www.mathnet.ru/eng/ipmp3092 https://www.mathnet.ru/eng/ipmp/y2022/p67
|
Statistics & downloads: |
Abstract page: | 33 | Full-text PDF : | 13 | References: | 4 |
|