Abstract:
In this paper the various methods of machine classification of scientific texts by thematic sections on the example of publications in specialized medical journals published by Springer are compared. The corpus of texts was studied in five sections: pharmacology/toxicology, cardiology, immunology, neurology and oncology. We considered both classification methods based on the analysis of annotations and keywords, and classification methods based on the processing of actual texts. Methods of Bayesian classification, reference vectors, and reference letter combinations were applied. It is shown that the method of classification with the best accuracy is based on creating a library of standards of letter trigrams that correspond to texts of a certain subject. It is turned out that for this corpus the Bayesian method gives an error of about 20 %, the support vector machine has error of order 10 %, and the proximity of the distribution of three-letter text to the standard theme gives an error of about 5 %, which allows to rank these methods to the use of artificial intelligence in the task of text classification by industry specialties. It is important that the support vector method provides the same accuracy when analyzing annotations as when analyzing full texts, which is important for reducing the number of operations for large text corpus.
Keywords:
machine learning, medicine texts classification, statistical analysis.
Citation:
G. V. Danilov, V. V. Zhukov, A. S. Kulikov, E. S. Makashova, N. A. Mitin, Yu. N. Orlov, “Comparative analysis of statistical methods of scientific publications classification in medicine”, Computer Research and Modeling, 12:4 (2020), 921–933
\Bibitem{DanZhuKul20}
\by G.~V.~Danilov, V.~V.~Zhukov, A.~S.~Kulikov, E.~S.~Makashova, N.~A.~Mitin, Yu.~N.~Orlov
\paper Comparative analysis of statistical methods of scientific publications classification in medicine
\jour Computer Research and Modeling
\yr 2020
\vol 12
\issue 4
\pages 921--933
\mathnet{http://mi.mathnet.ru/crm825}
\crossref{https://doi.org/10.20537/2076-7633-2020-12-4-921-933}
Linking options:
https://www.mathnet.ru/eng/crm825
https://www.mathnet.ru/eng/crm/v12/i4/p921
This publication is cited in the following 8 articles:
Parviz Saizhafarovich Murodov, Alexander Viktorovich Prutzkow, “MATHEMATICAL MODEL OF FUZZY DEFINITION OF SUBJECTS OF SCIENTIFIC ARTICLES USING SYNTACTICALLY RELATED WORDS”, tnusns, 2024:2 (2024)
K. A. Chernov, “Artificial intelligence in the field of information support of emergencies (literature review)”, Med.-biol. soc.-psihol. probl. bezop. črezvyčajnyh situac., 2023, no. 3, 111
K. A. Chernov, S. D. Misyurin, V. A. Glukhov, S. A. Durnev, “Disaster medicine: analysis of research papers by Russian investigators based on artificial intelligence methods (2005–2021)”, Med.-biol. soc.-psihol. probl. bezop. črezvyčajnyh situac., 2023, no. 1, 109
Jarosław Protasiewicz, Studies in Computational Intelligence, 1101, Knowledge Recommendation Systems with Machine Intelligence Algorithms, 2023, 9
Mahmad Isroil Saidzoda, Fayzali Saʹdullo Komiliyon, “MODELING THE ACTIVITY OF THE HONEY BEE FAMILY UNDER THE INFLUENCE OF DISEASES AND PESTS, TAKING INTO ACCOUNT AGE AND SEX CHARACTERISTICS”, tnusns, 2024:1 (2023)
A. I. Berger, S. A. Guda, “Svoistva algoritmov poiska optimalnykh porogov dlya zadach mnogoznachnoi klassifikatsii”, Kompyuternye issledovaniya i modelirovanie, 14:6 (2022), 1221–1238
B. Inomov, M. Tropmann-Frick, “Scientific Texts Classification by Speciality with Machine Learning Methods”, jour, 20:2 (2022), 27
M. Yu. Voronina, A. A. Kislitsyn, Yu. N. Orlov, “Two-factor patterns construction in problems of texts classification”, Keldysh Institute preprints, 2022, 43–24