Bulletin of Irkutsk State University. Series Mathematics
RUS  ENG    JOURNALS   PEOPLE   ORGANISATIONS   CONFERENCES   SEMINARS   VIDEO LIBRARY   PACKAGE AMSBIB  
General information
Latest issue
Archive

Search papers
Search references

RSS
Latest issue
Current issues
Archive issues
What is RSS



Bulletin of Irkutsk State University. Series Mathematics:
Year:
Volume:
Issue:
Page:
Find






Personal entry:
Login:
Password:
Save password
Enter
Forgotten password?
Register


Bulletin of Irkutsk State University. Series Mathematics, 2021, Volume 38, Pages 84–95
DOI: https://doi.org/10.26516/1997-7670.2021.38.84
(Mi iigum470)
 

Algebraic and logical methods in computer science and artificial intelligence

On the accuracy of cross-validation in the classification problem

V. M. Nedel'ko

Sobolev Institute of Mathematics SB RAS, Novosibirsk, Russian Federation
References:
Abstract: In this work we will study the accuracy of the cross-validation estimates for decision functions. The main idea of the research consists in the scheme of statistical modeling that allows using real data to obtain statistical estimates, which are usually obtained only by using model (synthetic) distributions.
The studies confirm the well-known empirical recommendation to choose the number of folds equal to 5 or more. The choice of more than 10 folds does not yield a significant increase in accuracy. The use of repeated cross-validation also does not provide fundamental gain in precision.
The results of the experiments allow us to formulate an empirical fact that the accuracy of the estimates obtained by the cross-validation method is approximately the same as the accuracy of the estimates obtained from the test sample of half the size. This result can be easily explained by the fact that all the objects of the test sample are independent, and the estimates built by the cross-validation on different subsamples (folds) are not independent.
Keywords: K-fold cross-validation, accuracy, statistical estimates, machinelearning.
Funding agency Grant number
Russian Foundation for Basic Research 19-29-01175
Ministry of Science and Higher Education of the Russian Federation 0314-2019-0015
The study was carried out within the framework of the state contract of the Sobolev Institute of Mathematics (project no 0314-2019-0015) and with partial support by RFBF grant 19–29–01175.
Received: 30.10.2021
Bibliographic databases:
Document Type: Article
UDC: 519.246
MSC: 68T10, 62H30
Language: English
Citation: V. M. Nedel'ko, “On the accuracy of cross-validation in the classification problem”, Bulletin of Irkutsk State University. Series Mathematics, 38 (2021), 84–95
Citation in format AMSBIB
\Bibitem{Ned21}
\by V.~M.~Nedel'ko
\paper On the accuracy of cross-validation in the classification problem
\jour Bulletin of Irkutsk State University. Series Mathematics
\yr 2021
\vol 38
\pages 84--95
\mathnet{http://mi.mathnet.ru/iigum470}
\crossref{https://doi.org/10.26516/1997-7670.2021.38.84}
\isi{https://gateway.webofknowledge.com/gateway/Gateway.cgi?GWVersion=2&SrcApp=Publons&SrcAuth=Publons_CEL&DestLinkType=FullRecord&DestApp=WOS_CPL&KeyUT=000744196900006}
Linking options:
  • https://www.mathnet.ru/eng/iigum470
  • https://www.mathnet.ru/eng/iigum/v38/p84
  • Citing articles in Google Scholar: Russian citations, English citations
    Related articles in Google Scholar: Russian articles, English articles
    Statistics & downloads:
    Abstract page:79
    Full-text PDF :46
    References:23
     
      Contact us:
     Terms of Use  Registration to the website  Logotypes © Steklov Mathematical Institute RAS, 2024