Choice of an evaluation algorithm using samples of limited size

The algorithm whereby the quality of an estimate obtained from an independent sample of limited size is chosen using the same sample. The algorithm performance is evaluated by four methods: estimating the actual average risk, estimating the forecasting performance, and parametric and nonparametric estimates of the men risk. The results are reported of experimental comparison of algorithms optimal in terms of every kind of estimate.