Modern Parametric Statistics. Lecture 4

$$$$ Penalized maximum likelihood and the problem of choosing the penalty: $$$$ - Fisher and Wilks for penalized maximum likelihood. $$$$ - Uniform confidence bands and concentration of the empirical risk. $$$$ - Choice of tuning parameters by propagation idea.