AIC, overfitting principles, and the boundedness of moments of inverse matrices for vector autoregressions and related models

[摘要] in his somewhat informal derivation, Akaike (in Proceedings of the 2nd International Symposium Information Theory (C. B. Petrov and F. Csaki, Eds.), pp. 610-624, Academici Kiado, Budapest, 1973) obtained AIC's parameter-count adjustment to the log-likelihood as a bias correction: it yields an asymptotically unbiased estimate of the quantity that measures the average fit of the estimated model to an independent replicate of the data used for estimation. We present the first mathematically complete derivation of an analogous property of AIC for comparing vector autoregressions fit to weakly stationary series. As a preparatory result, we derive a very general overfitting principle, first formulated in a more limited context in Findley (Ann. Inst. Statist. Math. 43, 509-514, 1991), asserting that a natural measure of an estimated model's overfit due to parameter estimation is equal, asymptotically, to a measure of its accuracy loss with independent replicates. A formal principle of parsimony for fitted models is obtained from this, which for nested models, covers the situation in which all models considered are misspecified. To prove these results, we establish a set of general conditions under which, for each tau greater than or equal to 1, the absolute tauth moments of the entries of the inverse matrices associated with least squares estimation are bounded for sufficiently large sample sizes. (C) 2002 Elsevier Scienee (USA).

[发布日期] 2002-11-01

[关键词] model selection;misspecified models;principle of parsimony;least squares matrices;uniform Lipschitz condition;elliptical distributions