nep-for New Economics Papers
on Forecasting
Issue of 2009‒09‒11
three papers chosen by
Rob J Hyndman
Monash University

  1. Nested forecast model comparisons: a new approach to testing equal accuracy By Todd E. Clark; Michael W. McCracken
  2. In-sample tests of predictive ability: a new approach By Todd E. Clark; Michael W. McCracken
  3. Financial professionals' overconfidence: Is it experience, job, or attitude? By Gloede, Oliver; Menkhoff, Lukas

  1. By: Todd E. Clark; Michael W. McCracken
    Abstract: This paper develops bootstrap methods for testing whether, in a finite sample, competing out-of-sample forecasts from nested models are equally accurate. Most prior work on forecast tests for nested models has focused on a null hypothesis of equal accuracy in population basically, whether coefficients on the extra variables in the larger, nesting model are zero. We instead use an asymptotic approximation that treats the coefficients as non-zero but small, such that, in a finite sample, forecasts from the small model are expected to be as accurate as forecasts from the large model. Under that approximation, we derive the limiting distributions of pairwise tests of equal mean square error, and develop bootstrap methods for estimating critical values. Monte Carlo experiments show that our proposed procedures have good size and power properties for the null of equal finite-sample forecast accuracy. We illustrate the use of the procedures with applications to forecasting stock returns and inflation.
    Date: 2009
  2. By: Todd E. Clark; Michael W. McCracken
    Abstract: This paper presents analytical, Monte Carlo, and empirical evidence linking in-sample tests of predictive content and out-of-sample forecast accuracy. Our approach focuses on the negative effect that finite-sample estimation error has on forecast accuracy despite the presence of significant population-level predictive content. Specifically, we derive simple-to-use in-sample tests that test not only whether a particular variable has predictive content but also whether this content is estimated precisely enough to improve forecast accuracy. Our tests are asymptotically non-central chi-square or non-central normal. We provide a convenient bootstrap method for computing the relevant critical values. In the Monte Carlo and empirical analysis, we compare the effectiveness of our testing procedure with more common testing procedures.
    Date: 2009
  3. By: Gloede, Oliver; Menkhoff, Lukas
    Abstract: This paper examines financial professionals' overconfidence in their forecasting performance. We are the first to compare individual financial professionals' self-ratings with their true forecasting performance. Data spans several years at monthly frequency. The forecasters in our sample do not provide feasible self-ratings compared to their true performance but show overconfidence on average. In analyzing this, we find an easing relation to experience. Job characteristics are also related to less overconfidence, such as being a fund manager and using fundamental analysis. The same effect is found for the attitude to herd, whereas recent forecasting success comes along with more overconfidence.
    Keywords: overconfidence, self-rating, forecasting, foreign exchange, better-than-average, experience, performance
    JEL: G1 D84 F31
    Date: 2009–08

This nep-for issue is ©2009 by Rob J Hyndman. It is provided as is without any express or implied warranty. It may be freely redistributed in whole or in part for any purpose. If distributed in part, please include this notice.
General information on the NEP project can be found at For comments please write to the director of NEP, Marco Novarese at <>. Put “NEP” in the subject, otherwise your mail may be rejected.
NEP’s infrastructure is sponsored by the School of Economics and Finance of Massey University in New Zealand.