Palgrave Handbook of Econometrics: Applied Econometrics

(Grace) #1
Gunnar Bårdsen and Ragnar Nymoen 899

disturbances – even underA. SituationBrepresents the situation theoretical expo-
sitions of inflation targeting conjure up (see Svensson, 1999). The properties of
situationAwill still hold – even though the inherent uncertainty will increase. If
Brepresents the premise for actual inflation targeting, there would be no forecast
failures, defined as a significant deterioration of forecast performance relative to in-
sample behavior (see, e.g., Hendry, 2006). The within-sample fit of section 17.4.2.2
corresponds to situationB, subject to the assumption that NAM is a congruent
model of the aggregate Norwegian economy.
The limited relevance of situationBfor inflation targeting becomes clear once
we recognize that, in practice, we do not know what kind of shocks will hit the
economy during the forecast period. We generally refer to such changes asregime
shifts,and their underlying causes include changes in technology and political deci-
sions and, more generally, “the complexity and instability of human behaviour”
(Elster, 2007, p. 467). A forecast failure effectively invalidates any claim about a
“correct” forecasting mechanism. Upon finding a forecast failure, the issue is there-
fore whether the misspecification was detectable or not at the time of preparing
the forecast. It is quite possible that a model which has been thoroughly tested for
misspecification within-sample nevertheless forecasts badly, which may occur in
situationC.
As discussed by Clements and Hendry (1999), a dominant source of forecast fail-
ure is regime shifts in the forecast period, i.e.,afterthe preparation of the forecasts.
Since there is no way of anticipating them, it is unavoidable thatafter-forecast
breaks damage forecasts from time to time. For example, when assessing infla-
tion targeting over a period of years, we anticipate that the forecasters have done
markedly worse than they expected at the time of preparing their forecasts, simply
because there is no way of anticipating structural breaks before they occur. The task
is then to be able to detect the nature of the regime shift as quickly as possible, in
order to avoid repeated unnecessary forecast failure.
However, experience tells us that forecast failures are sometimes due to shocks
and parameter changes that have taken place prior to the preparation of the fore-
cast, but which have remained undetected by the forecasters. Failing to detect a
before-forecaststructural break might be due to the low power of statistical tests
of parameter instability. However, the power is actually quite high for the kind
of breaks that are most damaging to model forecasts (see Hendry, 2000). There
are also practical circumstances that complicate and delay the detection of regime
shifts. For example, there is usually uncertainty about the quality of the provi-
sional data for the period that initialize the forecasts, making it difficult to assess
the significance of a structural change or shock.
Hence both after- and before-forecast structural breaks are realistic aspects of
real-life forecasting situations that deserve the attention of inflation targeters. In
particular, one should seek forecasting models and tools which help cultivate an
adaptive forecasting process. The literature on forecasting and model evaluation
provide several guidelines (see, e.g., Hendry, 2001a; Granger, 1999).
SituationDbrings us to the realistic situation, namely one of uncertainty and dis-
cord regarding what kind of model approximates reality; in other words, the issues
of model specification and model evaluation. In section 17.4.3 we saw that in policy

Free download pdf