
Board of Governors of the Federal Reserve System
International Finance Discussion Papers
Number 866, August 2006-Screen Reader Version*
NOTE: International Finance Discussion Papers are preliminary materials circulated to stimulate discussion and critical comment. References in publications to International Finance Discussion Papers (other than an acknowledgment that the writer has had access to unpublished material) should be cleared with the author or authors. Recent IFDPs are available on the Web at http://www.federalreserve.gov/pubs/ifdp/. This paper can be downloaded without charge from the Social Science Research Network electronic library at http://www.ssrn.com/.
Abstract:
This paper analyzes the quality of VAR-based procedures for estimating the response of the economy to a shock. We focus on two key issues. First, do VAR-based confidence intervals accurately reflect the actual degree of sampling uncertainty associated with impulse response functions? Second, what is the size of bias relative to confidence intervals, and how do coverage rates of confidence intervals compare with their nominal size? We address these questions using data generated from a series of estimated dynamic, stochastic general equilibrium models. We organize most of our analysis around a particular question that has attracted a great deal of attention in the literature: How do hours worked respond to an identified shock? In all of our examples, as long as the variance in hours worked due to a given shock is above the remarkably low number of 1 percent, structural VARs perform well. This finding is true regardless of whether identification is based on short-run or long-run restrictions. Confidence intervals are wider in the case of long-run restrictions. Even so, long-run identified VARs can be useful for discriminating among competing economic models.
Keywords: Vector autoregression, dynamic stochastic general equilibrium model, confidence intervals, impulse response functions, identification, long run restrictions, specification error, sampling
JEL Classification: C1
Sims's seminal paper Macroeconomics and Reality (1980) argued that procedures based on vector autoregression (VAR) would be useful to macroeconomists interested in constructing and evaluating economic models. Given a minimal set of identifying assumptions, structural VARs allow one to estimate the dynamic effects of economic shocks. The estimated impulse response functions provide a natural way to choose the parameters of a structural model and to assess the empirical plausibility of alternative models.1
To be useful in practice, VAR-based procedures must have good sampling properties. In particular, they should accurately characterize the amount of information in the data about the effects of a shock to the economy. Also, they should accurately uncover the information that is there.
These considerations lead us to investigate two key issues. First, do VAR-based confidence intervals accurately reflect the actual degree of sampling uncertainty associated with impulse response functions? Second, what is the size of bias relative to confidence intervals, and how do coverage rates of confidence intervals compare with their nominal size?
We address these questions using data generated from a series of estimated dynamic, stochastic general equilibrium (DSGE) models. We consider real business cycle (RBC) models and the model in Altig, Christiano, Eichenbaum, and Linde (2005) (hereafter, ACEL) that embodies real and nominal frictions. We organize most of our analysis around a particular question that has attracted a great deal of attention in the literature: How do hours worked respond to an identified shock? In the case of the RBC model, we consider a neutral shock to technology. In the ACEL model, we consider two types of technology shocks as well as a monetary policy shock.
We focus our analysis on an unavoidable specification error that occurs when the data generating process is a DSGE model and the econometrician uses a VAR. In this case the true VAR is infinite ordered, but the econometrician must use a VAR with a finite number of lags.
We find that as long as the variance in hours worked due to a given shock is above the remarkably low number of 1 percent, VAR-based methods for recovering the response of hours to that shock have good sampling properties. Technology shocks account for a much larger fraction of the variance of hours worked in the ACEL model than in any of our estimated RBC models. Not surprisingly, inference about the effects of a technology shock on hours worked is much sharper when the ACEL model is the data generating mechanism.
Taken as a whole, our results support the view that structural VARs are a useful guide to constructing and evaluating DSGE models. Of course, as with any econometric procedure it is possible to find examples in which VAR-based procedures do not do well. Indeed, we present such an example based on an RBC model in which technology shocks account for less than 1 percent of the variance in hours worked. In this example, VAR-based methods work poorly in the sense that bias exceeds sampling uncertainty. Although instructive, the example is based on a model that fits the data poorly and so is unlikely to be of practical importance.
Having good sampling properties does not mean that structural VARs always deliver small confidence intervals. Of course, it would be a Pyrrhic victory for structural VARs if the best one could say about them is that sampling uncertainty is always large and the econometrician will always know it. Fortunately, this is not the case. We describe examples in which structural VARs are useful for discriminating between competing economic models.
Researchers use two types of identifying restrictions in structural VARs. Blanchard and Quah (1989), Gali (1999), and others exploit the implications that many models have for the long-run effects of shocks.2 Other authors exploit short-run restrictions.3 It is useful to distinguish between these two types of identifying restrictions to summarize our results.
We find that structural VARs perform remarkably well when identification is based on short-run restrictions. For all the specifications that we consider, the sampling properties of impulse response estimators are good and sampling uncertainty is small. This good performance obtains even when technology shocks account for as little as 0.5 percent of the variance in hours. Our results are comforting for the vast literature that has exploited short-run identification schemes to identify the dynamic effects of shocks to the economy. Of course, one can question the particular short-run identifying assumptions used in any given analysis. However, our results strongly support the view that if the relevant short-run assumptions are satisfied in the data generating process, then standard structural VAR procedures reliably uncover and identify the dynamic effects of shocks to the economy.
The main distinction between our short and long-run results is that the sampling uncertainty associated with estimated impulse response functions is substantially larger in the long-run case. In addition, we find some evidence of bias when the fraction of the variance in hours worked that is accounted for by technology shocks is very small. However, this bias is not large relative to sampling uncertainty as long as technology shocks account for at least 1 percent of the variance of hours worked. Still, the reason for this bias is interesting. We document that, when substantial bias exists, it stems from the fact that with long-run restrictions one requires an estimate of the sum of the VAR coefficients. The specification error involved in using a finite-lag VAR is the reason that in some of our examples, the sum of VAR coefficients is difficult to estimate accurately. This difficulty also explains why sampling uncertainty with long-run restrictions tends to be large.
The preceding observations led us to develop an alternative to the standard VAR-based estimator of impulse response functions. The only place the sum of the VAR coefficients appears in the standard strategy is in the computation of the zero-frequency spectral density of the data. Our alternative estimator avoids using the sum of the VAR coefficients by working with a nonparametric estimator of this spectral density. We find that in cases when the standard VAR procedure entails some bias, our adjustment virtually eliminates the bias.
Our results are related to a literature that questions the ability of long-run identified VARs to reliably estimate the dynamic response of macroeconomic variables to structural shocks. Perhaps the first critique of this sort was provided by Sims (1972). Although his paper was written before the advent of VARs, it articulates why estimates of the sum of regression coefficients may be distorted when there is specification error. Faust and Leeper (1997) and Pagan and Robertson (1998) make an important related critique of identification strategies based on long-run restrictions. More recently Erceg, Guerrieri, and Gust (2005) and Chari, Kehoe, and McGrattan (2005b) (henceforth CKM) also examine the reliability of VAR-based inference using long-run identifying restrictions.4Our conclusions regarding the value of identified VARs differ sharply from those recently reached by CKM. One parameterization of the RBC model that we consider is identical to the one considered by CKM. This parameterization is included for pedagogical purposes only, as it is overwhelmingly rejected by the data.
The remainder of the paper is organized as follows. Section 2 presents the versions of the RBC models that we use in our analysis. Section 3 discusses our results for standard VAR-based estimators of impulse response functions. Section 4 analyzes the differences between short and long-run restrictions. Section 5 discusses the relation between our work and the recent critique of VARs offered by CKM. Section 6 summarizes the ACEL model and reports its implications for VARs. Section 7 contains concluding comments.
In this section, we display the RBC model that serves as one of the data generating processes in our analysis. In this model the only shock that affects labor productivity in the long-run is a shock to technology. This property lies at the core of the identification strategy used by King, et al (1991), Gali (1999) and other researchers to identify the effects of a shock to technology. We also consider a variant of the model which rationalizes short run restrictions as a strategy for identifying a technology shock. In this variant, agents choose hours worked before the technology shock is realized. We describe the conventional VAR-based strategies for estimating the dynamic effect on hours worked of a shock to technology. Finally, we discuss parameterizations of the RBC model that we use in our experiments.
The representative agent maximizes expected utility over per
capita consumption,
and per capita hours worked,
The representative competitive firm's production function is:
Finally, the resource constraint is:
We consider two versions of the model, differentiated according
to timing assumptions. In the standard
or nonrecursive version, all time
decisions are taken
after the realization of the time
shocks. This is the conventional assumption in the
RBC literature. In the recursive
version of the model the timing assumptions are as follows.
First,
is observed,
and then labor decisions are made. Second, the other shocks are
realized and agents make their investment and consumption
decisions.
We now discuss the relation between the RBC model and a VAR. Specifically, we establish conditions under which the reduced form of the RBC model is a VAR with disturbances that are linear combinations of the economic shocks. Our exposition is a simplified version of the discussion in Fernandez-Villaverde, Rubio-Ramirez, and Sargent (2005) (see especially their section III). We include this discussion because it frames many of the issues that we address. Our discussion applies to both the standard and the recursive versions of the model.
We begin by showing how to put the reduced form of the RBC model
into a state-space, observer form. Throughout, we analyze the
log-linear approximations to model solutions. Suppose the variables
of interest in the RBC model are denoted by
Let
denote the vector of exogenous
economic shocks and let
denote the
percent deviation from steady state of the capital stock, after
scaling by
5 The approximate solution for
is given by:
The `state' of the system is composed of the variables on the right side of (2):
We now use (5) and (6) to establish conditions under which the reduced
form representation for
implied by the RBC model is a VAR with
disturbances that are linear combinations of the economic shocks.
In this discussion, we set
so that
In
addition, we assume that the number of elements in
coincides with the number of elements in ![]()
We begin by substituting (5) into (6) to obtain:
Proposition 2.1. (Fernandez-Villaverde, Rubio-Ramirez, and Sargent) If C is invertible and the eigenvalues of M are less than unity in absolute value, then the RBC model implies:
has the
infinite-order VAR representation in (10)
The linear
one-step-ahead forecast error
given past
's is
, which is related to the economic disturbances
by (11)
The
variance-covariance of
is
![]()
The sum of the
VAR lag matrices is given by:
We will use the last of these results below.
Relation (10) indicates why researchers
interested in constructing DSGE models find it useful to analyze
VARs. At the same time, this relationship clarifies some of the
potential pitfalls in the use of VARs. First, in practice the
econometrician must work with finite lags. Second, the assumption
that
is square and
invertible may not be satisfied. Whether
satisfies these conditions depends
on how
is
defined. Third, significant measurement errors may exist. Fourth,
the matrix,
, may not
have eigenvalues inside the unit circle. In this case, the economic
shocks are not recoverable from the VAR disturbances.6 Implicitly, the econometrician who
works with VARs assumes that these pitfalls are not quantitatively
important.
We are interested in the use of VARs as a way to estimate the
response of
to
economic shocks, i.e., elements of
In
practice, macroeconomists use a version of (10)
with finite lags, say
A researcher can estimate
and
To obtain the impulse
response functions, however, the researcher needs the
's and the column of
corresponding to the shock in
that is
of interest. However, to compute the required column of
requires additional
identifying assumptions. In practice, two types of assumptions are
used. Short-run assumptions take the form of direct restrictions on
the matrix
. Long-run
assumptions place indirect restrictions on
that stem from restrictions on the
long-run response of
to
a shock in an element of
. In
this section we use our RBC model to discuss these two types of
assumptions and how they are imposed on VARs in practice.
The log-linearized equilibrium laws of motion for capital and hours in this model can be written as follows:
In practice, researchers impose the exclusion and sign
restrictions on a VAR to compute
and
identify its dynamic effects on macroeconomic variables. Consider
the
vector,
The VAR for
is given by:
The symmetric matrix,
and the
's can be
computed using ordinary least squares regressions. However, the
requirement that
is not
sufficient to determine a unique value of
Adding the exclusion and sign
restrictions does uniquely determine
Relation (2.18) implies
that these restrictions are:
In the recursive version of the model, the policy rule for labor
involves
and
because these variables help forecast
and
Let
and
denote the population one-step-ahead forecast errors in
and
conditional on the information set,
The
recursive version of the model implies that
In practice, we implement the previous procedure using the
one-step-ahead forecast errors generated from a VAR in which the
variables in
are
ordered as follows:
We consider different specifications of the RBC model that are distinguished by the parameterization of the laws of motion of the exogenous shocks. In all specifications we assume, as in CKM , that:
We estimate two versions of our model. In the two-shock maximum likelihood estimation (MLE)
specification we assume that
so that
there are two shocks,
and
We
estimate the parameters
,
and
by
maximizing the Gaussian likelihood function of the vector,
subject to (24 )
9 Our results are given by:
The three-shock MLE specification
incorporates the investment tax shock,
into the
model. We estimate the three-shock MLE version of the model by
maximizing the Gaussian likelihood function of the vector,
, subject to the parameter values in (24)
The
results are:
The two-shock CKM specification has two shocks,
and
These
shocks have the following time series representations:
As in our specifications, CKM obtain their parameter estimates
using maximum likelihood methods. However, their estimates are very
different from ours. For example, the variances of the shocks are
larger in the two-shock CKM specification than in our MLE
specification. Also, the ratio of
to
is
nearly three times larger in the two-shock CKM specification than
in our two-shock MLE specification. Section 5 below discusses
the reasons for these differences.
Table 1 reports the contribution,
of technology shocks to three different
measures of the volatility in the log of hours worked: (i) the
variance of the log hours, (ii) the variance of HP-filtered, log
hours and (iii) the variance in the one-step-ahead forecast error
in log hours.11 With one
exception, we compute the analogous statistics for log output. The
exception is (i), for which we compute the contribution of
technology shocks to the variance of the growth rate of output.
The key result in this table is that technology shocks account
for a very small fraction of the volatility in hours worked. When
is measured
according to (i), it is always below 4 percent. When
is measured using (ii) or (iii)
it is always below 8 percent. For both (ii) and (iii), in the CKM
specifications,
is below 2 percent.12
Consistent with the RBC literature, the table also shows that
technology accounts for a much larger movement in output.
Figure 1 displays visually how unimportant technology shocks are
for hours worked. The top panel displays two sets of 180 artificial
observations on hours worked, simulated using the standard
two-shock MLE specification. The volatile time series shows how log
hours worked evolve in the presence of shocks to both
and
The other
time series shows how log hours worked evolve in response to just
the technology shock,
The bottom panel is the analog of the top
figure when the data are generated using the standard two-shock CKM
specification.
In this section we analyze the properties of conventional VAR-based strategies for identifying the effects of a technology shock on hours worked. We focus on the bias properties of the impulse response estimator, and on standard procedures for estimating sampling uncertainty.
We use the RBC model parameterizations discussed in the previous
section as the data generating processes. For each
parameterization, we simulate 1,000 data sets of 180 observations
each. The shocks
,
and possibly
are drawn from
standard normal distributions. For each artificial data set, we
estimate a four-lag VAR. The average, across the 1,000 data sets,
of the estimated impulse response functions, allows us to assess
bias.
For each data set we also estimate two different confidence intervals: a percentile-based confidence interval and a standard-deviation based confidence interval.13 We construct the intervals using the following bootstrap procedure. Using random draws from the fitted VAR disturbances, we use the estimated four lag VAR to generate 200 synthetic data sets, each with 180 observations. For each of these 200 synthetic data sets we estimate a new VAR and impulse response function. For each artificial data set the percentile-based confidence interval is defined as the top 2.5 percent and bottom 2.5 percent of the estimated coefficients in the dynamic response functions. The standard-deviation-based confidence interval is defined as the estimated impulse response plus or minus two standard deviations where the standard deviations are calculated across the 200 simulated estimated coefficients in the dynamic response functions.
We assess the accuracy of the confidence interval estimators in two ways. First, we compute the coverage rate for each type of confidence interval. This rate is the fraction of times, across the 1,000 data sets simulated from the economic model, that the confidence interval contains the relevant true coefficient. If the confidence intervals were perfectly accurate, the coverage rate would be 95 percent. Second, we provide an indication of the actual degree of sampling uncertainty in the VAR-based impulse response functions. In particular, we report centered 95 percent probability intervals for each lag in our impulse response function estimators.14 If the confidence intervals were perfectly accurate, they should on average coincide with the boundary of the 95 percent probability interval.
When we generate data from the two-shock MLE and CKM
specifications, we set
When we generate data from the three-shock MLE and CKM
specifications, we set
Figure 2 reports results generated from four different
parameterizations of the recursive version of the RBC model. In
each panel, the solid line is the average estimated impulse
response function for the 1,000 data sets simulated using the
indicated economic model. For each model, the starred line is the
true impulse response function of hours worked. In each panel, the
gray area defines the centered
percent probability interval for the estimated
impulse response functions. The stars with no line indicate the
average percentile-based confidence intervals across the 1,000 data
sets. The circles with no line indicate the average
standard-deviation-based confidence intervals.
Figures 3 and 4 graph the coverage rates for the percentile-based and standard-deviation-based confidence intervals. For each case we graph how often, across the 1,000 data sets simulated from the economic model, the econometrician's confidence interval contains the relevant coefficient of the true impulse response function.
The 1,1 panel in Figure 2 exhibits the properties of the VAR-based estimator of the response of hours to a technology shock when the data are generated by the two-shock MLE specification. The 2,1 panel corresponds to the case when the data generating process is the three-shock MLE specification.
The panels have two striking features. First, there is essentially no evidence of bias in the estimated impulse response functions. In all cases, the solid lines are very close to the starred lines. Second, an econometrician would not be misled in inference by using standard procedures for constructing confidence intervals. The circles and stars are close to the boundaries of the gray area. The 1,1 panels in Figures 3 and 4 indicate that the coverage rates are roughly 90 percent. So, with high probability, VAR-based confidence intervals include the true value of the impulse response coefficients.
The second column of Figure 2 reports the results when the data generating process is given by variants of the CKM specification. The 1,2 and 2,1 panels correspond to the two and three-shock CKM specification, respectively.
The second column of Figure 2 contains the same striking features as the first column. There is very little bias in the estimated impulse response functions. In addition, the average value of the econometrician's confidence interval coincides closely with the actual range of variation in the impulse response function (the gray area). Coverage rates, reported in the 1,2 panels of Figures 3 and 4, are roughly 90 percent. These rates are consistent with the view that VAR-based procedures lead to reliable inference.
A comparison of the gray areas across the first and second columns of Figure 2, clearly indicates that more sampling uncertainty occurs when the data are generated from the CKM specifications than when they are generated from the MLE specifications (the gray areas are wider). VAR-based confidence intervals detect this fact.
The first and second rows of column 1 in Figure 5 exhibit our results when the data are generated by the two- and three- shock MLE specifications. Once again there is virtually no bias in the estimated impulse response functions and inference is accurate. The coverage rates associated with the percentile-based confidence intervals are very close to 95 percent (see Figure 3). The coverage rates for the standard-deviation-based confidence intervals are somewhat lower, roughly 80 percent (see Figure 4). The difference in coverage rates can be seen in Figure 5, which shows that the stars are shifted down slightly relative to the circles. Still, the circles and stars are very good indicators of the boundaries of the gray area, although not quite as good as in the analog cases in Figure 2.
Comparing Figures 2 and 5, we see that Figure 5 reports more sampling uncertainty. That is, the gray areas are wider. Again, the crucial point is that the econometrician who computes standard confidence intervals would detect the increase in sampling uncertainty.
The third and fourth rows of column 1 in Figure 5 report results
for the two and three - shock CKM specifications. Consistent with
results reported in CKM, there is substantial bias in the estimated
dynamic response functions. For example, in the Two-shock CKM
specification, the contemporaneous response of hours worked to a
one-standard-deviation technology shock is
percent, while the mean
estimated response is
percent. This bias stands in contrast to our
other results.
Is this bias big or problematic? In our view, bias cannot be evaluated without taking into account sampling uncertainty. Bias matters only to the extent that the econometrician is led to an incorrect inference. For example, suppose sampling uncertainty is large and the econometrician knows it. Then the econometrician would conclude that the data contain little information and, therefore, would not be misled. In this case, we say that bias is not large. In contrast, suppose sampling uncertainty is large, but the econometrician thinks it is small. Here, we would say bias is large.
We now turn to the sampling uncertainty in the CKM specifications. Figure 5 shows that the econometrician's average confidence interval is large relative to the bias. Interestingly, the percentile confidence intervals (stars) are shifted down slightly relative to the standard-deviation-based confidence intervals (circles). On average, the estimated impulse response function is not in the center of the percentile confidence interval. This phenomenon often occurs in practice.15 Recall that we estimate a four lag VAR in each of our 1,000 synthetic data sets. For the purposes of the bootstrap, each of these VARs is treated as a true data generating process. The asymmetric percentile confidence intervals show that when data are generated by these VARs, VAR-based estimators of the impulse response function have a downward bias.
Figure 3 reveals that for the two- and three-shock CKM specifications, percentile-based coverage rates are reasonably close to 95 percent. Figure 4 shows that the standard deviation based coverage rates are lower than the percentile-based coverage rates. However even these coverage rates are relatively high in that they exceed 70 percent.
In summary, the results for the MLE specification differ from those of the CKM specifications in two interesting ways. First, sampling uncertainty is much larger with the CKM specification. Second, the estimated responses are somewhat biased with the CKM specification. But the bias is small: It has no substantial effect on inference, at least as judged by coverage rates for the econometrician's confidence intervals.
Here we show that the more important technology shocks are in
the dynamics of hours worked, the easier it is for VARs to answer
the question, `how do hours worked respond to a technology shock'.
We demonstrate this by considering alternative values of the
innovation variance in the labor tax,
and by
considering alternative values of
the utility parameter that controls the Frisch
elasticity of labor supply.
Consider Figure 6, which focuses on the long-run identification
schemes. The first and second columns report results for the
two-shock MLE and CKM specifications, respectively. For each
specification we redo our experiments, reducing
by a half
and then by a quarter. Table 1 shows that the importance of
technology shocks rises as the standard deviation of the labor tax
shock falls. Figure 6 indicates that the magnitude of sampling
uncertainty and the size of confidence intervals fall as the
relative importance of labor tax shocks falls.16
Figure 7 presents the results of a different set of experiments
based on perturbations of the two-shock CKM specification. The 1,1
and 2,1 panels show what happens when we vary the value of
, the parameter
that controls the Frisch labor supply elasticity. In the 1,1 panel
we set
which corresponds to a Frisch elasticity of 0.63. In the 2,1 panel,
we set
which corresponds to a Frisch elasticity of infinity. As the Frisch
elasticity is increased, the fraction of the variance in hours
worked due to technology shocks decreases (see Table 1). The
magnitude of bias and the size of confidence intervals are larger
for the higher Frisch elasticity case. In both cases the bias is
still smaller than the sampling uncertainty.
We were determined to construct at least one example in which
the VAR-based estimator of impulse response functions have bad
properties, i.e., bias is larger than sampling uncertainty. We
display such an example in the 3,1 panel of Figure 7. The data
generating process is a version of the two-shock CKM model with an
infinite Frisch elasticity and double the standard deviation of the
labor tax rate. Table 1 indicates that with this specification,
technology shocks account for a trivial fraction of the variance in
hours worked. Of the three measures of
two are
percent and the third is
percent . The 3,1
panel of Figure 7 shows that the VAR-based procedure now has very
bad properties: the true value of the impulse response function
lies outside the average value of both confidence intervals that we
consider. This example shows that constructing scenarios in which
VAR-based procedures go awry is certainly possible. However, this
example seems unlikely to be of practical significance given the
poor fit to the data of this version of the model.
Up to now, we have focused on the RBC model as the data generating process. For empirically reasonable specifications of the RBC model, confidence intervals associated with long-run identification schemes are large. One might be tempted to conclude that VAR-based long-run identification schemes are uninformative. Specifically, are the confidence intervals so large that we can never discriminate between competing economic models? Erceg, Guerrieri, and Gust (2005) show that the answer to this question is `no'. They consider an RBC model similar to the one discussed above and a version of the sticky wage-price model developed by Christiano, Eichenbaum, and Evans (2005) in which hours worked fall after a positive technology shock. They then conduct a series of experiments to assess the ability of a long-run identified structural VAR to discriminate between the two models on the basis of the response of hours worked to a technology shock.
Using estimated versions of each of the economic models as a data generating process, they generate 10,000 synthetic data sets each with 180 observations. They then estimate a four-variable structural VAR on each synthetic data set and compute the dynamic response of hours worked to a technology shock using long-run identification. Erceg, Guerrieri, and Gust (2005) report that the probability of finding an initial decline in hours that persists for two quarters is much higher in the model with nominal rigidities than in the RBC model (93 percent versus 26 percent). So, if these are the only two models contemplated by the researcher, an empirical finding that hours worked decline after a positive innovation to technology will constitute compelling evidence in favor of the sticky wage-price model.
Erceg, Guerrieri, and Gust (2005) also report that the probability of finding an initial rise in hours that persists for two quarters is much higher in the RBC model than in the sticky wage-price model (71 percent versus 1 percent). So, an empirical finding that hours worked rises after a positive innovation to technology would constitute compelling evidence in favor of the RBC model versus the sticky wage-price alternative.
The previous section demonstrates that, in the examples we
considered, when VARs are identified using short-run restrictions,
the conventional estimator of impulse response functions is
remarkably accurate. In contrast, for some parameterizations of the
data generating process, the conventional estimator of impulse
response functions based on long-run identifying restrictions can
exhibit noticeable bias. In this section we argue that the key
difference between the two identification strategies is that the
long-run strategy requires an estimate of the sum of the VAR
coefficients,
This object is notoriously difficult to estimate accurately (see
Sims, 1972).
We consider a simple analytic expression related to one in Sims
(1972). Our expression shows what an econometrician who fits a
misspecified, fixed-lag, finite-order VAR would find in population.
Let
and
denote the parameters of the
th-order VAR fit by
the econometrician. Then:
To understand the implications of (26) for
our analysis, it is useful to write in lag-operator form the
estimated dynamic response of
to a shock in the first element of
![]()
We use (26) to understand why estimation
based on short-run and long-run identification can produce
different results. According to (27), impulse
response functions can be decomposed into two parts, the impact
effect of the shocks, summarized by
and the
dynamic part summarized in the term in square brackets. We argue
that when a bias arises with long-run restrictions, it is because
of difficulties in estimating
These difficulties do not arise with short-run
restrictions.
In the short-run identification case,
is a
function of
only.
Across a variety of numerical examples, we find that
is very close to
21 This result is not surprising because
(26) indicates that the entire objective of
estimation is to minimize the distance between
and
In the long-run identification
case,
depends
not only on
but
also on
A problem is that the
criterion does not assign much weight to setting
unless
happens to be relatively
large in a neighborhood of
But, a large value of
is not something one can rely on.22 When
is relatively small, attempts to match
with
at other frequencies can
induce large errors in
![]()
The previous argument about the difficulty of estimating
in the long-run
identification case does not apply to the
s
According to (28)
is a
function of
over the whole
range of
's, not
just one specific frequency.
We now present a numerical example, which illustrates Proposition 1 as well as some of the observations we have made in discussing (26). Our numerical example focuses on population results. Therefore, it provides only an indication of what happens in small samples.
To understand what happens in small samples, we consider four
additional numerical examples. First, we show that when the
econometrician uses the true value of
, the
bias and much of the sampling uncertainty associated with the
Two-shock CKM specification disappears. Second, we demonstrate that
bias problems essentially disappear when we use an alternative to
the standard zero-frequency spectral density estimator used in the
VAR literature. Third, we show that the problems are attenuated
when the preference shock is more persistent. Fourth, we consider
the recursive version of the two-shock CKM specification in which
the effect of technology shocks can be estimated using either
short- or long-run restrictions.
Table 2 reports various properties of the two-shock CKM
specification. The first six
's in the infinite-order VAR, computed using
(12), are reported in Panel A. These
's eventually
converge to zero, however they do so slowly. The speed of
convergence is governed by the size of the maximal eigenvalue of
the matrix
in (8), which is 0.957. Panel B displays the
's that
solve (26) with
Informally, the
's look
similar to the
's
for
In line
with this observation, the sum of the true
's,
is
similar in magnitude to the sum of the estimated
's,
![]()