Combining VAR and DSGE forecast densities

A popular macroeconomic forecasting strategy utilizes many models to hedge against instabilities of unknown timing; see (among others) Stock and Watson (2004), Clark and McCracken (2010), and Jore et al. (2010). Existing studies of this forecasting strategy exclude dynamic stochastic general equilibrium (DSGE) models, despite the widespread use of these models by monetary policymakers. In this paper, we use the linear opinion pool to combine inflation forecast densities from many vector autoregressions (VARs) and a policymaking DSGE model. The DSGE receives a substantial weight in the pool (at short horizons) provided the VAR components exclude structural breaks. In this case, the inflation forecast densities exhibit calibration failure. Allowing for structural breaks in the VARs reduces the weight on the DSGE considerably, but produces well-calibrated forecast densities for inflation.     

On the forecasting performance of a small-scale DSGE model

Dynamic stochastic general equilibrium (DSGE) models have recently become standard tools for policy analysis. Nevertheless, their forecasting properties have still barely been explored. In this article, we address this problem by examining the quality of forecasts of the key U.S. economic variables: the three-month Treasury bill yield, the GDP growth rate and GDP price index inflation, from a small-size DSGE model, trivariate vector autoregression (VAR) models and the Philadelphia Fed Survey of Professional Forecasters (SPF). The ex post forecast errors are evaluated on the basis of the data from the period 1994–2006. We apply the Philadelphia Fed “Real-Time Data Set for Macroeconomists” to ensure that the data used in estimating the DSGE and VAR models was comparable to the information available to the SPF.Overall, the results are mixed. When comparing the root mean squared errors for some forecast horizons, it appears that the DSGE model outperforms the other methods in forecasting the GDP growth rate. However, this characteristic turned out to be statistically insignificant. Most of the SPF's forecasts of GDP price index inflation and the short-term interest rate are better than those from the DSGE and VAR models.     

Marginalized Predictive Likelihood Comparisons of Linear Gaussian State‐Space Models with Applications to DSGE,DSGE‐VAR,and VAR Models

The predictive likelihood is useful for ranking models in forecast comparison exercises using Bayesian inference. We discuss how it can be estimated, by means of marzginalization, for any subset of the observables in linear Gaussian state‐space models. We compare macroeconomic density forecasts for the euro area of a DSGE model to those of a DSGE‐VAR, a BVAR and a multivariate random walk over 1999:Q1–2011:Q4. While the BVAR generally provides superior forecasts, its performance deteriorates substantially with the onset of the Great Recession. This is particularly notable for longer‐horizon real GDP forecasts, where the DSGE and DSGE‐VAR models perform better. Copyright © 2016 John Wiley & Sons, Ltd.     

Bayesian stochastic search for VAR model restrictions

We propose a Bayesian stochastic search approach to selecting restrictions for vector autoregressive (VAR) models. For this purpose, we develop a Markov chain Monte Carlo (MCMC) algorithm that visits high posterior probability restrictions on the elements of both the VAR regression coefficients and the error variance matrix. Numerical simulations show that stochastic search based on this algorithm can be effective at both selecting a satisfactory model and improving forecasting performance. To illustrate the potential of our approach, we apply our stochastic search to VAR modeling of inflation transmission from producer price index (PPI) components to the consumer price index (CPI).     

Testing the Structural Interpretation of the Price Puzzle with a Cost‐Channel Model*

We estimate a variety of small‐scale new‐Keynesian DSGE models with the cost channel to assess their ability to replicate the ‘price puzzle’, i.e. the inflationary impact of a monetary policy shock typically arising in vector autoregression (VAR) analysis. To correctly identify the monetary policy shock, we distinguish between a standard policy rate shifter and a shock to ‘trend inflation’, i.e. the time‐varying inflation target set by the Fed. Our estimated models predict a negative inflation reaction to a monetary policy tightening. We offer a discussion of the possible sources of mismatch between the VAR evidence and our own.     

Evaluating New‐Keynesian Models of a Small Open Economy*

We suggest a strategy to evaluate members of a class of New‐Keynesian models of a small open economy. As an example, we estimate a modified version of the model in Svensson [Journal of International Economics (2000) Vol. 50, pp. 155–183] and compare its impulse response and variance decomposition functions with those a structural vector autoregression (VAR) model. The focus is on responses to foreign rather than to domestic shocks, which facilitates identification. Some results are that US shocks account for large shares of the variance of Canadian variables, that little of this influence is due to real exchange rate movements, and that Canadian monetary policy is not adequately described by a Taylor rule.     

Leaning into the Wind: A Structural VAR Investigation of UK Monetary Policy*

This paper adapts Uhlig's [Journal of Monetary Economics (2005) forthcoming] sign restriction identification methodology to investigate the effects of UK monetary policy using a structural vector autoregression (VAR). It shows that shocks which can reasonably be described as monetary policy shocks have played only a small role in the total variation of UK monetary and macroeconomic variables. Most of the variation in UK monetary variables has been due to their systematic reaction to other macroeconomic shocks, namely non‐monetary aggregate demand, aggregate supply, and oil price shocks. We also find, without imposing any long run identifying restrictions, that aggregate supply shocks have permanent effects on output.     

Testing the New Keynesian Phillips Curve Through Vector Autoregressive Models: Results from the Euro Area*

This paper addresses the issue of testing the ‘hybrid’ New Keynesian Phillips curve (NKPC) through vector autoregressive (VAR) systems and likelihood methods, giving special emphasis to the case where the variables are non‐stationary. The idea is to use a VAR for both the inflation rate and the explanatory variable(s) to approximate the dynamics of the system and derive testable restrictions. Attention is focused on the ‘inexact’ formulation of the NKPC. Empirical results over the period 1971–98 show that the NKPC is far from providing a ‘good first approximation’ of inflation dynamics in the Euro area.     

Weak Identification of Forward‐looking Models in Monetary Economics*

Recently, single‐equation estimation by the generalized method of moments (GMM) has become popular in the monetary economics literature, for estimating forward‐looking models with rational expectations. We discuss a method for analysing the empirical identification of such models that exploits their dynamic structure and the assumption of rational expectations. This allows us to judge the reliability of the resulting GMM estimation and inference and reveals the potential sources of weak identification. With reference to the New Keynesian Phillips curve of Galí and Gertler [Journal of Monetary Economics (1999) Vol. 44, 195] and the forward‐looking Taylor rules of Clarida, Galí and Gertler [Quarterly Journal of Economics (2000) Vol. 115, 147], we demonstrate that the usual ‘weak instruments’ problem can arise naturally, when the predictable variation in inflation is small relative to unpredictable future shocks (news). Hence, we conclude that those models are less reliably estimated over periods when inflation has been under effective policy control.     

A Note on the Identification of Dynamic Economic Models with Generalized Shock Processes

Dynamic stochastic general equilibrium (DSGE) models with generalized shock processes, such as shock processes which follow a vector autoregression (VAR), have been an active area of research in recent years. Unfortunately, the structural parameters governing DSGE models are not identified when the driving process behind the model follows an unrestricted VAR. This finding implies that parameter estimates derived from recent attempts to estimate DSGE models with generalized driving processes should be treated with caution, and that there always exists a tradeoff between identification and the risk of model misspecification. However, these results also make it easier to address the issue of model misspecification by making it computationally easier to check the validity of cross‐equation restrictions.     

Evaluating Point and Density Forecasts of DSGE Models

This paper investigates the accuracy of forecasts from four dynamic stochastic general equilibrium (DSGE) models for inflation, output growth and the federal funds rate using a real‐time dataset synchronized with the Fed's Greenbook projections. Conditioning the model forecasts on the Greenbook nowcasts leads to forecasts that are as accurate as the Greenbook projections for output growth and the federal funds rate. Only for inflation are the model forecasts dominated by the Greenbook projections. A comparison with forecasts from Bayesian vector autoregressions shows that the economic structure of the DSGE models which is useful for the interpretation of forecasts does not lower the accuracy of forecasts. Combining forecasts of several DSGE models increases precision in comparison to individual model forecasts. Comparing density forecasts with the actual distribution of observations shows that DSGE models overestimate uncertainty around point forecasts. Copyright © 2013 John Wiley & Sons, Ltd.     

Fluctuation Tests for a Change in Persistence*

In this paper, we develop a set of new persistence change tests which are similar in spirit to those of Kim [Journal of Econometrics (2000) Vol. 95, pp. 97–116], Kim et al. [Journal of Econometrics (2002) Vol. 109, pp. 389–392] and Busetti and Taylor [Journal of Econometrics (2004) Vol. 123, pp. 33–66]. While the exisiting tests are based on ratios of sub‐sample Kwiatkowski et al. [Journal of Econometrics (1992) Vol. 54, pp. 158–179]‐type statistics, our proposed tests are based on the corresponding functions of sub‐sample implementations of the well‐known maximal recursive‐estimates and re‐scaled range fluctuation statistics. Our statistics are used to test the null hypothesis that a time series displays constant trend stationarity [I(0)] behaviour against the alternative of a change in persistence either from trend stationarity to difference stationarity [I(1)], or vice versa. Representations for the limiting null distributions of the new statistics are derived and both finite‐sample and asymptotic critical values are provided. The consistency of the tests against persistence change processes is also demonstrated. Numerical evidence suggests that our proposed tests provide a useful complement to the extant persistence change tests. An application of the tests to US inflation rate data is provided.     

Measuring the Connectedness of the Global Economy

We develop a technique to exploit forecast error variance decompositions to evaluate the macroeconomic connectedness embedded in any multi-country macroeconomic model with an approximate vector autoregressive (VAR) representation. We apply our technique to a large global VAR model covering 25 countries and derive vivid representations of macroeconomic connectedness. We find that the US exerts a dominant influence in the global economy and that Brazil, China, and the Eurozone are also globally significant. Recursive analysis over the period of the global financial crisis shows that shocks to global equity markets are transmitted rapidly and forcefully to real trade flows and real GDP.     

Testing for Parameter Stability in Dynamic Models across Frequencies*

This paper contributes to the econometric literature on structural breaks by proposing a test for parameter stability in vector autoregressive (VAR) models at a particular frequency ω, where ω ∈ [0, π]. When a dynamic model is affected by a structural break, the new tests allow for detecting which frequencies of the data are responsible for parameter instability. If the model is locally stable at the frequencies of interest, the whole sample size can then be exploited despite the presence of a break. The methodology is applied to analyse the productivity slowdown in the US, and the outcome is that local stability concerns only the higher frequencies of data on consumption, investment and output.     

Forecasting the UK economy with a medium-scale Bayesian VAR

We estimate a Bayesian VAR (BVAR) for the UK economy and assess its performance in forecasting GDP growth and CPI inflation in real time relative to forecasts from COMPASS, the Bank of England’s DSGE model, and other benchmarks. We find that the BVAR outperformed COMPASS when forecasting both GDP and its expenditure components. In contrast, their performances when forecasting CPI were similar. We also find that the BVAR density forecasts outperformed those of COMPASS, despite under-predicting inflation at most forecast horizons. Both models over-predicted GDP growth at all forecast horizons, but the issue was less pronounced in the BVAR. The BVAR’s point and density forecast performances are also comparable to those of a Bank of England in-house statistical suite for both GDP and CPI inflation, as well as to the official Inflation Report projections. Our results are broadly consistent with the findings of similar studies for other advanced economies.     

Forecasting with vector autoregressive (VAR) models subject to business cycle restrictions

In the last decade VAR models have become a widely-used tool for forecasting macroeconomic time series. To improve the out-of-sample forecasting accuracy of these models, Bayesian random-walk prior restrictions are often imposed on VAR model parameters. This paper focuses on whether placing an alternative type of restriction on the parameters of unrestricted VAR models improves the out-of-sample forecasting performance of these models. The type of restriction analyzed here is based on the business cycle characteristics of U.S. macroeconomic data, and in particular, requires that the dynamic behavior of the restricted VAR model mimic the business cycle characteristics of historical data. The question posed in this paper is: would a VAR model, estimated subject to the restriction that the cyclical characteristics of simulated data from the model “match up” with the business cycle characteristics of U.S. data, generate more accurate out-of-sample forecasts than unrestricted or Bayesian VAR models?     

Combining survey long-run forecasts and nowcasts with BVAR forecasts using relative entropy

This paper constructs hybrid forecasts that combine forecasts from vector autoregressive (VAR) model(s) with both short- and long-term expectations from surveys. Specifically, we use the relative entropy to tilt one-step-ahead and long-horizon VAR forecasts to match the nowcasts and long-horizon forecasts from the Survey of Professional Forecasters. We consider a variety of VAR models, ranging from simple fixed-parameter to time-varying parameters. The results across models indicate meaningful gains in multi-horizon forecast accuracy relative to model forecasts that do not incorporate long-term survey conditions. Accuracy improvements are achieved for a range of variables, including those that are not tilted directly but are affected through spillover effects from tilted variables. The accuracy gains for hybrid inflation forecasts from simple VARs are substantial, statistically significant, and competitive to time-varying VARs, univariate benchmarks, and survey forecasts. We view our proposal as an indirect approach to accommodating structural change and moving end points.     

Dickey–Fuller Type of Tests against Nonlinear Dynamic Models*

In this paper, we introduce several test statistics testing the null hypothesis of a random walk (with or without drift) against models that accommodate a smooth nonlinear shift in the level, the dynamic structure and the trend. We derive analytical limiting distributions for all the tests. The power performance of the tests is compared with that of the unit‐root tests by Phillips and Perron [Biometrika (1988), Vol. 75, pp. 335–346], and Leybourne, Newbold and Vougas [Journal of Time Series Analysis (1998), Vol. 19, pp. 83–97]. In the presence of a gradual change in the deterministics and in the dynamics, our tests are superior in terms of power.     

General‐to‐Specific Model Selection Procedures for Structural Vector Autoregressions*

Structural vector autoregressive (SVAR) models have emerged as a dominant research strategy in empirical macroeconomics, but suffer from the large number of parameters employed and the resulting estimation uncertainty associated with their impulse responses. In this paper, we propose general‐to‐specific (Gets) model selection procedures to overcome these limitations. It is shown that single‐equation procedures are generally efficient for the reduction of recursive SVAR models. The small‐sample properties of the proposed reduction procedure (as implemented using PcGets) are evaluated in a realistic Monte Carlo experiment. The impulse responses generated by the selected SVAR are found to be more precise and accurate than those of the unrestricted VAR. The proposed reduction strategy is then applied to the US monetary system considered by Christiano, Eichenbaum and Evans (Review of Economics and Statistics, Vol. 78, pp. 16–34, 1996) . The results are consistent with the Monte Carlo and question the validity of the impulse responses generated by the full system.     

Simulation‐based tests of forward‐looking models under VAR learning dynamics

In this paper we propose a simulation‐based technique to investigate the finite sample performance of likelihood ratio (LR) tests for the nonlinear restrictions that arise when a class of forward‐looking (FL) models typically used in monetary policy analysis is evaluated with vector autoregressive (VAR) models. We consider ‘one‐shot’ tests to evaluate the FL model under the rational expectations hypothesis and sequences of tests obtained under the adaptive learning hypothesis. The analysis is based on a comparison between the unrestricted and restricted VAR likelihoods, and the p‐values associated with the LR test statistics are computed by Monte Carlo simulation. We also address the case where the variables of the FL model can be approximated as non‐stationary cointegrated processes. Application to the ‘hybrid’ New Keynesian Phillips Curve (NKPC) in the euro area shows that (i) the forward‐looking component of inflation dynamics is much larger than the backward‐looking component and (ii) the sequence of restrictions implied by the cointegrated NKPC under learning dynamics is not rejected over the monitoring period 1984–2005. Copyright © 2010 John Wiley & Sons, Ltd.