On the forecasting performance of a small-scale DSGE model

Dynamic stochastic general equilibrium (DSGE) models have recently become standard tools for policy analysis. Nevertheless, their forecasting properties have still barely been explored. In this article, we address this problem by examining the quality of forecasts of the key U.S. economic variables: the three-month Treasury bill yield, the GDP growth rate and GDP price index inflation, from a small-size DSGE model, trivariate vector autoregression (VAR) models and the Philadelphia Fed Survey of Professional Forecasters (SPF). The ex post forecast errors are evaluated on the basis of the data from the period 1994–2006. We apply the Philadelphia Fed “Real-Time Data Set for Macroeconomists” to ensure that the data used in estimating the DSGE and VAR models was comparable to the information available to the SPF.Overall, the results are mixed. When comparing the root mean squared errors for some forecast horizons, it appears that the DSGE model outperforms the other methods in forecasting the GDP growth rate. However, this characteristic turned out to be statistically insignificant. Most of the SPF's forecasts of GDP price index inflation and the short-term interest rate are better than those from the DSGE and VAR models.     

Marginalized Predictive Likelihood Comparisons of Linear Gaussian State‐Space Models with Applications to DSGE,DSGE‐VAR,and VAR Models

The predictive likelihood is useful for ranking models in forecast comparison exercises using Bayesian inference. We discuss how it can be estimated, by means of marzginalization, for any subset of the observables in linear Gaussian state‐space models. We compare macroeconomic density forecasts for the euro area of a DSGE model to those of a DSGE‐VAR, a BVAR and a multivariate random walk over 1999:Q1–2011:Q4. While the BVAR generally provides superior forecasts, its performance deteriorates substantially with the onset of the Great Recession. This is particularly notable for longer‐horizon real GDP forecasts, where the DSGE and DSGE‐VAR models perform better. Copyright © 2016 John Wiley & Sons, Ltd.     

The Incremental Predictive Information Associated with Using Theoretical New Keynesian DSGE Models vs. Simple Linear Econometric Models*

In this paper we construct output gap and inflation predictions using a variety of dynamic stochastic general equilibrium (DSGE) sticky price models. Predictive density accuracy tests related to the test discussed in Corradi and Swanson [Journal of Econometrics (2005a), forthcoming] as well as predictive accuracy tests due to Diebold and Mariano [Journal of Business and Economic Statistics (1995) , Vol. 13, pp. 253–263]; and West [Econometrica (1996) , Vol. 64, pp. 1067–1084] are used to compare the alternative models. A number of simple time‐series prediction models (such as autoregressive and vector autoregressive (VAR) models) are additionally used as strawman models. Given that DSGE model restrictions are routinely nested within VAR models, the addition of our strawman models allows us to indirectly assess the usefulness of imposing theoretical restrictions implied by DSGE models on unrestricted econometric models. With respect to predictive density evaluation, our results suggest that the standard sticky price model discussed in Calvo [Journal of Monetary Economics (1983), Vol. XII, pp. 383–398] is not outperformed by the same model augmented either with information or indexation, when used to predict the output gap. On the other hand, there are clear gains to using the more recent models when predicting inflation. Results based on mean square forecast error analysis are less clear‐cut, although the standard sticky price model fares best at our longest forecast horizon of 3 years, it performs relatively poorly at shorter horizons. When the strawman time‐series models are added to the picture, we find that the DSGE models still fare very well, often outperforming our forecast competitions, suggesting that theoretical macroeconomic restrictions yield useful additional information for forming macroeconomic forecasts.     

Testing the Structural Interpretation of the Price Puzzle with a Cost‐Channel Model*

We estimate a variety of small‐scale new‐Keynesian DSGE models with the cost channel to assess their ability to replicate the ‘price puzzle’, i.e. the inflationary impact of a monetary policy shock typically arising in vector autoregression (VAR) analysis. To correctly identify the monetary policy shock, we distinguish between a standard policy rate shifter and a shock to ‘trend inflation’, i.e. the time‐varying inflation target set by the Fed. Our estimated models predict a negative inflation reaction to a monetary policy tightening. We offer a discussion of the possible sources of mismatch between the VAR evidence and our own.     

In Search of the Transmission Mechanism of Fiscal Policy in the Euro Area

This paper applies the DSGE‐VAR methodology to assess the size of fiscal multipliers in the data and the relative contributions of two transmission mechanisms of government spending shocks, namely hand‐to‐mouth consumers and Edgeworth complementarity. Econometric experiments show that a DSGE model with Edgeworth complementarity is a better representation of the transmission mechanism of fiscal policy as it yields dynamic responses close to those obtained with the flexible DSGE‐VAR model (i.e. an impact output multiplier larger than one and a crowding‐in of private consumption). The estimated share of hand‐to‐mouth consumers is too small to replicate the positive response of private consumption. Copyright © 2016 John Wiley & Sons, Ltd.     

Combining VAR and DSGE forecast densities

A popular macroeconomic forecasting strategy utilizes many models to hedge against instabilities of unknown timing; see (among others) Stock and Watson (2004), Clark and McCracken (2010), and Jore et al. (2010). Existing studies of this forecasting strategy exclude dynamic stochastic general equilibrium (DSGE) models, despite the widespread use of these models by monetary policymakers. In this paper, we use the linear opinion pool to combine inflation forecast densities from many vector autoregressions (VARs) and a policymaking DSGE model. The DSGE receives a substantial weight in the pool (at short horizons) provided the VAR components exclude structural breaks. In this case, the inflation forecast densities exhibit calibration failure. Allowing for structural breaks in the VARs reduces the weight on the DSGE considerably, but produces well-calibrated forecast densities for inflation.     

Professional forecasters and real-time forecasting with a DSGE model

This paper analyses the real-time forecasting performance of the New Keynesian DSGE model of Galí, Smets and Wouters (2012), estimated on euro area data. It investigates the extent to which the inclusion of forecasts of inflation, GDP growth and unemployment by professional forecasters improve the forecasting performance. We consider two approaches for conditioning on such information. Under the “noise” approach, the mean professional forecasts are assumed to be noisy indicators of the rational expectations forecasts implied by the DSGE model. Under the “news” approach, it is assumed that the forecasts reveal the presence of expected future structural shocks in line with those estimated in the past. The forecasts of the DSGE model are compared with those from a Bayesian VAR model, an AR(1) model, a sample mean and a random walk.     

On the statistical identification of DSGE models

Dynamic Stochastic General Equilibrium (DSGE) models are now considered attractive by the profession not only from the theoretical perspective but also from an empirical standpoint. As a consequence of this development, methods for diagnosing the fit of these models are being proposed and implemented. In this article we illustrate how the concept of statistical identification, that was introduced and used by Spanos [Spanos, Aris, 1990. The simultaneous-equations model revisited: Statistical adequacy and identification. Journal of Econometrics 44, 87–105] to criticize traditional evaluation methods of Cowles Commission models, could be relevant for DSGE models. We conclude that the recently proposed model evaluation method, based on the DSGE–VAR(λ)$\left(\lambda \right)$, might not satisfy the condition for statistical identification. However, our application also shows that the adoption of a FAVAR as a statistically identified benchmark leaves unaltered the support of the data for the DSGE model and that a DSGE–FAVAR can be an optimal forecasting model.     

Evaluation of dynamic stochastic general equilibrium models based on distributional comparison of simulated and historical data

We take as a starting point the existence of a joint distribution implied by different dynamic stochastic general equilibrium (DSGE) models, all of which are potentially misspecified. Our objective is to compare “true” joint distributions with ones generated by given DSGEs. This is accomplished via comparison of the empirical joint distributions (or confidence intervals) of historical and simulated time series. The tool draws on recent advances in the theory of the bootstrap, Kolmogorov type testing, and other work on the evaluation of DSGEs, aimed at comparing the second order properties of historical and simulated time series. We begin by fixing a given model as the “benchmark” model, against which all “alternative” models are to be compared. We then test whether at least one of the alternative models provides a more “accurate” approximation to the true cumulative distribution than does the benchmark model, where accuracy is measured in terms of distributional square error. Bootstrap critical values are discussed, and an illustrative example is given, in which it is shown that alternative versions of a standard DSGE model in which calibrated parameters are allowed to vary slightly perform equally well. On the other hand, there are stark differences between models when the shocks driving the models are assigned non-plausible variances and/or distributional assumptions.     

Exact likelihood computation for nonlinear DSGE models with heteroskedastic innovations

Phenomena such as the Great Moderation have increased the attention of macroeconomists towards models where shock processes are not (log-)normal. This paper studies a class of discrete-time rational expectations models where the variance of exogenous innovations is subject to stochastic regime shifts. We first show that, up to a second-order approximation using perturbation methods, regime switching in the variances has an impact only on the intercept coefficients of the decision rules. We then demonstrate how to derive the exact model likelihood for the second-order approximation of the solution when there are as many shocks as observable variables. We illustrate the applicability of the proposed solution and estimation methods in the case of a small DSGE model.     

What (really) accounts for the fall in hours after a technology shock?

The paper asks how state of the art DSGE models that account for the conditional response of hours following a positive neutral technology shock compare in a marginal likelihood race. To that end we construct and estimate several competing small-scale DSGE models that extend the standard real business cycle model. In particular, we identify from the literature six different hypotheses that generate the empirically observed decline in hours worked after a positive technology shock. These models alternatively exhibit (i) sticky prices; (ii) firm entry and exit with time to build; (iii) habit in consumption and costly adjustment of investment; (iv) persistence in the permanent technology shocks; (v) labor market friction with procyclical hiring costs; and (vi) Leontief production function with labor-saving technology shocks. In terms of model posterior probabilities, impulse responses, and autocorrelations, the model favored is the one that exhibits habit formation in consumption and investment adjustment costs. A robustness test shows that the sticky price model becomes as competitive as the habit formation and costly adjustment of investment model when sticky wages are included.     

Selecting structural innovations in DSGE models

Dynamic stochastic general equilibrium (DSGE) models are typically estimated assuming the existence of certain structural shocks that drive macroeconomic fluctuations. We analyze the consequences of estimating shocks that are “nonexistent” and propose a method to select the economic shocks driving macroeconomic uncertainty. Forcing these nonexisting shocks in estimation produces a downward bias in the estimated internal persistence of the model. We show how these distortions can be reduced by using priors for standard deviations whose support includes zero. The method allows us to accurately select shocks and estimate model parameters with high precision. We revisit the empirical evidence on an industry standard medium‐scale DSGE model and find that government and price markup shocks are innovations that do not generate statistically significant dynamics.     

The New Keynesian Phillips Curve and staggered price and wage determination in a model with firm-specific labor

We develop a DSGE model with firm-specific labor where wage and price setting are subject to Calvo-type staggering. This is in general an intractable problem due to complicated intertemporal dependencies between price and wage decisions. However, the problem is significantly simplified if we, in line with empirical evidence, assume that prices can be changed whenever wages are. We show that the price- and wage-setting relationships are substantially altered by the introduction of firm-specific labor. Specifically, the inflation response is substantially dampened, whereas the wage inflation response is increased as compared to models with freely mobile labor. These distinctive features of the model with firm-specific labor are supported by empirical evidence from a structural VAR.     

Tests of Predictive Ability for Vector Autoregressions Used for Conditional Forecasting

Many forecasts are conditional in nature. For example, a number of central banks routinely report forecasts conditional on particular paths of policy instruments. Even though conditional forecasting is common, there has been little work on methods for evaluating conditional forecasts. This paper provides analytical, Monte Carlo and empirical evidence on tests of predictive ability for conditional forecasts from estimated models. In the empirical analysis, we examine conditional forecasts obtained with a VAR in the variables included in the DSGE model of Smets and Wouters (American Economic Review 2007; 97 : 586–606). Throughout the analysis, we focus on tests of bias, efficiency and equal accuracy applied to conditional forecasts from VAR models. Copyright © 2016 John Wiley & Sons, Ltd.     

Open economy forecasting with a DSGE-VAR: Head to head with the RBNZ published forecasts

We construct a DSGE-VAR model for competing head to head with the long history of published forecasts of the Reserve Bank of New Zealand. We also construct a Bayesian VAR model with a Minnesota prior for forecast comparison. The DSGE-VAR model combines a structural DSGE model with a statistical VAR model based on the in-sample fit over the majority of New Zealand’s inflation-targeting period. We evaluate the real-time out-of-sample forecasting performance of the DSGE-VAR model, and show that the forecasts from the DSGE-VAR are competitive with the Reserve Bank of New Zealand’s published, judgmentally-adjusted forecasts. The Bayesian VAR model with a Minnesota prior also provides a competitive forecasting performance, and generally, with a few exceptions, out-performs both the DSGE-VAR and the Reserve Bank’s own forecasts.     

Bayesian prior elicitation in DSGE models: Macro- vs micropriors

Bayesian approaches to the estimation of DSGE models are becoming increasingly popular. Prior knowledge is normally formalized either directly on deep parameters' values (‘microprior’) or indirectly, on macroeconomic indicators, e.g. moments of observable variables (‘macroprior’). We introduce a non-parametric macroprior which is elicited from impulse response functions and assess its performance in shaping posterior estimates. We find that using a macroprior can lead to substantially different posterior estimates. We probe into the details of our result, showing that model misspecification is likely to be responsible of that. In addition, we assess to what extent the use of macropriors is impaired by the need of calibrating some hyperparameters.     

Mortgage default in an estimated model of the U.S. housing market

This paper models the housing sector, mortgages and endogenous default in a DSGE setting with nominal and real rigidities. We use data for the period 1981–2006 to estimate our model using Bayesian techniques. We analyze how an increase in risk in the mortgage market raises the default rate and spreads to the rest of the economy, creating a recession. In our model two shocks are well suited to replicate the subprime crisis and the Great Recession: the mortgage risk shock and the housing demand shock. Next we use our estimated model to evaluate a policy that reduces the principal of underwater mortgages. This policy is successful in stabilizing the mortgage market and makes all agents better off.     

Examining bias in estimators of linear rational expectations models under misspecification

Most rational expectations models involve equations in which the dependent variable is a function of its lags and its expected future value. We investigate the asymptotic bias of generalized method of moment (GMM) and maximum likelihood (ML) estimators in such models under misspecification. We consider several misspecifications, and focus more specifically on the case of omitted dynamics in the dependent variable. In a stylized DGP, we derive analytically the asymptotic biases of these estimators. We establish that in many cases of interest the two estimators of the degree of forward-lookingness are asymptotically biased in opposite direction with respect to the true value of the parameter. We also propose a quasi-Hausman test of misspecification based on the difference between the GMM and ML estimators. Using Monte-Carlo simulations, we show that the ordering and direction of the estimators still hold in a more realistic New Keynesian macroeconomic model. In this set-up, misspecification is in general found to be more harmful to GMM than to ML estimators.     

Endogenous business cycle propagation and the persistence problem: The role of labor-market frictions

Contrasting sharply with a recent trend in DSGE modeling, we propose a business cycle model where frictions and shocks are chosen with parsimony. The model emphasizes a few labor-market frictions and shocks to monetary policy and technology. The model, estimated from U.S. quarterly postwar data, accounts well for important differences in the serial correlation of the growth rates of aggregate quantities, the size of aggregate fluctuations and key comovements, including the correlation between hours and labor productivity. Despite its simplicity, the model offers an answer to the persistence problem (Chari et al., 2000) that does not rely on multiple frictions and adjustment lags or ad hoc backward-looking components. We conclude modern DSGE models need not embed large batteries of frictions and shocks to account for the salient features of postwar business cycles.