On the forecasting performance of a small-scale DSGE model

Dynamic stochastic general equilibrium (DSGE) models have recently become standard tools for policy analysis. Nevertheless, their forecasting properties have still barely been explored. In this article, we address this problem by examining the quality of forecasts of the key U.S. economic variables: the three-month Treasury bill yield, the GDP growth rate and GDP price index inflation, from a small-size DSGE model, trivariate vector autoregression (VAR) models and the Philadelphia Fed Survey of Professional Forecasters (SPF). The ex post forecast errors are evaluated on the basis of the data from the period 1994–2006. We apply the Philadelphia Fed “Real-Time Data Set for Macroeconomists” to ensure that the data used in estimating the DSGE and VAR models was comparable to the information available to the SPF.Overall, the results are mixed. When comparing the root mean squared errors for some forecast horizons, it appears that the DSGE model outperforms the other methods in forecasting the GDP growth rate. However, this characteristic turned out to be statistically insignificant. Most of the SPF's forecasts of GDP price index inflation and the short-term interest rate are better than those from the DSGE and VAR models.     

Marginalized Predictive Likelihood Comparisons of Linear Gaussian State‐Space Models with Applications to DSGE,DSGE‐VAR,and VAR Models

The predictive likelihood is useful for ranking models in forecast comparison exercises using Bayesian inference. We discuss how it can be estimated, by means of marzginalization, for any subset of the observables in linear Gaussian state‐space models. We compare macroeconomic density forecasts for the euro area of a DSGE model to those of a DSGE‐VAR, a BVAR and a multivariate random walk over 1999:Q1–2011:Q4. While the BVAR generally provides superior forecasts, its performance deteriorates substantially with the onset of the Great Recession. This is particularly notable for longer‐horizon real GDP forecasts, where the DSGE and DSGE‐VAR models perform better. Copyright © 2016 John Wiley & Sons, Ltd.     

Euro area real-time density forecasting with financial or labor market frictions

We compare real-time density forecasts for the euro area using three DSGE models. The benchmark is the Smets and Wouters model, and its forecasts of real GDP growth and inflation are compared with those from two extensions. The first adds financial frictions and expands the observables to include a measure of the external finance premium. The second allows for the extensive labor-market margin and adds the unemployment rate to the observables. The main question that we address is whether these extensions improve the density forecasts of real GDP and inflation and their joint forecasts up to an eight-quarter horizon. We find that adding financial frictions leads to a deterioration in the forecasts, with the exception of longer-term inflation forecasts and the period around the Great Recession. The labor market extension improves the medium- to longer-term real GDP growth and shorter- to medium-term inflation forecasts weakly compared with the benchmark model.     

Forecasting the UK economy with a medium-scale Bayesian VAR

We estimate a Bayesian VAR (BVAR) for the UK economy and assess its performance in forecasting GDP growth and CPI inflation in real time relative to forecasts from COMPASS, the Bank of England’s DSGE model, and other benchmarks. We find that the BVAR outperformed COMPASS when forecasting both GDP and its expenditure components. In contrast, their performances when forecasting CPI were similar. We also find that the BVAR density forecasts outperformed those of COMPASS, despite under-predicting inflation at most forecast horizons. Both models over-predicted GDP growth at all forecast horizons, but the issue was less pronounced in the BVAR. The BVAR’s point and density forecast performances are also comparable to those of a Bank of England in-house statistical suite for both GDP and CPI inflation, as well as to the official Inflation Report projections. Our results are broadly consistent with the findings of similar studies for other advanced economies.     

Professional forecasters and real-time forecasting with a DSGE model

This paper analyses the real-time forecasting performance of the New Keynesian DSGE model of Galí, Smets and Wouters (2012), estimated on euro area data. It investigates the extent to which the inclusion of forecasts of inflation, GDP growth and unemployment by professional forecasters improve the forecasting performance. We consider two approaches for conditioning on such information. Under the “noise” approach, the mean professional forecasts are assumed to be noisy indicators of the rational expectations forecasts implied by the DSGE model. Under the “news” approach, it is assumed that the forecasts reveal the presence of expected future structural shocks in line with those estimated in the past. The forecasts of the DSGE model are compared with those from a Bayesian VAR model, an AR(1) model, a sample mean and a random walk.     

A look into the factor model black box: Publication lags and the role of hard and soft data in forecasting GDP

We derive forecast weights and uncertainty measures for assessing the roles of individual series in a dynamic factor model (DFM) for forecasting the euro area GDP from monthly indicators. The use of the Kalman smoother allows us to deal with publication lags when calculating the above measures. We find that surveys and financial data contain important information for the GDP forecasts beyond the monthly real activity measures. However, this is discovered only if their more timely publication is taken into account properly. Differences in publication lags play a very important role and should be considered in forecast evaluation.     

Evaluating Point and Density Forecasts of DSGE Models

This paper investigates the accuracy of forecasts from four dynamic stochastic general equilibrium (DSGE) models for inflation, output growth and the federal funds rate using a real‐time dataset synchronized with the Fed's Greenbook projections. Conditioning the model forecasts on the Greenbook nowcasts leads to forecasts that are as accurate as the Greenbook projections for output growth and the federal funds rate. Only for inflation are the model forecasts dominated by the Greenbook projections. A comparison with forecasts from Bayesian vector autoregressions shows that the economic structure of the DSGE models which is useful for the interpretation of forecasts does not lower the accuracy of forecasts. Combining forecasts of several DSGE models increases precision in comparison to individual model forecasts. Comparing density forecasts with the actual distribution of observations shows that DSGE models overestimate uncertainty around point forecasts. Copyright © 2013 John Wiley & Sons, Ltd.     

DSGE forecasts of the lost recovery

The years following the Great Recession were challenging for forecasters. Unlike other deep downturns, this recession was not followed by a swift recovery, but instead generated a sizable and persistent output gap that was not accompanied by deflation as a traditional Phillips curve relationship would have predicted. Moreover, the zero lower bound and unconventional monetary policy generated an unprecedented policy environment. We document the actual real-time forecasting performance of the New York Fed dynamic stochastic general equilibrium (DSGE) model during this period and explain the results using the pseudo real-time forecasting performance results from a battery of DSGE models. We find the New York Fed DSGE model’s forecasting accuracy to be comparable to that of private forecasters, and notably better for output growth than the median forecasts from the FOMC’s Summary of Economic Projections. The model’s financial frictions were key in obtaining these results, as they implied a slow recovery following the financial crisis.     

The COVID-19 shock and challenges for inflation modelling

We document the impact of COVID-19 on inflation modelling within a vector autoregression (VAR) model and provide guidance for forecasting euro area inflation during the pandemic. We show that estimated parameters are strongly affected, leading to different and sometimes implausible projections. As a solution, we propose to augment the VAR by allowing the residuals to have a fat-tailed distribution instead of a Gaussian one. This also outperforms with respect to unconditional forecasts. Yet, what brings sizeable forecast gains during the pandemic is adding meaningful off-model information, such as that entailed in the Survey of Professional Forecasters. The fat-tailed VAR loses part, but not all of its relative advantage compared to the Gaussian version when producing conditional inflation forecasts in a real-time setup. It is the joint fat-tailed errors and multi-equation modelling that manage to robustify models against extreme observations; in a single-equation model the same solution is less effective.     

Forecasting the Covid-19 recession and recovery: Lessons from the financial crisis

We consider simple methods to improve the growth nowcasts and forecasts obtained by mixed-frequency MIDAS and UMIDAS models with a variety of indicators during the Covid-19 crisis and recovery period, such as combining forecasts across various specifications for the same model and/or across different models, extending the model specification by adding MA terms, enhancing the estimation method by taking a similarity approach, and adjusting the forecasts to put them back on track using a specific form of intercept correction. Among these methods, adjusting the original nowcasts and forecasts by an amount similar to the nowcast and forecast errors made during the financial crisis and subsequent recovery seems to produce the best results for the US, notwithstanding the different source and characteristics of the financial crisis. In particular, the adjusted growth nowcasts for 2020Q1 get closer to the actual value, and the adjusted forecasts based on alternative indicators become much more similar, all unfortunately indicating a much slower recovery than without adjustment, and very persistent negative effects on trend growth. Similar findings also emerge for forecasts by institutions, for survey forecasts, and for the other G7 countries.     

Bayesian VAR forecasts,survey information,and structural change in the euro area

We incorporate external information extracted from the European Central Bank’s Survey of Professional Forecasters into the predictions of a Bayesian VAR using entropic tilting and soft conditioning. The resulting conditional forecasts significantly improve the plain BVAR point and density forecasts. Importantly, we do not restrict the forecasts at a specific quarterly horizon but their possible paths over several horizons jointly since the survey information comes in the form of one- and two-year-ahead expectations. As well as improving the accuracy of the variable that we target, the spillover effects on “other-than-targeted” variables are relevant in size and are statistically significant. We document that the baseline BVAR exhibits an upward bias for GDP growth after the financial crisis, and our results provide evidence that survey forecasts can help mitigate the effects of structural breaks on the forecasting performance of a popular macroeconometric model.     

Forecasting economic time series using score-driven dynamic models with mixed-data sampling

We introduce a mixed-frequency score-driven dynamic model for multiple time series where the score contributions from high-frequency variables are transformed by means of a mixed-data sampling weighting scheme. The resulting dynamic model delivers a flexible and easy-to-implement framework for the forecasting of low-frequency time series variables through the use of timely information from high-frequency variables. We verify the in-sample and out-of-sample performances of the model in an empirical study on the forecasting of U.S. headline inflation and GDP growth. In particular, we forecast monthly headline inflation using daily oil prices and quarterly GDP growth using a measure of financial risk. The forecasting results and other findings are promising. Our proposed score-driven dynamic model with mixed-data sampling weighting outperforms competing models in terms of both point and density forecasts.     

Forecasting macroeconomic risks

We construct risks around consensus forecasts of real GDP growth, unemployment, and inflation. We find that risks are time-varying, asymmetric, and partly predictable. Tight financial conditions forecast downside growth risk, upside unemployment risk, and increased uncertainty around the inflation forecast. Growth vulnerability arises as the conditional mean and conditional variance of GDP growth are negatively correlated: downside risks are driven by lower mean and higher variance when financial conditions tighten. Similarly, employment vulnerability arises as the conditional mean and conditional variance of unemployment are positively correlated, with tighter financial conditions corresponding to higher forecasted unemployment and higher variance around the consensus forecast.     

Open economy forecasting with a DSGE-VAR: Head to head with the RBNZ published forecasts

We construct a DSGE-VAR model for competing head to head with the long history of published forecasts of the Reserve Bank of New Zealand. We also construct a Bayesian VAR model with a Minnesota prior for forecast comparison. The DSGE-VAR model combines a structural DSGE model with a statistical VAR model based on the in-sample fit over the majority of New Zealand’s inflation-targeting period. We evaluate the real-time out-of-sample forecasting performance of the DSGE-VAR model, and show that the forecasts from the DSGE-VAR are competitive with the Reserve Bank of New Zealand’s published, judgmentally-adjusted forecasts. The Bayesian VAR model with a Minnesota prior also provides a competitive forecasting performance, and generally, with a few exceptions, out-performs both the DSGE-VAR and the Reserve Bank’s own forecasts.     

Nowcasting German GDP: Foreign factors,financial markets,and model averaging

This paper develops a nowcasting model for the German economy. The model outperforms a number of alternatives and produces forecasts not only for GDP but also for other key variables. We show that the inclusion of a foreign factor improves the model’s performance, while financial variables do not. Additionally, a comprehensive model averaging exercise reveals that factor extraction in a single model delivers slightly better results than averaging across models. Finally, we estimate a “news” index for the German economy in order to assess the overall performance of the model beyond forecast errors in GDP. The index is constructed as a weighted average of the nowcast errors related to each variable included in the model.     

The Incremental Predictive Information Associated with Using Theoretical New Keynesian DSGE Models vs. Simple Linear Econometric Models*

In this paper we construct output gap and inflation predictions using a variety of dynamic stochastic general equilibrium (DSGE) sticky price models. Predictive density accuracy tests related to the test discussed in Corradi and Swanson [Journal of Econometrics (2005a), forthcoming] as well as predictive accuracy tests due to Diebold and Mariano [Journal of Business and Economic Statistics (1995) , Vol. 13, pp. 253–263]; and West [Econometrica (1996) , Vol. 64, pp. 1067–1084] are used to compare the alternative models. A number of simple time‐series prediction models (such as autoregressive and vector autoregressive (VAR) models) are additionally used as strawman models. Given that DSGE model restrictions are routinely nested within VAR models, the addition of our strawman models allows us to indirectly assess the usefulness of imposing theoretical restrictions implied by DSGE models on unrestricted econometric models. With respect to predictive density evaluation, our results suggest that the standard sticky price model discussed in Calvo [Journal of Monetary Economics (1983), Vol. XII, pp. 383–398] is not outperformed by the same model augmented either with information or indexation, when used to predict the output gap. On the other hand, there are clear gains to using the more recent models when predicting inflation. Results based on mean square forecast error analysis are less clear‐cut, although the standard sticky price model fares best at our longest forecast horizon of 3 years, it performs relatively poorly at shorter horizons. When the strawman time‐series models are added to the picture, we find that the DSGE models still fare very well, often outperforming our forecast competitions, suggesting that theoretical macroeconomic restrictions yield useful additional information for forming macroeconomic forecasts.     

Taking financial frictions to the data

We estimate a Dynamic Stochastic General Equilibrium (DSGE) model with various financial frictions and analyze how well the model explains the Great Recession. Predictive analysis shows that the model can only slightly better explain the large deviation from trend during the crisis relative to a model without financial frictions. Specifically, the risk premium shock, which is a shock to the external finance premium of the entrepreneurs׳ leverage, explains the largest part of the investment downfall during the crisis. However, the ‘balance sheet’ channel of financial frictions in the model, which structurally links balance sheet conditions of financial intermediaries and nonfinancial borrowers to their borrowing rates, is estimated to be weak. We examine alternative prior specifications for how the financial frictions enter the model and continue to find a limited role for these frictions. Rolling-window estimation provides evidence for substantial time variation in parameters governing financial frictions. We conclude that the well-known financial frictions studied in this paper are not able to explain the financial crisis in a linearized and estimated model.     

How quickly do forecasters incorporate news? Evidence from cross‐country surveys

Using forecasts from Consensus Economics Inc., we provide evidence on the efficiency of real GDP growth forecasts by testing whether forecast revisions are uncorrelated. As the forecast data used are multi‐dimensional—18 countries, 24 monthly forecasts for the current and the following year and 16 target years—the panel estimation takes into account the complex structure of the variance–covariance matrix due to propagation of shocks across countries and economic linkages among them. Efficiency is rejected for all 18 countries: forecast revisions show a high degree of serial correlation. We then develop a framework for characterizing the nature of the inefficiency in forecasts. For a smaller set of countries, the G‐7, we estimate a VAR model on forecast revisions. The degree of inefficiency, as manifested in the serial correlation of forecast revisions, tends to be smaller in forecasts of the USA than in forecasts for European countries. Our framework also shows that one of the sources of the inefficiency in a country's forecasts is resistance to utilizing foreign news. Thus the quality of forecasts for many of these countries can be significantly improved if forecasters pay more attention to news originating from outside their respective countries. This is particularly the case for Canadian and French forecasts, which would gain by paying greater attention than they do to news from the USA and Germany, respectively. Copyright © 2006 John Wiley & Sons, Ltd.     

Raiders of the lost high-frequency forecasts: New data and evidence on the efficiency of the Fed's forecasting

We introduce a new dataset of real gross domestic product (GDP) growth and core personal consumption expenditures (PCE) inflation forecasts produced by the staff of the Board of Governors of the Federal Reserve System. In contrast to the eight Greenbook forecasts a year the staff produce for Federal Open Market Committee (FOMC) meetings, our dataset has roughly weekly forecasts. We use these data to study whether the staff forecasts efficiently. Prespecified regressions of forecast errors on forecast revisions show the staff's GDP forecasts exhibit time-varying inefficiency between FOMC meetings, and also show some evidence for inefficient inflation forecasts.     

Differing behaviours of forecasters of UK GDP growth

The literature suggests that the dispersion of agents’ forecasts of an event flows from heterogeneity of beliefs and models. Using a data set of fixed event point forecasts of UK GDP growth by a panel of independent forecasters published by HM Treasury, we investigate three questions concerning this dispersion: (a) Are agent’s beliefs randomly distributed or do agents fall into groups with similar beliefs? (b) as agents revise their forecasts, what roles are played by their previous and consensus forecasts? and (c) is an agent’s private information of persistent value? We find that agents fall into four clusters, a large majority, a few pessimists, and two idiosyncratic agents. Our proposed model of forecast revisions shows agents are influenced positively by a change in the consensus forecast and negatively influenced by the previous distance of their forecast from the consensus. We show that the forecasts of a minority of agents significantly lead the consensus.