A comprehensive evaluation of macroeconomic forecasting methods

We employ datasets for seven developed economies and consider four classes of multivariate forecasting models in order to extend and enhance the empirical evidence in the macroeconomic forecasting literature. The evaluation considers forecasting horizons of between one quarter and two years ahead. We find that the structural model, a medium-sized DSGE model, provides accurate long-horizon US and UK inflation forecasts. We strike a balance between being comprehensive and producing clear messages by applying meta-analysis regressions to 2,976 relative accuracy comparisons that vary with the forecasting horizon, country, model class and specification, number of predictors, and evaluation period. For point and density forecasting of GDP growth and inflation, we find that models with large numbers of predictors do not outperform models with 13–14 hand-picked predictors. Factor-augmented models and equal-weighted combinations of single-predictor mixed-data sampling regressions are a better choice for dealing with large numbers of predictors than Bayesian VARs.     

Forecasting GDP growth with NIPA aggregates: In search of core GDP

In addition to GDP, which is measured using expenditure data, the U.S. national income and product accounts (NIPAs) provide a variety of measures of economic activity, including gross domestic income and other aggregates that exclude one or more of the components that make up GDP. Similarly to the way in which economists have attempted to use core inflation—which excludes volatile energy and food prices—to predict headline inflation, the omission of GDP components may be useful in extracting a signal as to where GDP is going. We investigate the extent to which these NIPA aggregates constitute “core GDP.” In an out-of-sample forecasting exercise using a novel real-time dataset of NIPA aggregates, we find that consumption growth and the growth of GDP excluding inventories and trade have historically outperformed a canonical univariate benchmark for forecasting GDP growth, suggesting that these are promising measures of core GDP growth.     

Leading Indicators for Euro‐area Inflation and GDP Growth*

In this paper, we evaluate the role of a set of variables as leading indicators for Euro‐area inflation and GDP growth. Our leading indicators are taken from the variables in the European Central Bank's (ECB) Euro‐area‐wide model database, plus a set of similar variables for the US. We compare the forecasting performance of each indicator ex post with that of purely autoregressive models. We also analyse three different approaches to combining the information from several indicators. First, ex post, we discuss the use as indicators of the estimated factors from a dynamic factor model for all the indicators. Secondly, within an ex ante framework, an automated model selection procedure is applied to models with a large set of indicators. No future information is used, future values of the regressors are forecast, and the choice of the indicators is based on their past forecasting records. Finally, we consider the forecasting performance of groups of indicators and factors and methods of pooling the ex ante single‐indicator or factor‐based forecasts. Some sensitivity analyses are also undertaken for different forecasting horizons and weighting schemes of forecasts to assess the robustness of the results.     

Forecasting the UK economy with a medium-scale Bayesian VAR

We estimate a Bayesian VAR (BVAR) for the UK economy and assess its performance in forecasting GDP growth and CPI inflation in real time relative to forecasts from COMPASS, the Bank of England’s DSGE model, and other benchmarks. We find that the BVAR outperformed COMPASS when forecasting both GDP and its expenditure components. In contrast, their performances when forecasting CPI were similar. We also find that the BVAR density forecasts outperformed those of COMPASS, despite under-predicting inflation at most forecast horizons. Both models over-predicted GDP growth at all forecast horizons, but the issue was less pronounced in the BVAR. The BVAR’s point and density forecast performances are also comparable to those of a Bank of England in-house statistical suite for both GDP and CPI inflation, as well as to the official Inflation Report projections. Our results are broadly consistent with the findings of similar studies for other advanced economies.     

MIDAS vs. mixed-frequency VAR: Nowcasting GDP in the euro area

This paper compares the mixed-data sampling (MIDAS) and mixed-frequency VAR (MF-VAR) approaches to model specification in the presence of mixed-frequency data, e.g. monthly and quarterly series. MIDAS leads to parsimonious models which are based on exponential lag polynomials for the coefficients, whereas MF-VAR does not restrict the dynamics and can therefore suffer from the curse of dimensionality. However, if the restrictions imposed by MIDAS are too stringent, the MF-VAR can perform better. Hence, it is difficult to rank MIDAS and MF-VAR a priori, and their relative rankings are better evaluated empirically. In this paper, we compare their performances in a case which is relevant for policy making, namely nowcasting and forecasting quarterly GDP growth in the euro area on a monthly basis, using a set of about 20 monthly indicators. It turns out that the two approaches are more complements than substitutes, since MIDAS tends to perform better for horizons up to four to five months, whereas MF-VAR performs better for longer horizons, up to nine months.     

High-frequency monitoring of growth at risk

Monitoring changes in financial conditions provides valuable information on the contribution of financial risks to future economic growth. For that purpose, central banks need real-time indicators to promptly adjust their policy stance. In this paper, we extend the quarterly growth-at-risk (GaR) approach of Adrian et al. (2019) by accounting for the high-frequency nature of financial conditions indicators. Specifically, we use Bayesian mixed-data sampling (MIDAS) quantile regressions to exploit the information content of both a financial stress index and a financial conditions index, leading to real-time high-frequency GaR measures for the euro area. We show that our daily GaR indicator (i) displays good GDP nowcasting properties, (ii) can provide an early signal of GDP downturns, and (iii) allows day-to-day assessment of the effects of monetary policies. During the first six months of the Covid-19 pandemic period, it has provided a timely measure of the tail risks to euro-area GDP.     

Noncausal Bayesian Vector Autoregression

We consider Bayesian analysis of the noncausal vector autoregressive model that is capable of capturing nonlinearities and effects of missing variables. Specifically, we devise a fast and reliable posterior simulator that yields the predictive distribution as a by‐product. We apply the methods to postwar US inflation and GDP growth. The noncausal model is found superior in terms of both in‐sample fit and out‐of‐sample forecasting performance over its conventional causal counterpart. Economic shocks based on the noncausal model turn out to be highly anticipated in advance. We also find the GDP growth to have predictive power for future inflation, but not vice versa. Copyright © 2016 John Wiley & Sons, Ltd.     

Forecasting Euro‐Area Macroeconomic Variables Using a Factor Model Approach for Backdating

We suggest to use a factor model based backdating procedure to construct historical Euro‐area macroeconomic time series data for the pre‐Euro period. We argue that this is a useful alternative to standard contemporaneous aggregation methods. The article investigates for a number of Euro‐area variables whether forecasts based on the factor‐backdated data are more precise than those obtained with standard area‐wide data. A recursive pseudo‐out‐of‐sample forecasting experiment using quarterly data is conducted. Our results suggest that some key variables (e.g. real GDP, inflation and long‐term interest rate) can indeed be forecasted more precisely with the factor‐backdated data.     

On the forecasting performance of a small-scale DSGE model

Dynamic stochastic general equilibrium (DSGE) models have recently become standard tools for policy analysis. Nevertheless, their forecasting properties have still barely been explored. In this article, we address this problem by examining the quality of forecasts of the key U.S. economic variables: the three-month Treasury bill yield, the GDP growth rate and GDP price index inflation, from a small-size DSGE model, trivariate vector autoregression (VAR) models and the Philadelphia Fed Survey of Professional Forecasters (SPF). The ex post forecast errors are evaluated on the basis of the data from the period 1994–2006. We apply the Philadelphia Fed “Real-Time Data Set for Macroeconomists” to ensure that the data used in estimating the DSGE and VAR models was comparable to the information available to the SPF.Overall, the results are mixed. When comparing the root mean squared errors for some forecast horizons, it appears that the DSGE model outperforms the other methods in forecasting the GDP growth rate. However, this characteristic turned out to be statistically insignificant. Most of the SPF's forecasts of GDP price index inflation and the short-term interest rate are better than those from the DSGE and VAR models.     

ALICE: Composite leading indicators for euro area inflation cycles

This paper develops Area-wide Leading Inflation CyclE (ALICE) indicators with the aim to provide early signals for turning points in the euro area headline and core inflation cycles. The headline (core) ALICE leads the reference cycle by three (four) months and the lead times extend to five (nine) months based on longer-leading series. Both ALICE indicators signalled turning points in the inflation cycles ex post and also performed well in a simulated real-time exercise. Moreover, in particular the headline ALICE also appeared to be useful for quantitative forecasting of the direction and level of inflation.     

Forecasting macroeconomic variables using disaggregate survey data

We construct factor models based on disaggregate survey data for forecasting national aggregate macroeconomic variables. Our methodology applies regional and sectoral factor models to Norges Bank’s regional survey and to the Swedish Business Tendency Survey. The analysis identifies which of the pieces of information extracted from the individual regions in Norges Bank’s survey and the sectors for the two surveys perform particularly well at forecasting different variables at various horizons. The results show that several factor models beat an autoregressive benchmark in forecasting inflation and the unemployment rate. However, the factor models are most successful at forecasting GDP growth. Forecast combinations using the past performances of regional and sectoral factor models yield the most accurate forecasts in the majority of the cases.     

Asymmetric Quantile Persistence and Predictability: the Case of US Inflation

This article investigates the evidence of time‐variation and asymmetry in the persistence of US inflation. We compare the out‐of‐sample performance of different forecasting models and find that quantile forecasts from an Auto‐Regressive (AR) model with level‐dependent volatility are at least as accurate as the forecasts of the Quantile Auto‐Regressive model, in particular for the core inflation measures. Our results indicate that the persistence of core inflation has been relatively constant and high, but it declined for the headline inflation measures. We also find that the asymmetric persistence of inflation shocks can be mostly attributed to the positive relation between inflation level and its volatility.     

Forecasting macroeconomic variables using collapsed dynamic factor analysis

We explore a new approach to the forecasting of macroeconomic variables based on a dynamic factor state space analysis. Key economic variables are modeled jointly with principal components from a large time series panel of macroeconomic indicators using a multivariate unobserved components time series model. When the key economic variables are observed at a low frequency and the panel of macroeconomic variables is at a high frequency, we can use our approach for both nowcasting and forecasting purposes. Given a dynamic factor model as the data generation process, we provide Monte Carlo evidence of the finite-sample justification of our parsimonious and feasible approach. We also provide empirical evidence for a US macroeconomic dataset. The unbalanced panel contains quarterly and monthly variables. The forecasting accuracy is measured against a set of benchmark models. We conclude that our dynamic factor state space analysis can lead to higher levels of forecasting precision when the panel size and time series dimensions are moderate.     

Mixed‐frequency models with moving‐average components

Temporal aggregation in general introduces a moving‐average (MA) component in the aggregated model. A similar feature emerges when not all but only a few variables are aggregated, which generates a mixed‐frequency (MF) model. The MA component is generally neglected, likely to preserve the possibility of ordinary least squares estimation, but the consequences have never been properly studied in the MF context. In this paper we show, analytically, in Monte Carlo simulations and in a forecasting application on US macroeconomic variables, the relevance of considering the MA component in MF mixed‐data sampling (MIDAS) and unrestricted MIDAS models (MIDAS–autoregressive moving average (ARMA) and UMIDAS‐ARMA). Specifically, the simulation results indicate that the short‐term forecasting performance of MIDAS‐ARMA and UMIDAS‐ARMA are better than that of, respectively, MIDAS and UMIDAS. The empirical applications on nowcasting US gross domestic product (GDP) growth, investment growth, and GDP deflator inflation confirm this ranking. Moreover, in both simulation and empirical results, MIDAS‐ARMA is better than UMIDAS‐ARMA.     

A SHARP model of bid–ask spread forecasts

This paper proposes an accurate, parsimonious and fast-to-estimate forecasting model for integer-valued time series with long memory and seasonality. The modelling is achieved through an autoregressive Poisson process with a predictable stochastic intensity that is determined by two factors: a seasonal intraday pattern and a heterogeneous autoregressive component. We call the model SHARP, which is an acronym for seasonal heterogeneous autoregressive Poisson. We also present a mixed-data sampling extension of the model, which adopts the historical information flow more efficiently and provides the best (among all the models considered) forecasting performances, empirically, for the bid–ask spreads of NYSE equity stocks. We conclude by showing how bid–ask spread forecasts based on the SHARP model can be exploited in order to reduce the total cost incurred by a trader who is willing to buy or sell a given amount of an equity stock.     

Tracking world trade and GDP in real time

This paper proposes a simple procedure for obtaining monthly assessments of short-run perspectives for quarterly world GDP and trade. It combines high-frequency information from emerging and advanced countries so as to explain quarterly national accounts variables through bridge models. The union of all bridge equations leads to our world bridge model (WBM). The WBM approach of this paper is new for two reasons: its equations combine traditional short-run bridging with theoretical level-relationships, and it is the first time that forecasts of world GDP and trade have been computed for both advanced and emerging countries on the basis of a real-time database of approximately 7000 time series. Although the performances of the equations that are searched automatically should be taken as a lower bound, our results show that the forecasting ability of the WBM is superior to the benchmark. Finally, our results confirm that the use of revised data leads to models’ forecasting performances being overstated significantly.     

Forecasting Singapore's quarterly GDP with monthly external trade

In this paper we suggest a methodology to formulate a dynamic regression with variables observed at different time intervals. This methodology is applicable if the explanatory variables are observed more frequently than the dependent variable. We demonstrate this procedure by developing a forecasting model for Singapore's quarterly GDP based on monthly external trade. Apart from forecasts, the model provides a monthly distributed lag structure between GDP and external trade, which is not possible with quarterly data.     

Financial nowcasts and their usefulness in macroeconomic forecasting

Financial data often contain information that is helpful for macroeconomic forecasting, while multi-step forecast accuracy benefits from incorporating good nowcasts of macroeconomic variables. This paper considers the usefulness of financial nowcasts for making conditional forecasts of macroeconomic variables with quarterly Bayesian vector autoregressions (BVARs). When nowcasting quarterly financial variables’ values, we find that taking the average of the available daily data and a daily random walk forecast to complete the quarter typically outperforms other nowcasting approaches. Using real-time data, we find gains in out-of-sample forecast accuracy from the inclusion of financial nowcasts relative to unconditional forecasts, with further gains from the incorporation of nowcasts of macroeconomic variables. Conditional forecasts from quarterly BVARs augmented with financial nowcasts rival the forecast accuracy of mixed-frequency dynamic factor models and mixed-data sampling (MIDAS) models.     

A comparison of mixed frequency approaches for nowcasting Euro area macroeconomic aggregates

In this paper, we focus on the different methods which have been proposed in the literature to date for dealing with mixed-frequency and ragged-edge datasets: bridge equations, mixed-data sampling (MIDAS), and mixed-frequency VAR (MF-VAR) models. We discuss their performances for nowcasting the quarterly growth rate of the Euro area GDP and its components, using a very large set of monthly indicators. We investigate the behaviors of single indicator models, forecast combinations and factor models, in a pseudo real-time framework. MIDAS with an AR component performs quite well, and outperforms MF-VAR at most horizons. Bridge equations perform well overall. Forecast pooling is superior to most of the single indicator models overall. Pooling information using factor models gives even better results. The best results are obtained for the components for which more economically related monthly indicators are available. Nowcasts of GDP components can then be combined to obtain nowcasts for the total GDP growth.     

Forecasting CPI inflation components with Hierarchical Recurrent Neural Networks

We present a hierarchical architecture based on recurrent neural networks for predicting disaggregated inflation components of the Consumer Price Index (CPI). While the majority of existing research is focused on predicting headline inflation, many economic and financial institutions are interested in its partial disaggregated components. To this end, we developed the novel Hierarchical Recurrent Neural Network (HRNN) model, which utilizes information from higher levels in the CPI hierarchy to improve predictions at the more volatile lower levels. Based on a large dataset from the US CPI-U index, our evaluations indicate that the HRNN model significantly outperforms a vast array of well-known inflation prediction baselines. Our methodology and results provide additional forecasting measures and possibilities to policy and market makers on sectoral and component-specific price changes.