GNP forecasts: How credible are they? A sequential test of consistency and rationality

In this study we examine the accuracy in the expectation formation process of a major macroeconomic forecast variable, namely the Gross National Product (GNP). The theoretical foundations are similar to the one used to study exchange rate expectations, i.e. a verification of consistency and rationality in forecast formation. A very reliable and continuos data set, the ASA-NBER survey is used. The Engle-Granger two step cointegration methodology and the Johansen-Juselius canonical correlation's (which has the smallest bias and dispersion) is applied to examine consistency in the gross national product expectation formation process. Our results support (reject) consistency at the short (long) forecast horizon. We then sequentially test for weak and strong form rationality using the Phillips-Hansen fully modified ordinary least squares procedure. This allows for an unrestricted cointegration test correcting for both endogeneity in the data and asymtotic bias in the coefficient estimates. Weak (strong) form rationality is upheld (rejected). This is in line with the literature which rejects orthogonality, but partially supports expectational rationality.     

Assessing forecast performance in a cointegrated system

This paper examines the forecast performance of a cointegrated system relative to the forecast performance of a comparable VAR that fails to recognize that the system is characterized by cointegration. The cointegrated system we examine is composed of three vectors, a money demand representation, a Fisher equation, and a risk premium captured by an interest rate differential. The forecasts produced by the vector error correction model (VECM) associated with this system are compared with those obtained from a corresponding differenced vector autoregression, (DVAR) as well as a vector autoregression based upon the levels of the data (LVAR). Forecast evaluation is conducted using both the ‘full-system’ criterion proposed by Clements and Hendry (1993) and by comparing forecast performance for specific variables. Overall our findings suggest that selective forecast performance improvement (especially at long forecast horizons) may be observed by incorporating knowledge of cointegration rank. Our general conclusion is that when the advantage of incorporating cointegration appears, it is generally at longer forecast horizons. This is consistent with the predictions of Engle and Yoo (1987). But we also find, consistent with Clements and Hendry (1995) that relative gain in forecast performance clearly depends upon the chosen data transformation.     

Financial nowcasts and their usefulness in macroeconomic forecasting

Financial data often contain information that is helpful for macroeconomic forecasting, while multi-step forecast accuracy benefits from incorporating good nowcasts of macroeconomic variables. This paper considers the usefulness of financial nowcasts for making conditional forecasts of macroeconomic variables with quarterly Bayesian vector autoregressions (BVARs). When nowcasting quarterly financial variables’ values, we find that taking the average of the available daily data and a daily random walk forecast to complete the quarter typically outperforms other nowcasting approaches. Using real-time data, we find gains in out-of-sample forecast accuracy from the inclusion of financial nowcasts relative to unconditional forecasts, with further gains from the incorporation of nowcasts of macroeconomic variables. Conditional forecasts from quarterly BVARs augmented with financial nowcasts rival the forecast accuracy of mixed-frequency dynamic factor models and mixed-data sampling (MIDAS) models.     

Applications of machine learning for corporate bond yield spread forecasting

This article considers nine different predictive techniques, including state-of-the-art machine learning methods for forecasting corporate bond yield spreads with other input variables. We examine each method’s out-of-sample forecasting performance using two different forecast horizons: (1) the in-sample dataset over 2003–2007 is used for one-year-ahead and two-year-ahead forecasts of non-callable corporate bond yield spreads; and (2) the in-sample dataset over 2003–2008 is considered to forecast the yield spreads in 2009. Evaluations of forecasting accuracy have shown that neural network forecasts are superior to the other methods considered here in both the short and longer horizon. Furthermore, we visualize the determinants of yield spreads and find that a firm’s equity volatility is a critical factor in yield spreads.     

Short term load forecasting and the effect of temperature at the low voltage level

Short term load forecasts will play a key role in the implementation of smart electricity grids. They are required for optimising a wide range of potential network solutions on the low voltage (LV) grid, including the integration of low carbon technologies (such as photovoltaics) and the utilisation of battery storage devices. Despite the need for accurate LV level load forecasts, much of the literature has focused on the individual household or building level using data from smart meters, or on aggregates of such data. This study provides a detailed analysis of several state-of-the-art methods for both point and probabilistic LV load forecasts. We evaluate the out-of-sample forecast accuracies of these methodologies on 100 real LV feeders, for horizons from one to four days ahead. In addition, we also test the effect of the temperature (both actual and forecast) on the accuracy of load forecasts. We present some important results on the drivers of forecasts accuracy as well as on the empirical comparison of point and probabilistic forecast measures.     

Predictive financial models of the euro area: A new evaluation test

This paper investigates the predictive ability of financial variables for euro area growth. Our forecasts are built from univariate autoregressive and single equation models. Euro area aggregate forecasts are constructed both by employing aggregate variables and by aggregating country-specific forecasts. The forecast evaluation is based on a recently developed test for equal predictive ability between nested models. Employing a monthly dataset from the period between January 1988 and May 2005 and setting the out-of-sample period to be from 2001 onwards, we find that the single most powerful predictor on a country basis is the stock market returns, followed by money supply growth. However, for the euro area aggregate, the set of most powerful predictors includes interest rate variables as well. The forecasts from pooling individual country models outperform those from the aggregate itself for short run forecasts, while for longer horizons this pattern is reversed. Additional benefits are obtained when combining information from a range of variables or combining model forecasts.     

An Evaluation of Financial Analysts' Earnings Forecasts for Hong Kong Firms

This study evaluates the accuracy and potential bias of analyst forecasts for Hong Kong firms published in the Estimate Directory and compares analyst forecasts to model forecasts. It also examines the association of forecast accuracy with various firm characteristics. The findings of the study show that on an overall basis analyst forecasts for Hong Kong firms are more accurate than model forecasts. Analyst forecasts for Earnings Per Share (EPS) are generally biased towards overstatement. The analysis of the association between forecast accuracy and company characteristics suggests that analyst forecasts for larger firms are comparatively more accurate than for smaller firms. As expected, the results also show that analyst forecasts with shorter time horizons are more accurate than forecasts with longer time horizons. The variability in firms' earnings, beta (market risk) or industry classification have no significant impact on the accuracy of analyst forecasts.     

On forecasting cointegrated seasonal time series

We analyze periodic and seasonal cointegration models for bivariate quarterly observed time series in an empirical forecasting study. We include both single equation and multiple equation methods for those two classes of models. A VAR model in first differences, with and without cointegration restrictions, and a VAR model in annual differences are also included in the analysis, where they serve as benchmark models. Our empirical results indicate that the VAR model in first differences without cointegration is best if one-step ahead forecasts are considered. For longer forecast horizons however, the VAR model in annual differences is better. When comparing periodic versus seasonal cointegration models, we find that the seasonal cointegration models tend to yield better forecasts. Finally, there is no clear indication that multiple equations methods improve on single equation methods.     

Linear models, smooth transition autoregressions, and neural networks for forecasting macroeconomic time series: A re-examination

In this paper, we examine the forecast accuracy of linear autoregressive, smooth transition autoregressive (STAR), and neural network (NN) time series models for 47 monthly macroeconomic variables of the G7 economies. Unlike previous studies that typically consider multiple but fixed model specifications, we use a single but dynamic specification for each model class. The point forecast results indicate that the STAR model generally outperforms linear autoregressive models. It also improves upon several fixed STAR models, demonstrating that careful specification of nonlinear time series models is of crucial importance. The results for neural network models are mixed in the sense that at long forecast horizons, an NN model obtained using Bayesian regularization produces more accurate forecasts than a corresponding model specified using the specific-to-general approach. Reasons for this outcome are discussed.     

Real‐time forecast combinations for the oil price

Baumeister and Kilian (Journal of Business and Economic Statistics, 2015, 33(3), 338–351) combine forecasts from six empirical models to predict real oil prices. In this paper, we broadly reproduce their main economic findings, employing their preferred measures of the real oil price and other real‐time variables. Mindful of the importance of Brent crude oil as a global price benchmark, we extend consideration to the North Sea‐based measure and update the evaluation sample to 2017:12. We model the oil price futures curve using a factor‐based Nelson–Siegel specification estimated in real time to fill in missing values for oil price futures in the raw data. We find that the combined forecasts for Brent are as effective as for other oil price measures. The extended sample using the oil price measures adopted by Baumeister and Kilian yields similar results to those reported in their paper. Also, the futures‐based model improves forecast accuracy at longer horizons.     

Improving forecast stability using deep learning

In this paper, we define forecast (in)stability in terms of the variability in forecasts for a specific time period caused by updating the forecast for this time period when new observations become available, i.e., as time passes. We propose an extension to the state-of-the-art N-BEATS deep learning architecture for the univariate time series point forecasting problem. The extension allows us to optimize forecasts from both a traditional forecast accuracy perspective as well as a forecast stability perspective. We show that the proposed extension results in forecasts that are more stable without leading to a deterioration in forecast accuracy for the M3 and M4 data sets. Moreover, our experimental study shows that it is possible to improve both forecast accuracy and stability compared to the original N-BEATS architecture, indicating that including a forecast instability component in the loss function can be used as regularization mechanism.     

Macroeconomic forecasting for Australia using a large number of predictors

A popular approach to forecasting macroeconomic variables is to utilize a large number of predictors. Several regularization and shrinkage methods can be used to exploit such high-dimensional datasets, and have been shown to improve forecast accuracy for the US economy. To assess whether similar results hold for economies with different characteristics, an Australian dataset containing observations on 151 aggregate and disaggregate economic series as well as 185 international variables, is introduced. An extensive empirical study is carried out investigating forecasts at different horizons, using a variety of methods and with information sets containing an increasing number of predictors. In contrast to other countries the results show that it is difficult to forecast Australian key macroeconomic variables more accurately than some simple benchmarks. In line with other studies we also find that there is little to no improvement in forecast accuracy when the number of predictors is expanded beyond 20–40 variables and international factors do not seem to help.     

Asymmetric loss in the Greenbook and the Survey of Professional Forecasters

This paper examines the forecast rationality of the Greenbook and the Survey of Professional Forecasters (SPF) under asymmetric loss functions, using the method proposed by Elliott, Komunjer, and Timmermann (2005) with a rolling window strategy. Over rolling periods, the degree and direction of the asymmetry in forecast loss functions are time-varying. While rationality under symmetric loss is often rejected, forecast rationality under asymmetric loss fails to be rejected over nearly all rolling periods. Besides, real output growth is consistently under-predicted in the 1990s, and the inflation rate is consistently over-predicted in the 1980s and 1990s. In general, inflation forecasts, especially for long horizons, exhibit greater levels of loss asymmetry in magnitude and frequency. The loss asymmetry of real output growth forecasts is more pronounced when the last revised vintage data are used than when the real-time vintage is used. All of these results hold for both the Greenbook and SPF forecasts. The results are also similar with the use of different sets of instrumental variables for estimating the asymmetric loss and testing for forecast rationality.     

Forecasts in times of crises

Financial crises pose unique challenges for forecast accuracy. Using the IMF’s Monitoring of Fund Arrangements (MONA) database, we conduct the most comprehensive evaluation of IMF forecasts to date for countries in times of crises. We examine 29 macroeconomic variables in terms of bias, efficiency, and information content to find that IMF forecasts add substantial informational value, as they consistently outperform naive forecast approaches. However, we also document that there is room for improvement: two-thirds of the key macroeconomic variables that we examine are forecast inefficiently, and six variables (growth of nominal GDP, public investment, private investment, the current account, net transfers, and government expenditures) exhibit significant forecast biases. The forecasts for low-income countries are the main drivers of forecast biases and inefficiency, perhaps reflecting larger shocks and lower data quality. When we decompose the forecast errors into their sources, we find that forecast errors for private consumption growth are the key contributor to GDP growth forecast errors. Similarly, forecast errors for non-interest expenditure growth and tax revenue growth are crucial determinants of the forecast errors in the growth of fiscal budgets. Forecast errors for balance of payments growth are influenced significantly by forecast errors in goods import growth. The results highlight which macroeconomic aggregates require further attention in future forecast models for countries in crises.     

Multivariate volatility forecasts for stock market indices

Volatility forecasts aim to measure future risk and they are key inputs for financial analysis. In this study, we forecast the realized variance as an observable measure of volatility for several major international stock market indices and accounted for the different predictive information present in jump, continuous, and option-implied variance components. We allowed for volatility spillovers in different stock markets by using a multivariate modeling approach. We used heterogeneous autoregressive (HAR)-type models to obtain the forecasts. Based an out-of-sample forecast study, we show that: (i) including option-implied variances in the HAR model substantially improves the forecast accuracy, (ii) lasso-based lag selection methods do not outperform the parsimonious day-week-month lag structure of the HAR model, and (iii) cross-market spillover effects embedded in the multivariate HAR model have long-term forecasting power.     

Does judgment improve macroeconomic density forecasts?

This paper presents empirical evidence on how judgmental adjustments affect the accuracy of macroeconomic density forecasts. Judgment is defined as the difference between professional forecasters’ densities and the forecast densities from statistical models. Using entropic tilting, we evaluate whether judgments about the mean, variance and skew improve the accuracy of density forecasts for UK output growth and inflation. We find that not all judgmental adjustments help. Judgments about point forecasts tend to improve density forecast accuracy at short horizons and at times of heightened macroeconomic uncertainty. Judgments about the variance hinder at short horizons, but can improve tail risk forecasts at longer horizons. Judgments about skew in general take value away, with gains seen only for longer horizon output growth forecasts when statistical models took longer to learn that downside risks had reduced with the end of the Great Recession. Overall, density forecasts from statistical models prove hard to beat.     

The tourism forecasting competition

We evaluate the performances of various methods for forecasting tourism data. The data used include 366 monthly series, 427 quarterly series and 518 annual series, all supplied to us by either tourism bodies or academics who had used them in previous tourism forecasting studies. The forecasting methods implemented in the competition are univariate and multivariate time series approaches, and econometric models. This forecasting competition differs from previous competitions in several ways: (i) we concentrate on tourism data only; (ii) we include approaches with explanatory variables; (iii) we evaluate the forecast interval coverage as well as the point forecast accuracy; (iv) we observe the effect of temporal aggregation on the forecasting accuracy; and (v) we consider the mean absolute scaled error as an alternative forecasting accuracy measure. We find that pure time series approaches provide more accurate forecasts for tourism data than models with explanatory variables. For seasonal data we implement three fully automated pure time series algorithms that generate accurate point forecasts, and two of these also produce forecast coverage probabilities which are satisfactorily close to the nominal rates. For annual data we find that Naïve forecasts are hard to beat.     

Forecasting with Global Vector Autoregressive Models: a Bayesian Approach

This paper develops a Bayesian variant of global vector autoregressive (B‐GVAR) models to forecast an international set of macroeconomic and financial variables. We propose a set of hierarchical priors and compare the predictive performance of B‐GVAR models in terms of point and density forecasts for one‐quarter‐ahead and four‐quarter‐ahead forecast horizons. We find that forecasts can be improved by employing a global framework and hierarchical priors which induce country‐specific degrees of shrinkage on the coefficients of the GVAR model. Forecasts from various B‐GVAR specifications tend to outperform forecasts from a naive univariate model, a global model without shrinkage on the parameters and country‐specific vector autoregressions. Copyright © 2016 John Wiley & Sons, Ltd.     

Are professional forecasters overconfident?

Do professional forecasters have an accurate sense of the uncertainties surrounding their own forecasts? This paper examines forecaster overconfidence by comparing ex ante, surveyed forecaster uncertainty with ex post, realised uncertainty based on the dispersion of an individual’s forecast errors. Unlike the literature that focuses on consensus forecasts, our focus is at the level of the individual forecaster. Using microdata from the three major surveys of professional forecasters (Euro Area, US and UK), we examine real GDP growth forecasts over the period 1999–2015. Our findings show that overconfidence dominates among individual forecasters, particularly for longer forecast horizons, and that individual forecasters appear to have little understanding of their own uncertainty.     

Macroeconomic forecast accuracy in a data‐rich environment

The performance of six classes of models in forecasting different types of economic series is evaluated in an extensive pseudo out‐of‐sample exercise. One of these forecasting models, regularized data‐rich model averaging (RDRMA), is new in the literature. The findings can be summarized in four points. First, RDRMA is difficult to beat in general and generates the best forecasts for real variables. This performance is attributed to the combination of regularization and model averaging, and it confirms that a smart handling of large data sets can lead to substantial improvements over univariate approaches. Second, the ARMA(1,1) model emerges as the best to forecast inflation changes in the short run, while RDRMA dominates at longer horizons. Third, the returns on the S&P 500 index are predictable by RDRMA at short horizons. Finally, the forecast accuracy and the optimal structure of the forecasting equations are quite unstable over time.