Bayesian VAR forecasts,survey information,and structural change in the euro area

We incorporate external information extracted from the European Central Bank’s Survey of Professional Forecasters into the predictions of a Bayesian VAR using entropic tilting and soft conditioning. The resulting conditional forecasts significantly improve the plain BVAR point and density forecasts. Importantly, we do not restrict the forecasts at a specific quarterly horizon but their possible paths over several horizons jointly since the survey information comes in the form of one- and two-year-ahead expectations. As well as improving the accuracy of the variable that we target, the spillover effects on “other-than-targeted” variables are relevant in size and are statistically significant. We document that the baseline BVAR exhibits an upward bias for GDP growth after the financial crisis, and our results provide evidence that survey forecasts can help mitigate the effects of structural breaks on the forecasting performance of a popular macroeconometric model.     

An evaluation of the forecasts of the federal reserve: a pooled approach

The Federal Reserve Greenbook forecasts of real GDP, inflation and unemployment are analysed for the period 1974–1997. We consider whether these forecasts exhibit systematic bias, and whether efficient use is made of information, that is, whether revisions to these forecasts over time are predictable. Rather than analyse the forecasts separately for each horizon of interest, we discuss and implement methods that pool information over horizons. We conclude that there is evidence of systematic bias and of forecast smoothing of the inflation forecasts. Copyright © 2007 John Wiley & Sons, Ltd.     

Analysts' Forecasts of German Firms' Earnings: a Comparative Analysis

This paper examines analysts' forecasts of the annual earnings per share of German firms over the period of February 1987 to December 1995. The German case is particularly interesting as the accounting and institutional structures vary from those in more thoroughly researched markets such as the U.S. or U.K. The paper therefore considers the features of the German forecasting environment which distinguish it from the Anglo-American model, and whether these might be reflected in forecasting performance. The results for Germany show that the accuracy of analysts' forecasts improves as the forecast horizon shortens, are less accurate than a naive prediction model over longer horizons, and contain a positive bias. When the results for Germany are contrasted with the results for the U.K., as reported in a recent paper, they are found to be a little less accurate but the positive bias is greater in U.K. forecasts. Taken overall the forecasting process in Germany appears to be less efficient than in the U.K., but this may be due to the distinct features of the German forecasting environment.     

Systemic event prediction by an aggregate early warning system: An application to the Czech Republic

This work develops an early warning framework for assessing systemic risks and predicting systemic events over a short horizon of six quarters and a long horizon of 12 quarters on a panel of 14 countries, both advanced and developing. First, we build a financial stress index to identify the starting dates of systemic financial crises for each country in the panel. Second, early warning indicators for the assessment and prediction of systemic risk are selected in a two-step approach; we find relevant prediction horizons for each indicator by a univariate logit model followed by the application of Bayesian model averaging to identify the most useful indicators. Finally, we observe the performance of the constructed EWS over both horizons on the Czech data and find that the model over the long horizon outperforms the EWS over the short horizon. For both horizons, out-of-sample probability estimates do not deviate substantially from their in-sample estimates, indicating a good out-of-sample performance for the Czech Republic.     

A comparison of the forecasting performance of WEFA and ARIMA time series methods

This paper examines the forecasting performance of the Wharton model (MARK III) over the period 1973 through 1975 and compares it with that of ARIMA models' performance over the same period. Despite strong intimation in the literature to the contrary, we find that this econometric model, at least, exhibits greater accuracy in every respect relative to ARIMA methods, in terms of its forecasts cum constant adjustments. When constant adjustments are disallowed then its forecasts are still more accurate than ARIMA forecasts over a 4- and 8-quarter forecasting horizon, but less accurate over a 1-quarter horizon. The comparison was carried out over twenty three macrovariables, under a slight handicap for the Wharton Model, in that the latter's parameters were estimated over a sample ending in 1969.3 while the ARIMA models were reidentified and reestimated as of the quarter immediately preceding the forecast.     

Forecasting performance of multivariate time series models with full and reduced rank: an empirical examination

Since Quenouille's influential work on multiple time series, much progress has been made towards the goal of parameter reduction and model fit. Relatively less attention has been paid to the systematic evaluation of out-of-sample forecast performance of multivariate time series models. In this paper, we update the hog data set studied by Quenouille (and other researchers who followed him). We re-estimate his model with extended observations (1867–1966), and generate recursive one- to four-steps-ahead forecasts for the period of 1967 through 2000. These forecasts are compared to forecasts from an unrestricted vector autoregression, a reduced rank regression model, an index model and a cointegration-based error correction model. The error correction model that takes into account both nonstationarity of the data and rank reduction performs best at all four forecasting horizons. However, differences among competing models are statistically insignificant in most cases. No model consistently encompasses the others at all four horizons.     

A Dynamic Panel Data Approach to the Forecasting of the GDP of German Länder

Abstract

In this paper, we make multi-step forecasts of the annual growth rates of the real GDP for each of the 16 German Länder simultaneously. We apply dynamic panel models accounting for spatial dependence between regional GDP. We find that both pooling and accounting for spatial effects help to improve the forecast performance substantially. We demonstrate that the effect of accounting for spatial dependence is more pronounced for longer forecasting horizons (the forecast accuracy gain is about 9% for a 1-year horizon and exceeds 40% for a 5-year horizon). We recommend incorporating a spatial dependence structure into regional forecasting models, especially when long-term forecasts are made.     

Macroeconomic forecast accuracy in a data‐rich environment

The performance of six classes of models in forecasting different types of economic series is evaluated in an extensive pseudo out‐of‐sample exercise. One of these forecasting models, regularized data‐rich model averaging (RDRMA), is new in the literature. The findings can be summarized in four points. First, RDRMA is difficult to beat in general and generates the best forecasts for real variables. This performance is attributed to the combination of regularization and model averaging, and it confirms that a smart handling of large data sets can lead to substantial improvements over univariate approaches. Second, the ARMA(1,1) model emerges as the best to forecast inflation changes in the short run, while RDRMA dominates at longer horizons. Third, the returns on the S&P 500 index are predictable by RDRMA at short horizons. Finally, the forecast accuracy and the optimal structure of the forecasting equations are quite unstable over time.     

Applications of machine learning for corporate bond yield spread forecasting

This article considers nine different predictive techniques, including state-of-the-art machine learning methods for forecasting corporate bond yield spreads with other input variables. We examine each method’s out-of-sample forecasting performance using two different forecast horizons: (1) the in-sample dataset over 2003–2007 is used for one-year-ahead and two-year-ahead forecasts of non-callable corporate bond yield spreads; and (2) the in-sample dataset over 2003–2008 is considered to forecast the yield spreads in 2009. Evaluations of forecasting accuracy have shown that neural network forecasts are superior to the other methods considered here in both the short and longer horizon. Furthermore, we visualize the determinants of yield spreads and find that a firm’s equity volatility is a critical factor in yield spreads.     

Content horizons for univariate time-series forecasts

This paper investigates the maximum horizon at which conditioning information can be shown to have value for univariate time series forecasts. In particular, we consider the problem of determining the horizon beyond which forecasts from univariate time series models of stationary processes add nothing to the forecast implicit in the unconditional mean. We refer to this as the content horizon for forecasts, and provide a formal definition of the corresponding forecast content function at horizons s=1,… S. This function depends upon parameter estimation uncertainty as well as on autocorrelation structure of the process. We show that for autoregressive processes it is possible to give an asymptotic expression for the forecast content function, and show by simulation that the expression gives a good approximation even at modest sample sizes. The results are applied to the growth rate of GDP and to inflation, using US and Canadian data.     

Differencing versus nondifferencing in factor-based forecasting

This paper studies performance of factor-based forecasts using differenced and nondifferenced data. Approximate variances of forecasting errors from the two forecasts are derived and compared. It is reported that the forecast using nondifferenced data tends to be more accurate than that using differenced data. This paper conducts simulations to compare root mean squared forecasting errors of the two competing forecasts. Simulation results indicate that forecasting using nondifferenced data performs better. The advantage of using nondifferenced data is more pronounced when a forecasting horizon is long and the number of factors is large. This paper applies the two competing forecasting methods to 68 I(1) monthly US macroeconomic variables across a range of forecasting horizons and sampling periods. We also provide detailed forecasting analysis on US inflation and industrial production. We find that forecasts using nondifferenced data tend to outperform those using differenced data.     

Efficient estimation of forecast uncertainty based on recent forecast errors

Multi-step-ahead forecasts of the forecast uncertainty of an individual forecaster are often based on the horizon-specific sample means of his recent squared forecast errors, where the number of past forecast errors available decreases one-to-one with the forecast horizon. In this paper, the efficiency gains from the joint estimation of forecast uncertainty for all horizons in such samples are investigated. If the forecast uncertainty is estimated by seemingly unrelated regressions, it turns out that the covariance matrix of the squared forecast errors does not have to be estimated, but simply needs to have a certain structure, which is a very useful property in small samples. Considering optimal and non-optimal forecasts, it is found that the efficiency gains can be substantial for longer horizons in small samples. The superior performance of the seemingly-unrelated-regressions approach is confirmed in several empirical applications.     

Probabilistic wind forecasting up to three months ahead using ensemble predictions for geopotential height

We develop a method for forecasting the distribution of the daily surface wind speed at timescales from 15-days to 3-months in France. On such long-term timescales, ensemble predictions of the surface wind speed have poor performance, however, the wind speed distribution may be related to the large-scale circulation of the atmosphere, for which the ensemble forecasts have better skill. The information from the large-scale circulation, represented by the 500 hPa geopotential height, is summarized into a single index by first running a PCA and then a polynomial regression. We estimate, over 20 years of daily data, the conditional probability density of the wind speed at a specific location given the index. We then use the ECMWF seasonal forecast ensemble to predict the index for horizons from 15-days to 3-months. These predictions are plugged into the conditional density to obtain a distributional forecast of surface wind. These probabilistic forecasts remain sharper than the climatology up to 1-month forecast horizon. Using a statistical postprocessing method to recalibrate the ensemble leads to further improvement of our probabilistic forecast, which then remains calibrated and sharper than the climatology up to 3-months horizon, particularly in the north of France in winter and fall.     

Financial information and macroeconomic forecasts

We study the forecasting power of financial variables for macroeconomic variables in 62 countries between 1980 and 2013. We find that financial variables such as credit growth, stock prices, and house prices have considerable predictive power for macroeconomic variables at the one- to four-quarter horizons. A forecasting model that includes financial variables outperforms the World Economic Outlook (WEO) forecasts in up to 85% of our sample countries at the four-quarter horizon. We also find that cross-country panel models produce more accurate out-of-sample forecasts than individual country models.     

An Evaluation of Financial Analysts' Earnings Forecasts for Hong Kong Firms

This study evaluates the accuracy and potential bias of analyst forecasts for Hong Kong firms published in the Estimate Directory and compares analyst forecasts to model forecasts. It also examines the association of forecast accuracy with various firm characteristics. The findings of the study show that on an overall basis analyst forecasts for Hong Kong firms are more accurate than model forecasts. Analyst forecasts for Earnings Per Share (EPS) are generally biased towards overstatement. The analysis of the association between forecast accuracy and company characteristics suggests that analyst forecasts for larger firms are comparatively more accurate than for smaller firms. As expected, the results also show that analyst forecasts with shorter time horizons are more accurate than forecasts with longer time horizons. The variability in firms' earnings, beta (market risk) or industry classification have no significant impact on the accuracy of analyst forecasts.     

Does judgment improve macroeconomic density forecasts?

This paper presents empirical evidence on how judgmental adjustments affect the accuracy of macroeconomic density forecasts. Judgment is defined as the difference between professional forecasters’ densities and the forecast densities from statistical models. Using entropic tilting, we evaluate whether judgments about the mean, variance and skew improve the accuracy of density forecasts for UK output growth and inflation. We find that not all judgmental adjustments help. Judgments about point forecasts tend to improve density forecast accuracy at short horizons and at times of heightened macroeconomic uncertainty. Judgments about the variance hinder at short horizons, but can improve tail risk forecasts at longer horizons. Judgments about skew in general take value away, with gains seen only for longer horizon output growth forecasts when statistical models took longer to learn that downside risks had reduced with the end of the Great Recession. Overall, density forecasts from statistical models prove hard to beat.     

The usefulness of oil price forecasts—Evidence from survey predictions

This paper evaluates survey forecasts for crude oil prices and discusses the implications for decision makers. A novel disaggregated data set incorporating individual forecasts for Brent and Western Texas Intermediate is used. We carry out tests for unbiasedness, sign accuracy, and forecast encompassing, followed by the computation of coefficients for topically oriented trend adjustments and the Theil's U measure. We also control for the forecast horizon finding heterogeneous results. Forecasts are more precise for shorter horizons, but less accurate than the naïve prediction. For longer horizons, topically oriented trend adjustments become more pronounced, but forecasters tend to outperform the naïve predictions.     

Forecasts of US short-term interest rates: A flexible forecast combination approach

This paper develops a flexible approach to combine forecasts of future spot rates with forecasts from time-series models or macroeconomic variables. We find empirical evidence that, accounting for both regimes in interest rate dynamics, and combining forecasts from different models, helps improve the out-of-sample forecasting performance for US short-term rates. Imposing restrictions from the expectations hypothesis on the forecasting model are found to help at long forecasting horizons.     

Testing the predictive accuracy of COVID-19 forecasts

We test the predictive accuracy of forecasts of the number of COVID-19 fatalities produced by several forecasting teams and collected by the United States Centers for Disease Control and Prevention for the epidemic in the United States. We find three main results. First, at the short horizon (1 week ahead) no forecasting team outperforms a simple time-series benchmark. Second, at longer horizons (3 and 4 week ahead) forecasters are more successful and sometimes outperform the benchmark. Third, one of the best performing forecasts is the Ensemble forecast, that combines all available predictions using uniform weights. In view of these results, collecting a wide range of forecasts and combining them in an ensemble forecast may be a superior approach for health authorities, rather than relying on a small number of forecasts.