Forecasting with news sentiment: Evidence with UK newspapers

We investigate the performance of newspapers for forecasting inflation, output and unemployment in the United Kingdom. We concentrate on whether the economic policy content reported in popular printed media can improve on existing point forecasts. We find no evidence supporting improved nowcasts or short-term forecasts for inflation. The sentiment inferred from printed media, can however be useful for forecasting unemployment and output. Considerable improvements are also noted when using individual newspapers and keyword based indices.     

A textual analysis of Bank of England growth forecasts

The Bank of England publishes a quarterly Inflation Report that provides numerical forecasts and a text discussion of its assessment of the UK economy. Previous research has evaluated the quantitative forecasts that are included in these reports, but we focus on the qualitative discussion of output growth, by using an in-sample textual analysis procedure to convert these qualitative assessments into a score for each report over the period 2005–2014. We also construct out-of-sample scores for reports before and after this period. We then compare the scores both to real-time output growth data and to the corresponding quantitative projections published by the bank. We find that overall developments in the UK economy were represented accurately in the text of the Inflation Report. Furthermore, efficiency regressions suggest that there is information in the text that could improve the Bank of England’s quantitative nowcasts and one-quarter-ahead forecasts.     

Does judgment improve macroeconomic density forecasts?

This paper presents empirical evidence on how judgmental adjustments affect the accuracy of macroeconomic density forecasts. Judgment is defined as the difference between professional forecasters’ densities and the forecast densities from statistical models. Using entropic tilting, we evaluate whether judgments about the mean, variance and skew improve the accuracy of density forecasts for UK output growth and inflation. We find that not all judgmental adjustments help. Judgments about point forecasts tend to improve density forecast accuracy at short horizons and at times of heightened macroeconomic uncertainty. Judgments about the variance hinder at short horizons, but can improve tail risk forecasts at longer horizons. Judgments about skew in general take value away, with gains seen only for longer horizon output growth forecasts when statistical models took longer to learn that downside risks had reduced with the end of the Great Recession. Overall, density forecasts from statistical models prove hard to beat.     

The Measurement and Behavior of Uncertainty: Evidence from the ECB Survey of Professional Forecasters

We examine matched point and density forecasts of output growth, inflation and unemployment from the ECB Survey of Professional Forecasters. We construct measures of uncertainty from individual histograms, and find that the measures display countercyclical behavior and have increased across all forecast horizons since 2007. We also derive measures of forecast dispersion and forecast accuracy, and find that they are not reliable proxies for uncertainty. There is, however, evidence of a meaningful co‐movement between uncertainty and aggregate point predictions for output growth and unemployment. These results are robust to changes in the composition of the survey respondents over time. Copyright © 2015 John Wiley & Sons, Ltd.     

Do Investors Pay Sufficient Attention to Banks’ Unrealized Gains and Losses on Available-for-sale Securities?

Abstract

Unrealized gains and losses on available-for-sale securities (AFSGL) are included in Other Comprehensive Income (OCI) and directly affect shareholders’ equity but are not included in earnings. We investigate whether unrealized AFSGL help predict future earnings and whether analysts and investors incorporate the information conveyed by unrealized AFSGL in a timely manner. We conduct our investigation on a sample of banks because unrealized AFSGL are material in the banking industry. First, we show that unrealized AFSGL are material and help in predicting next period realized AFSGL and future earnings change. Second, we document that financial analysts are slow to react to unrealized AFSGL and update their forecasts after AFSGL are realized in earnings. Third, we find that investors are also slow to react to unrealized AFSGL and do so only after AFSGL are included (realized) in earnings and after financial analysts update their forecasts. We document an annual difference of 5% in future abnormal returns between banks in the top and bottom quintiles of past unrealized AFSGL. A zero-cost trading strategy that relies on public information about unrealized AFSGL generates a sizeable monthly alpha that ranges between 1.8% and 1.9%.     

Are macroeconomic density forecasts informative?

We consider whether survey density forecasts (such as the inflation and output growth histograms of the US Survey of Professional Forecasters) are superior to unconditional density forecasts. The unconditional forecasts assume that the average level of uncertainty that has been experienced in the past will continue to prevail in the future, whereas the SPF projections ought to be adapted to the current conditions and the outlook at each forecast origin. The SPF forecasts might be expected to outperform the unconditional densities at the shortest horizons, but it transpires that such is not the case for the aggregate forecasts of either variable, or for the majority of the individual respondents for forecasting inflation.     

Forecasting the UK economy with a medium-scale Bayesian VAR

We estimate a Bayesian VAR (BVAR) for the UK economy and assess its performance in forecasting GDP growth and CPI inflation in real time relative to forecasts from COMPASS, the Bank of England’s DSGE model, and other benchmarks. We find that the BVAR outperformed COMPASS when forecasting both GDP and its expenditure components. In contrast, their performances when forecasting CPI were similar. We also find that the BVAR density forecasts outperformed those of COMPASS, despite under-predicting inflation at most forecast horizons. Both models over-predicted GDP growth at all forecast horizons, but the issue was less pronounced in the BVAR. The BVAR’s point and density forecast performances are also comparable to those of a Bank of England in-house statistical suite for both GDP and CPI inflation, as well as to the official Inflation Report projections. Our results are broadly consistent with the findings of similar studies for other advanced economies.     

The Influence and Policy Signalling Role of FOMC Forecasts

Federal Open Market Committee (FOMC) policymakers have published macroeconomic forecasts since 1979 and we examine the effects of FOMC inflation forecasts using a structural VAR model. First, we assess whether they influence private inflation expectations. Second, we investigate the underlying mechanism at work and whether they convey policy signals. We provide original evidence that FOMC inflation forecasts influence private ones. We also find that the influencing effect of FOMC forecasts does not come through current Fed rate changes, that FOMC forecasts affect private expectations in a different way than current policy decisions, and that FOMC forecasts are informative about future Fed rate movements.     

Evaluating predictive densities of US output growth and inflation in a large macroeconomic data set

We evaluate conditional predictive densities for US output growth and inflation using a number of commonly-used forecasting models that rely on large numbers of macroeconomic predictors. More specifically, we evaluate how well conditional predictive densities based on the commonly-used normality assumption fit actual realizations out-of-sample. Our focus on predictive densities acknowledges the possibility that, although some predictors can cause point forecasts to either improve or deteriorate, they might have the opposite effect on higher moments. We find that normality is rejected for most models in some dimension according to at least one of the tests we use. Interestingly, however, combinations of predictive densities appear to be approximated correctly by a normal density: the simple, equal average when predicting output growth, and the Bayesian model average when predicting inflation.     

The impact of sentiment and attention measures on stock market volatility

We analyze the impact of sentiment and attention variables on the stock market volatility by using a novel and extensive dataset that combines social media, news articles, information consumption, and search engine data. We apply a state-of-the-art sentiment classification technique in order to investigate the question of whether sentiment and attention measures contain additional predictive power for realized volatility when controlling for a wide range of economic and financial predictors. Using a penalized regression framework, we identify the most relevant variables to be investors’ attention, as measured by the number of Google searches on financial keywords (e.g. “financial market” and “stock market”), and the daily volume of company-specific short messages posted on StockTwits. In addition, our study shows that attention and sentiment variables are able to improve volatility forecasts significantly, although the magnitudes of the improvements are relatively small from an economic point of view.     

Predicting turning points in the housing market

We identify leading indicators of changes in the housing market and compare their performance in predicting turning points. Being able to predict turning points is of importance to the home building industry, homeowners, and makers of housing policy. Our leading indicators include the Wells Fargo/NAHB Housing Market Index, two of its forward looking components, and an index of consumer sentiment regarding purchasing a home. Our comparison tests include Granger causality and a Bayesian predictor of the probability of a turning point. We find that the measure of consumer sentiment performs relatively well compared to the HMI in predicting home permits, housing starts, and new home sales.     

Kernel-based calibration diagnostics for recession and inflation probability forecasts

A probabilistic forecast is the estimated probability with which a future event will occur. One interesting feature of such forecasts is their calibration, or the match between the predicted probabilities and the actual outcome probabilities. Calibration has been evaluated in the past by grouping probability forecasts into discrete categories. We show here that we can do this without discrete groupings; the kernel estimators that we use produce efficiency gains and smooth estimated curves relating the predicted and actual probabilities. We use such estimates to evaluate the empirical evidence on the calibration error in a number of economic applications, including the prediction of recessions and inflation, using both forecasts made and stored in real time and pseudo-forecasts made using the data vintage available at the forecast date. The outcomes are evaluated using both first-release outcome measures and subsequent revised data. We find substantial evidence of incorrect calibration in professional forecasts of recessions and inflation from the SPF, as well as in real-time inflation forecasts from a variety of output gap models.     

Do IMF forecasts respect Okun’s law? Evidence for advanced and developing economies

This paper provides an assessment of the IMF’s unemployment forecasts, which have not received much scrutiny to date. The focus is on the internal consistency of the IMF’s growth and unemployment forecasts, and specifically on seeing whether the relationship between the two is consistent with the relationship in the data, i.e., with Okun’s Law. We find that the average performance is good, in the sense that the relationship between growth and unemployment forecasts is fairly comparable to that which prevails in the data: on average, the Okun coefficient in the forecasts mirrors the Okun coefficient in the data. Nevertheless, there is room for improvement, particularly in the year-ahead forecasts and for the group of middle-income countries. We show that a linear combination of Okun-based unemployment forecasts and WEO unemployment forecasts can deliver significant gains in forecast accuracy for developing economies.     

Evaluating DSGE model forecasts of comovements

This paper develops and applies tools to assess multivariate aspects of Bayesian Dynamic Stochastic General Equilibrium (DSGE) model forecasts and their ability to predict comovements among key macroeconomic variables. We construct posterior predictive checks to evaluate conditional and unconditional density forecasts, in addition to checks for root-mean-squared errors and event probabilities associated with these forecasts. The checks are implemented on a three-equation DSGE model as well as the Smets and Wouters (2007) model using real-time data. We find that the additional features incorporated into the Smets–Wouters model do not lead to a uniform improvement in the quality of density forecasts and prediction of comovements of output, inflation, and interest rates.     

Comparing probabilistic forecasts of the daily minimum and maximum temperature

Understanding changes in the frequency, severity, and seasonality of daily temperature extremes is important for public policy decisions regarding heat waves and cold snaps. A heat wave is sometimes defined in terms of both the daily minimum and maximum temperature, which necessitates the generation of forecasts of their joint distribution. In this paper, we develop time series models with the aim of providing insight and producing forecasts of the joint distribution that can challenge the accuracy of forecasts based on ensemble predictions from a numerical weather prediction model. We use ensemble model output statistics to recalibrate the raw ensemble predictions for the marginal distributions, with ensemble copula coupling used to capture the dependency between the marginal distributions. In terms of time series modelling, we consider a bivariate VARMA-MGARCH model. We use daily Spanish data recorded over a 65-year period, and find that, for the 5-year out-of-sample period, the recalibrated ensemble predictions outperform the time series models in terms of forecast accuracy.     

Happiness sentiments and the prediction of cross-border country exchange-traded fund returns

This research examines whether social media (Twitter) happiness sentiment and country-level happiness sentiment indices predict cross-border ETF returns. To account for complicated associations between happiness sentiment and ETF returns, we use a quantile regression approach and find that Twitter and trading market (U.S.) happiness sentiments are strong predictors of future ETF returns, for which both have far greater predictive power than those of their home countries. Home country happiness indices exhibit asymmetric impacts across quantiles, suggesting the importance of trading country (U.S.) and Twitter happiness sentiments. Higher U.S. and home countries’ freedom to make life choices, absence of corruption perception, and confidence in national government precede higher ETF returns, while U.S. GDP, social support, health life expectancy, positive affect, and negative affect precede lower (abnormal) returns. We find that higher return quantile country ETFs provide a safe haven for U.S. investors during a U.S. bear market.     

High-frequency credit spread information and macroeconomic forecast revision

We examine whether professional forecasters incorporate high-frequency information about credit conditions when revising their economic forecasts. Using a mixed data sampling regression approach, we find that daily credit spreads have significant predictive ability for monthly forecast revisions of output growth, at both the aggregate and individual forecast levels. The relationships are shown to be notably strong during ‘bad’ economic conditions, which suggests that forecasters anticipate more pronounced effects of credit tightening during economic downturns, indicating an amplification effect of financial developments on macroeconomic aggregates. The forecasts do not incorporate all financial information received in equal measures, implying the presence of information rigidities in the incorporation of credit spread information.     

Evaluating Point and Density Forecasts of DSGE Models

This paper investigates the accuracy of forecasts from four dynamic stochastic general equilibrium (DSGE) models for inflation, output growth and the federal funds rate using a real‐time dataset synchronized with the Fed's Greenbook projections. Conditioning the model forecasts on the Greenbook nowcasts leads to forecasts that are as accurate as the Greenbook projections for output growth and the federal funds rate. Only for inflation are the model forecasts dominated by the Greenbook projections. A comparison with forecasts from Bayesian vector autoregressions shows that the economic structure of the DSGE models which is useful for the interpretation of forecasts does not lower the accuracy of forecasts. Combining forecasts of several DSGE models increases precision in comparison to individual model forecasts. Comparing density forecasts with the actual distribution of observations shows that DSGE models overestimate uncertainty around point forecasts. Copyright © 2013 John Wiley & Sons, Ltd.     

Do precious metal prices help in forecasting South African inflation?

In this paper we test whether the key metals prices of gold and platinum significantly improve inflation forecasts for the South African economy. We also test whether controlling for conditional correlations in a dynamic setup, using bivariate Bayesian-Dynamic Conditional Correlation (B-DCC) models, improves inflation forecasts. To achieve this we compare out-of-sample forecast estimates of the B-DCC model to Random Walk, Autoregressive and Bayesian VAR models. We find that for both the BVAR and BDCC models, improving point forecasts of the Autoregressive model of inflation remains an elusive exercise. This, we argue, is of less importance relative to the more informative density forecasts. For this we find improved forecasts of inflation for the B-DCC models at all forecasting horizons tested. We thus conclude that including metals price series as inputs to inflation models leads to improved density forecasts, while controlling for the dynamic relationship between the included price series and inflation similarly leads to significantly improved density forecasts.     

What do professional forecasters actually predict?

This paper studies what professional forecasters predict. We use spectral analysis and state space modeling to decompose economic time series into trend, business cycle, and irregular components. We examine which components are captured by professional forecasters by regressing their forecasts on the estimated components extracted from both the spectral analysis and the state space model. For both decomposition methods, we find that, in the short run, the Survey of Professional Forecasters can predict almost all of the variation in the time series due to the trend and the business cycle, but that the forecasts contain little or no significant information about the variation in the irregular component.