Evaluating FOMC forecasts

Monetary policy outcomes have improved since the early 1980s. One factor contributing to the improvement is that Federal Reserve policymakers began reporting economic forecasts to Congress in 1979. These forecasts indicate what the Federal Open Market Committee (FOMC) members think will be the likely consequence of their policies. We evaluate the accuracy of the FOMC forecasts relative to private sector forecasts, the forecasts of the Research Staff at the Board of Governors, and a naïve alternative. We find that the FOMC output forecasts were better than the naïve model and at least as good as those of the private sector and the Fed staff. The FOMC inflation forecasts were more accurate than the private sector forecasts and the naïve model; for the period ending in 1996, however, they were not as accurate as Fed staff inflation forecasts.     

Fiscal forecasting performance in an emerging economy: An empirical assessment of Brazil

This study makes use of Brazilian data to analyze government budget balance forecast errors. Besides the analysis of the quality and efficiency of budget balance forecasts, economic, political, and institutional and governance dimensions are explored. The findings show that the data forecasts have low quality and efficiency. Furthermore, it is observed that the budget forecast error is subject to a backward-looking effect, a bias in the economic growth forecasts, as well as cyclical fluctuations. Finally, electoral cycles represent a source of overestimated forecasts, and strong institutions and governance supported by the public are able to suppress opportunistic motivations in budget forecasts.     

业绩预告下的股份减持与内幕交易——会计稳健性是遏制还是助力？

选取2010—2018年沪深A股上市公司为样本,考察业绩预告发布前后大股东是否存在以及如何利用自身信息优势进行股份减持交易,会计稳健性是否以及如何对该内幕交易产生影响。研究结果表明:与强制性业绩预告相比,自愿性业绩预告披露前后发生大股东减持的概率更高,并且会计稳健性会显著抑制自愿性业绩预告披露前后的大股东减持行为。进一步将业绩预告消息区分为好消息和坏消息之后研究发现:坏消息的利空程度越高,大股东在业绩预告之前进行股份减持的规模越大;或者好消息的利好程度越高,大股东在业绩预告之后减持的规模也越大;稳健的财务信息能够抑制公司在隐匿坏消息方面进行的内幕交易,但会加剧公司在隐匿好消息方面进行的内幕交易。     

Predicting capacity utilization: Federal Reserve vs time-series models

This study evaluates the Federal Reserve forecasts of manufacturing capacity utilization employing, as benchmarks, the forecasts from a univariate model which utilizes past information in capacity utilization, and from a bivariate model which utilizes past information in both capacity utilization and the federal funds rate. In addition to accurately predicting the directional change in capacity utilization, the Federal Reserve forecasts are “weakly” rational and generally superior to the bivariate forecasts. In light of another finding that monetary policy is non-neutral, we argue the Federal Reserve forecasts of capacity utilization have positively contributed to the Fed’s success in maintaining a low inflationary environment.

Do Analysts Strategically Employ Cash Flow Forecast Revisions to Offset Negative Earnings Forecast Revisions?

We investigate whether analysts use cash flow forecasts to reduce the impact of earnings forecast revisions (EFRs) on market participants. In particular, we focus on conflict between an analyst's concurrent cash flow and earnings forecast revisions. We hypothesize and find that analysts are more likely to issue a positive cash flow forecast revision when they issue a negative earnings forecast revision concurrently, but not the opposite, particularly for Fortune 500 firms. Furthermore, our supplementary analyses suggest that (1) some analysts optimistically bias cash flow forecasts when they issue negative earnings forecast revisions; (2) the market pays less attention to the historical accuracy of analyst cash flow forecasts, so analysts have some latitude to present their cash flow forecasts in an optimistic way; and (3) the market reacts mainly to the direction, not the magnitude, of cash flow forecast revisions. Overall, these findings suggest that analysts may strategically use cash flow forecasts in conjunction with earnings forecasts to maintain good management relationships.     

Do IMF forecasts respect Okun’s law? Evidence for advanced and developing economies

This paper provides an assessment of the IMF’s unemployment forecasts, which have not received much scrutiny to date. The focus is on the internal consistency of the IMF’s growth and unemployment forecasts, and specifically on seeing whether the relationship between the two is consistent with the relationship in the data, i.e., with Okun’s Law. We find that the average performance is good, in the sense that the relationship between growth and unemployment forecasts is fairly comparable to that which prevails in the data: on average, the Okun coefficient in the forecasts mirrors the Okun coefficient in the data. Nevertheless, there is room for improvement, particularly in the year-ahead forecasts and for the group of middle-income countries. We show that a linear combination of Okun-based unemployment forecasts and WEO unemployment forecasts can deliver significant gains in forecast accuracy for developing economies.     

Comparing trained and untrained probabilistic ensemble forecasts of COVID-19 cases and deaths in the United States

The U.S. COVID-19 Forecast Hub aggregates forecasts of the short-term burden of COVID-19 in the United States from many contributing teams. We study methods for building an ensemble that combines forecasts from these teams. These experiments have informed the ensemble methods used by the Hub. To be most useful to policymakers, ensemble forecasts must have stable performance in the presence of two key characteristics of the component forecasts: (1) occasional misalignment with the reported data, and (2) instability in the relative performance of component forecasters over time. Our results indicate that in the presence of these challenges, an untrained and robust approach to ensembling using an equally weighted median of all component forecasts is a good choice to support public health decision-makers. In settings where some contributing forecasters have a stable record of good performance, trained ensembles that give those forecasters higher weight can also be helpful.     

Social networks and citizen election forecasting: The more friends the better

Most citizens correctly forecast which party will win a given election, and such forecasts usually have a higher level of accuracy than voter intention polls. How do citizens do it? We argue that social networks are a big part of the answer: much of what we know as citizens comes from our interactions with others. Previous research has considered only indirect characteristics of social networks when analyzing why citizens are good forecasters. We use a unique German survey and consider direct measures of social networks in order to explore their role in election forecasting. We find that three network characteristics –  size, political composition, and frequency of political discussion – are among the most important variables when predicting the accuracy of citizens’ election forecasts.     

Estimating the output gap in real time: A factor model approach

By using a dynamic factor model, we can substantially improve the reliability of real-time output gap estimates for the U.S. economy. First, we use a factor model to extract a series for the common component in GDP from a large panel of monthly real-time macroeconomic variables. This series is immune to revisions to the extent that revisions are due to unbiased measurement errors or idiosyncratic news. Second, our model is able to handle the unbalanced arrival of the data. This yields favorable nowcasting properties and thus starting conditions for the filtering of data into a trend and deviations from a trend. Combined with the method of augmenting data with forecasts prior to filtering, this greatly reduces the end-of-sample imprecision in the gap estimate. The increased precision has economic importance for real-time policy decisions and improves real-time inflation forecasts.     

Fiscal Surprises at the FOMC

We examine a new set of U.S. fiscal forecasts from the FOMC briefing books. These forecasts are precisely those that were presented to monetary policymakers, and include frequently-updated estimates covering six complete business cycles and several fiscal-policy regimes. We detail the performances of forecast federal expenditures, revenues, surpluses, and structural surpluses in terms of their accuracy, bias, and efficiency. We find that forecast errors can be large economically, even at relatively short forecast horizons. While economic activity became less volatile after 1990, fiscal policy became harder to forecast. Finally, cyclically-adjusted deficit forecasts appear to be over-optimistic around both peaks and troughs of the business cycle, suggesting that fiscal policy is counter-cyclical in downturns and pro-cyclical in the early stages of recoveries.     

Asset market response to monetary policy news from SNB press releases

This paper analyses the effects of Swiss National Bank (SNB) communication on asset prices. It distinguishes between different monetary policy news contained in press releases following a monetary policy decision. Employing a latent variable approach and event-study methods, I find that medium- and long-term bond yields respond to changes in the communicated inflation and GDP forecasts as well as to the degree of pessimism expressed in press releases. Exchange rates mainly react to changes in the GDP forecast while stocks do not react to SNB communication on monetary policy announcement days. Additionally, short-term expectations about the future path of the policy rate are driven by the communicated inflation forecast. The results underline the role of qualitative news beyond quantitative forecasts in influencing market expectations and asset prices.     

Polls to probabilities: Comparing prediction markets and opinion polls

The forecasting of election outcomes is a hugely popular activity, and not without reason: the outcomes can have significant economic impacts, for example on stock prices. As such, it is economically important, as well as of academic interest, to determine the forecasting methods that have historically performed best. However, the forecasts are often incompatible, as some are in terms of vote shares while others are probabilistic outcome forecasts. This paper sets out an empirical method for transforming opinion poll vote shares into probabilistic forecasts, and then evaluates the performances of prediction markets and opinion polls. We make comparisons along two dimensions, bias and precision, and find that converted opinion polls perform well in terms of bias, while prediction markets are good for precision.     

Least squares learning and the US Treasury bill rate

Understanding how agents formulate their expectations about Fed behavior is important for market participants because they can potentially use this information to make more accurate estimates of stock and bond prices. Although it is commonly assumed that agents learn over time, there is scant empirical evidence in support of this assumption. Thus, in this paper we test if the forecast of the three month T-bill rate in the Survey of Professional Forecasters (SPF) is consistent with least squares learning when there are discrete shifts in monetary policy. We first derive the mean, variance and autocovariances of the forecast errors from a recursive least squares learning algorithm when there are breaks in the structure of the model. We then apply the Bai and Perron (1998) test for structural change to a forecasting model for the three month T-bill rate in order to identify changes in monetary policy. Having identified the policy regimes, we then estimate the implied biases in the interest rate forecasts within each regime. We find that when the forecast errors from the SPF are corrected for the biases due to shifts in policy, the forecasts are consistent with least squares learning.     

Validity of climate change forecasting for public policy decision making

Policymakers need to know whether prediction is possible and, if so, whether any proposed forecasting method will provide forecasts that are substantially more accurate than those from the relevant benchmark method. An inspection of global temperature data suggests that temperature is subject to irregular variations on all relevant time scales, and that variations during the late 1900s were not unusual. In such a situation, a “no change” extrapolation is an appropriate benchmark forecasting method. We used the UK Met Office Hadley Centre’s annual average thermometer data from 1850 through 2007 to examine the performance of the benchmark method. The accuracy of forecasts from the benchmark is such that even perfect forecasts would be unlikely to help policymakers. For example, mean absolute errors for the 20- and 50-year horizons were 0.18  C and 0.24  C respectively. We nevertheless demonstrate the use of benchmarking with the example of the Intergovernmental Panel on Climate Change’s 1992 linear projection of long-term warming at a rate of 0.03  C per year. The small sample of errors from ex ante projections at 0.03  C per year for 1992 through 2008 was practically indistinguishable from the benchmark errors. Validation for long-term forecasting, however, requires a much longer horizon. Again using the IPCC warming rate for our demonstration, we projected the rate successively over a period analogous to that envisaged in their scenario of exponential CO₂ growth—the years 1851 to 1975. The errors from the projections were more than seven times greater than the errors from the benchmark method. Relative errors were larger for longer forecast horizons. Our validation exercise illustrates the importance of determining whether it is possible to obtain forecasts that are more useful than those from a simple benchmark before making expensive policy decisions.     

Can we improve the perceived quality of economic forecasts?

A number of topics are discussed concerning how economic forecasts can be improved in quality or at least in presentation. These include the following: using 50% uncertainty intervals rather than 95%; noting that even though forecasters use many different techniques, they are all occasionally incorrect in the same direction; that there is a tendency to underestimate changes; that some expectations and recently available data are used insufficiently; lagged forecasts errors can help compensate for structural breaks; series that are more forecastable could be emphasized and that present methods of evaluating forecasts do not capture the useful properties of some methods compared to alternatives.     

Evaluating a three-dimensional panel of point forecasts: The Bank of England Survey of External Forecasters

This article provides a first analysis of the forecasts of inflation and GDP growth obtained from the Bank of England's Survey of External Forecasters, considering both the survey average forecasts published in the quarterly Inflation Report, and the individual survey responses, recently made available by the Bank. These comprise a conventional incomplete panel dataset, with an additional dimension arising from the collection of forecasts at several horizons; both point forecasts and density forecasts are collected. The inflation forecasts show good performance in tests of unbiasedness and efficiency, albeit over a relatively calm period for the UK economy, and there is considerable individual heterogeneity. For GDP growth, inaccurate real-time data and their subsequent revisions are seen to cause serious difficulties for forecast construction and evaluation, although the forecasts are again unbiased. There is evidence that some forecasters have asymmetric loss functions.     

Comparison of intraday probabilistic forecasting of solar irradiance using only endogenous data

Accurate solar forecasts are necessary to improve the integration of solar renewables into the energy grid. In recent years, numerous methods have been developed for predicting the solar irradiance or the output of solar renewables. By definition, a forecast is uncertain. Thus, the models developed predict the mean and the associated uncertainty. Comparisons are therefore necessary and useful for assessing the skill and accuracy of these new methods in the field of solar energy.The aim of this paper is to present a comparison of various models that provide probabilistic forecasts of the solar irradiance within a very strict framework. Indeed, we consider focusing on intraday forecasts, with lead times ranging from 1 to 6 h. The models selected use only endogenous inputs for generating the forecasts. In other words, the only inputs of the models are the past solar irradiance data. In this context, the most common way of generating the forecasts is to combine point forecasting methods with probabilistic approaches in order to provide prediction intervals for the solar irradiance forecasts. For this task, we selected from the literature three point forecasting models (recursive autoregressive and moving average (ARMA), coupled autoregressive and dynamical system (CARDS), and neural network (NN)), and seven methods for assessing the distribution of their error (linear model in quantile regression (LMQR), weighted quantile regression (WQR), quantile regression neural network (QRNN), recursive generalized autoregressive conditional heteroskedasticity (GARCHrls), sieve bootstrap (SB), quantile regression forest (QRF), and gradient boosting decision trees (GBDT)), leading to a comparison of 20 combinations of models.None of the model combinations clearly outperform the others; nevertheless, some trends emerge from the comparison. First, the use of the clear sky index ensures the accuracy of the forecasts. This derived parameter permits time series to be deseasonalized with missing data, and is also a good explanatory variable of the distribution of the forecasting errors. Second, regardless of the point forecasting method used, linear models in quantile regression, weighted quantile regression and gradient boosting decision trees are able to forecast the prediction intervals accurately.     

Financial forecasting and risky decisions: an experimental study grounded in Prospect theory

This study employed prospect theory to examine relationships between effort invested in developing financial forecasts and risk taking. Results of an experimental study indicated that the more effort subjects invested in developing forecasts, the more likely they were to use those forecasts as their reference points when evaluating venture performance. Results also indicated that subjects who used forecasts as their reference points and exerted greater effort developing those forecasts were more likely to take risky actions when performance fell below their reference points. This study is the first to link effort to the type of reference point used and the first to link effort and the use of financial forecasts to risky decisions. In addition, it is one of only a few studies to employ prospect theory to examine risk taking decisions subsequent to start-up. Its results enhance our understanding of risk taking, prospect theory and reference points.

     

CONSTRUCTING OPTIMAL DENSITY FORECASTS FROM POINT FORECAST COMBINATIONS

Decision makers often observe point forecasts of the same variable computed, for instance, by commercial banks, IMF and the World Bank, but the econometric models used by such institutions are frequently unknown. This paper shows how to use the information available on point forecasts to compute optimal density forecasts. Our idea builds upon the combination of point forecasts under general loss functions and unknown forecast error distributions. We use real‐time data to forecast the density of US inflation. The results indicate that the proposed method materially improves the real‐time accuracy of density forecasts vis‐à‐vis those from the (unknown) individual econometric models. Copyright © 2013 John Wiley & Sons, Ltd.     

Kernel-based calibration diagnostics for recession and inflation probability forecasts

A probabilistic forecast is the estimated probability with which a future event will occur. One interesting feature of such forecasts is their calibration, or the match between the predicted probabilities and the actual outcome probabilities. Calibration has been evaluated in the past by grouping probability forecasts into discrete categories. We show here that we can do this without discrete groupings; the kernel estimators that we use produce efficiency gains and smooth estimated curves relating the predicted and actual probabilities. We use such estimates to evaluate the empirical evidence on the calibration error in a number of economic applications, including the prediction of recessions and inflation, using both forecasts made and stored in real time and pseudo-forecasts made using the data vintage available at the forecast date. The outcomes are evaluated using both first-release outcome measures and subsequent revised data. We find substantial evidence of incorrect calibration in professional forecasts of recessions and inflation from the SPF, as well as in real-time inflation forecasts from a variety of output gap models.