Forecasting bulk prices of Bordeaux wines using leading indicators

Agricultural price forecasting has been being abandoned progressively by researchers ever since the development of large-scale agricultural futures markets. However, as with many other agricultural goods, there is no futures market for wine. This paper draws on the agricultural prices forecasting literature to develop a forecasting model for bulk wine prices. The price data include annual and monthly series for various wine types that are produced in the Bordeaux region. The predictors include several leading economic indicators of supply and demand shifts. The stock levels and quantities produced are found to have the highest predictive power. The preferred annual and monthly forecasting models outperform naive random walk forecasts by 27.1% and 3.4% respectively; their mean absolute percentage errors are 2.7% and 3.4% respectively. A simple trading strategy based on monthly forecasts is estimated to increase profits by 3.3% relative to a blind strategy that consists of always selling at the spot price.     

Probabilistic electricity price forecasting with NARX networks: Combine point or probabilistic forecasts?

Recent electricity price forecasting studies have shown that decomposing a series of spot prices into a long-term trend-seasonal and a stochastic component, modeling them independently and then combining their forecasts, can yield more accurate point predictions than an approach in which the same regression or neural network model is calibrated to the prices themselves. Here, considering two novel extensions of this concept to probabilistic forecasting, we find that (i) efficiently calibrated non-linear autoregressive with exogenous variables (NARX) networks can outperform their autoregressive counterparts, even without combining forecasts from many runs, and that (ii) in terms of accuracy it is better to construct probabilistic forecasts directly from point predictions. However, if speed is a critical issue, running quantile regression on combined point forecasts (i.e., committee machines) may be an option worth considering. Finally, we confirm an earlier observation that averaging probabilities outperforms averaging quantiles when combining predictive distributions in electricity price forecasting.     

The tourism forecasting competition

We evaluate the performances of various methods for forecasting tourism data. The data used include 366 monthly series, 427 quarterly series and 518 annual series, all supplied to us by either tourism bodies or academics who had used them in previous tourism forecasting studies. The forecasting methods implemented in the competition are univariate and multivariate time series approaches, and econometric models. This forecasting competition differs from previous competitions in several ways: (i) we concentrate on tourism data only; (ii) we include approaches with explanatory variables; (iii) we evaluate the forecast interval coverage as well as the point forecast accuracy; (iv) we observe the effect of temporal aggregation on the forecasting accuracy; and (v) we consider the mean absolute scaled error as an alternative forecasting accuracy measure. We find that pure time series approaches provide more accurate forecasts for tourism data than models with explanatory variables. For seasonal data we implement three fully automated pure time series algorithms that generate accurate point forecasts, and two of these also produce forecast coverage probabilities which are satisfactorily close to the nominal rates. For annual data we find that Naïve forecasts are hard to beat.     

The Predictive Ability of Geographic Segment Information at the Country, Continent, and Consolidated Levels

This study examines whether geographic information disclosed at an increasingly disaggregated level (specifically, consolidated vs. continent vs. country) results in increased predictive ability of company operations (specifically, sales, gross profit, and earnings). Multinational corporations (MNCs) are formed using a simulated merger approach by combining the annual operating results of six individual firms, one from each of six countries. This approach makes it possible to compare the forecasting accuracy of data disclosed at the country, continent, and consolidated levels, not possible using current geographic segment disclosures. Previous studies using year-ahead forecast models implicitly assume the predictive factors included in the models are significant in forecasting operating results. Using regression forecast models, this study tests whether the predictive factors included in the models are effective in forecasting operating results by examining the direction, size, and significance of the regression coefficient estimates. The coefficients provide evidence that exchange rate changes, inflation, and real GNP growth are useful in forecasting annual sales and gross profit. Whereas, at least for this sample and this time period, exchange rate changes, inflation, and real GNP growth are not significant variables in forecasting annual earnings. The results indicate that the accuracy of forecasts increase as sales and gross profit are disclosed at a more disaggregated geographic level. The hypothesized relationship between consolidated, continent, and country levels, while holding strongly under perfect foresight, holds to a lesser extent using forecasts of exchange rates, inflation, and real GNP.     

Regional heterogeneity and U.S. presidential elections: Real-time 2020 forecasts and evaluation

This paper exploits cross-sectional variation at the level of U.S. counties to generate real-time forecasts for the 2020 U.S. presidential election. The forecasting models are trained on data covering the period 2000–2016, using high-dimensional variable selection techniques. Our county-based approach contrasts the literature that focuses on national and state level data but uses longer time periods to train their models. The paper reports forecasts of popular and electoral college vote outcomes and provides a detailed ex-post evaluation of the forecasts released in real time before the election. It is shown that all of these forecasts outperform autoregressive benchmarks. A pooled national model using One-Covariate-at-a-time-Multiple-Testing (OCMT) variable selection significantly outperformed all models in forecasting the U.S. mainland national vote share and electoral college outcomes (forecasting 236 electoral votes for the Republican party compared to 232 realized). This paper also shows that key determinants of voting outcomes at the county level include incumbency effects, unemployment, poverty, educational attainment, house price changes, and international competitiveness. The results are also supportive of myopic voting: economic fluctuations realized a few months before the election tend to be more powerful predictors of voting outcomes than their long-horizon analogs.     

On the forecasting performance of a small-scale DSGE model

Dynamic stochastic general equilibrium (DSGE) models have recently become standard tools for policy analysis. Nevertheless, their forecasting properties have still barely been explored. In this article, we address this problem by examining the quality of forecasts of the key U.S. economic variables: the three-month Treasury bill yield, the GDP growth rate and GDP price index inflation, from a small-size DSGE model, trivariate vector autoregression (VAR) models and the Philadelphia Fed Survey of Professional Forecasters (SPF). The ex post forecast errors are evaluated on the basis of the data from the period 1994–2006. We apply the Philadelphia Fed “Real-Time Data Set for Macroeconomists” to ensure that the data used in estimating the DSGE and VAR models was comparable to the information available to the SPF.Overall, the results are mixed. When comparing the root mean squared errors for some forecast horizons, it appears that the DSGE model outperforms the other methods in forecasting the GDP growth rate. However, this characteristic turned out to be statistically insignificant. Most of the SPF's forecasts of GDP price index inflation and the short-term interest rate are better than those from the DSGE and VAR models.     

FRED-SD: A real-time database for state-level data with forecasting applications

We construct a real-time dataset (FRED-SD) with vintage data for the U.S. states that can be used to forecast both state-level and national-level variables. Our dataset includes approximately 28 variables per state, including labor-market, production, and housing variables. We conduct two sets of real-time forecasting exercises. The first forecasts state-level labor-market variables using five different models and different levels of industrially disaggregated data. The second forecasts a national-level variable exploiting the cross-section of state data. The state-forecasting experiments suggest that large models with industrially disaggregated data tend to have higher predictive ability for industrially diversified states. For national-level data, we find that forecasting and aggregating state-level data can outperform a random walk but not an autoregression. We compare these real-time data experiments with forecasting experiments using final-vintage data and find very different results. Because these final-vintage results are obtained with revised data that would not have been available at the time the forecasts would have been made, we conclude that the use of real-time data is essential for drawing proper conclusions about state-level forecasting models.     

Predictions of annual earnings using quarterly earnings,annual earnings and dividend payout ratios

This study empirically examines two issues related to forecasting annual accounting earnings. The first issue studied is the improvement in forecasts of annual earnings that can be obtained by including information about dividend payout along with the past earnings series in forecasting models. The second issue deals with the comparative ability of quarterly earnings time series models and annual earnings time series models to predict annual earnings. The results of this study indicate that considerable improvement in predictive ability can be obtained by expanding the information set to include the dividend payout ratio series. The empirical analysis also indicates that time series models developed using annual earnings generate more accurate predictions of annual earnings than do models developed using quarterly earnings.     

Text-based crude oil price forecasting: A deep learning approach

This study proposes a new, novel crude oil price forecasting method based on online media text mining, with the aim of capturing the more immediate market antecedents of price fluctuations. Specifically, this is an early attempt to apply deep learning techniques to crude oil forecasting, and to extract hidden patterns within online news media using a convolutional neural network (CNN). While the news-text sentiment features and the features extracted by the CNN model reveal significant relationships with the price change, they need to be grouped according to their topics in the price forecasting in order to obtain a greater forecasting accuracy. This study further proposes a feature grouping method based on the Latent Dirichlet Allocation (LDA) topic model for distinguishing effects from various online news topics. Optimized input variable combination is constructed using lag order selection and feature selection methods. Our empirical results suggest that the proposed topic-sentiment synthesis forecasting models perform better than the older benchmark models. In addition, text features and financial features are shown to be complementary in producing more accurate crude oil price forecasts.     

Forecasting sales response for multiple time horizons and temporally aggregated data: A comparison of constant and stochastic coefficient models

Past research on time-varying sales-response models emphasized the application of different estimation techniques in examining variation in advertising effectiveness over time. This study focuses on comparing sales forecasts using constant and stochastic coefficients sales-response models. Selected constant and stochastic coefficient models are applied to six sets of bimonthly and one set of annual advertising and sales data to assess forecasting accuracy for time horizons of various lengths. Results show improved forecasting accuracy for a first-order autoregressive stochastic coefficient model, particularly in short-run forecasting applications.     

Forecasting football match results in national league competitions using score-driven time series models

We develop a new dynamic multivariate model for the analysis and forecasting of football match results in national league competitions. The proposed dynamic model is based on the score of the predictive observation mass function for a high-dimensional panel of weekly match results. Our main interest is in forecasting whether the match result is a win, a loss or a draw for each team. The dynamic model for delivering such forecasts can be based on three different dependent variables: the pairwise count of the number of goals, the difference between the numbers of goals, or the category of the match result (win, loss, draw). The different dependent variables require different distributional assumptions. Furthermore, different dynamic model specifications can be considered for generating the forecasts. We investigate empirically which dependent variable and which dynamic model specification yield the best forecasting results. We validate the precision of the resulting forecasts and the success of the forecasts in a betting simulation in an extensive forecasting study for match results from six large European football competitions. Finally, we conclude that the dynamic model for pairwise counts delivers the most precise forecasts while the dynamic model for the difference between counts is most successful for betting, but that both outperform benchmark and other competing models.     

Differencing versus nondifferencing in factor-based forecasting

This paper studies performance of factor-based forecasts using differenced and nondifferenced data. Approximate variances of forecasting errors from the two forecasts are derived and compared. It is reported that the forecast using nondifferenced data tends to be more accurate than that using differenced data. This paper conducts simulations to compare root mean squared forecasting errors of the two competing forecasts. Simulation results indicate that forecasting using nondifferenced data performs better. The advantage of using nondifferenced data is more pronounced when a forecasting horizon is long and the number of factors is large. This paper applies the two competing forecasting methods to 68 I(1) monthly US macroeconomic variables across a range of forecasting horizons and sampling periods. We also provide detailed forecasting analysis on US inflation and industrial production. We find that forecasts using nondifferenced data tend to outperform those using differenced data.     

A new approach to estimating earnings forecasting models: Robust regression MM-estimation

This study focuses on the impact of model estimation methods on earnings forecast accuracy. Compared with an ordinary least squares (OLS) regression combined with winsorization, robust regression MM-estimation improves the earnings forecast accuracy of all the models examined, especially for those with more variables. My findings indicate that the impact of outliers on the OLS regression increases with the number of variables in the models, alerting researchers who use OLS regressions for forecasting. My findings explain the puzzling negative relationship between earnings forecast accuracy and the number of model variables in prior research. Moreover, I demonstrate the valuation implications of earnings forecasted using robust regression MM-estimation. This study contributes to earnings forecasting, valuation, and influential observation treatment in forecasting.     

Evaluating quantile-bounded and expectile-bounded interval forecasts

In many different contexts, decision-making is improved by the availability of probabilistic predictions. The accuracy of probabilistic forecasting methods can be compared using scoring functions and insight provided by calibration tests. These tests evaluate the consistency of predictions with the observations. Our main agenda in this paper is interval forecasts and their evaluation. Such forecasts are usually bounded by two quantile forecasts. However, a limitation of quantiles is that they convey no information regarding the size of potential exceedances. By contrast, the location of an expectile is dictated by the whole distribution. This prompts us to propose expectile-bounded intervals. We provide interpretation, a consistent scoring function and a calibration test. Before doing this, we reflect on the evaluation of forecasts of quantile-bounded intervals and expectiles, and suggest extensions of previously proposed calibration tests in order to guard against strategic forecasting. We illustrate ideas using day-ahead electricity price forecasting.     

States of psychological anchors and price behavior of Japanese yen futures

This study explores whether the relationship between Japanese yen futures returns and the corresponding equity returns is affected by the states of psychological anchors of the currency and stock markets. This study employs the linear-regression-based tree model (a machine learning method) to account for the framing effect of the anchors. The empirical results of the linear-regression-based tree model show that the currency price behaviors of momentum and reversal, and prediction by equity markets, vary with the anchors. Empirical evidence also indicates that the linear-regression-based tree model outperforms the OLS model based on the estimation results and out-of-sample forecasting. The forecasting performance of the linear-regression-based tree model can be improved along with an increase in the forecasting period.     

Seasonal exponential smoothing with damped trends : An application for production planning

This paper reviews a spreadsheet-based forecasting approach which a process industry manufacturer developed and implemented to link annual corporate forecasts with its manufacturing/distribution operations. First, we consider how this forecasting system supports overall production planning and why it must be compatible with corporate forecasts. We then review the results of substantial testing of variations on the Winters three-parameter exponential smoothing model on 28 actual product family time series. In particular, we evaluate whether the use of damping parameters improves forecast accuracy. The paper concludes that a Winters four-parameter model (i.e. the standard Winters three-parameter model augmented by a fourth parameter to damp the trend) provides the most accurate forecasts of the models evaluated. Our application confirms the fact that there are situations where the use of damped trend parameters in short-run exponential smoothing based forecasting models is beneficial.     

A note on forecasting international tourism demand in Spain

This paper considers the extent to which price and income proxy variables help in forecasting tourist demand in Spain. Contrary to some recent studies, we found that the inputs' contribution in terms of fitting and forecasting is nil when compared with alternative univariate models. Whether these findings are the results of the restrictions embedded in building the proxy inputs or in a poor specification of the dynamics of these models remains to be seen. We also contend that when dealing with medium, long-term forecasting comparisons, the use of the traditional aggregate accuracy measures like RMSE and MAPE help very little in discriminating among competing models. In these situations, predicted annual growth rates may be a better alternative.     

Simple rules for combining forecasts: Some empirical results

This study is an empirical comparison of three rules for aggregating forecasts. The three combined forecasts evaluated are: a simple average forecast, a median forecast and a focus forecast. These combined forecasts are compared over four economic variables (housing starts, the index of industrial production, the unemployment rate and gross national product) using a set of previously published forecasts. The results indicate that an average forecast will not perform as well as previous studies indicate if all or most of the individual forecasts tend to over- or under-predict simultaneously. The median forecast also seems to be suspect in this case. There is little evidence to suggest that the median forecast is a viable alternative to the mean forecast. Focus forecasting, however, is found to perform well for all four variables. The evidence indicates that focus forecasting is a reasonable alternative to simple averaging.     

Managerial evaluation of exogenous forecast sources

This paper concerns the managerial evaluation of forecast vendors—individuals or firms offering for sale future forecasts of random variables relevant to managerial decision making. Assuming the forecasts are exogenous in the sense they are generated by a methodology unknown or unproven to management, the paper uses a logistic regression model to present a statistical test for informativeness that allows for an interpretation of the vendor's abilities. The advantage of the approach is that it requires as input only knowledge of the unconditional probability distribution of the variable being forecast and a relatively small historical track record of the vendor's forecasting performance. No benchmark forecast is necessary and few assumptions are required about the statistical process that generates the forecasts. As an illustrative empirical application, the paper presents an evaluation of the informativeness of the published long-range price forecasts by a veteran analyst of the Iowa hog market.     

Analysts' Forecasts of German Firms' Earnings: a Comparative Analysis

This paper examines analysts' forecasts of the annual earnings per share of German firms over the period of February 1987 to December 1995. The German case is particularly interesting as the accounting and institutional structures vary from those in more thoroughly researched markets such as the U.S. or U.K. The paper therefore considers the features of the German forecasting environment which distinguish it from the Anglo-American model, and whether these might be reflected in forecasting performance. The results for Germany show that the accuracy of analysts' forecasts improves as the forecast horizon shortens, are less accurate than a naive prediction model over longer horizons, and contain a positive bias. When the results for Germany are contrasted with the results for the U.K., as reported in a recent paper, they are found to be a little less accurate but the positive bias is greater in U.K. forecasts. Taken overall the forecasting process in Germany appears to be less efficient than in the U.K., but this may be due to the distinct features of the German forecasting environment.