Use and misuse of information in supply chain forecasting of promotion effects

Demand forecasting is critical to sales and operations planning (S&OP), but the effects of sales promotions can be difficult to forecast. Typically, a baseline statistical forecast is judgmentally adjusted on receipt of information from different departments. However, much of this information either has no predictive value or its value is unknown. Research into base rate discounting has suggested that such information may distract forecasters from the average uplift and reduce accuracy. This has been investigated in situations in which forecasters were able to adjust the statistical forecasts for promotions via a forecasting support system (FSS). In two ecologically valid experiments, forecasters were provided with the mean level of promotion uplift, a baseline statistical forecast, and quantitative and qualitative information. However, the forecasters were distracted from the base rate and misinterpreted the information available to them. These findings have important implications for the design of organizational S&OP processes, and for the implementation of FSSs.     

The tourism forecasting competition

We evaluate the performances of various methods for forecasting tourism data. The data used include 366 monthly series, 427 quarterly series and 518 annual series, all supplied to us by either tourism bodies or academics who had used them in previous tourism forecasting studies. The forecasting methods implemented in the competition are univariate and multivariate time series approaches, and econometric models. This forecasting competition differs from previous competitions in several ways: (i) we concentrate on tourism data only; (ii) we include approaches with explanatory variables; (iii) we evaluate the forecast interval coverage as well as the point forecast accuracy; (iv) we observe the effect of temporal aggregation on the forecasting accuracy; and (v) we consider the mean absolute scaled error as an alternative forecasting accuracy measure. We find that pure time series approaches provide more accurate forecasts for tourism data than models with explanatory variables. For seasonal data we implement three fully automated pure time series algorithms that generate accurate point forecasts, and two of these also produce forecast coverage probabilities which are satisfactorily close to the nominal rates. For annual data we find that Naïve forecasts are hard to beat.     

Macroeconomic forecast accuracy in a data‐rich environment

The performance of six classes of models in forecasting different types of economic series is evaluated in an extensive pseudo out‐of‐sample exercise. One of these forecasting models, regularized data‐rich model averaging (RDRMA), is new in the literature. The findings can be summarized in four points. First, RDRMA is difficult to beat in general and generates the best forecasts for real variables. This performance is attributed to the combination of regularization and model averaging, and it confirms that a smart handling of large data sets can lead to substantial improvements over univariate approaches. Second, the ARMA(1,1) model emerges as the best to forecast inflation changes in the short run, while RDRMA dominates at longer horizons. Third, the returns on the S&P 500 index are predictable by RDRMA at short horizons. Finally, the forecast accuracy and the optimal structure of the forecasting equations are quite unstable over time.     

Simple rules for combining forecasts: Some empirical results

This study is an empirical comparison of three rules for aggregating forecasts. The three combined forecasts evaluated are: a simple average forecast, a median forecast and a focus forecast. These combined forecasts are compared over four economic variables (housing starts, the index of industrial production, the unemployment rate and gross national product) using a set of previously published forecasts. The results indicate that an average forecast will not perform as well as previous studies indicate if all or most of the individual forecasts tend to over- or under-predict simultaneously. The median forecast also seems to be suspect in this case. There is little evidence to suggest that the median forecast is a viable alternative to the mean forecast. Focus forecasting, however, is found to perform well for all four variables. The evidence indicates that focus forecasting is a reasonable alternative to simple averaging.     

Physics-informed Gaussian process regression for states estimation and forecasting in power grids

Real-time state estimation and forecasting are critical for the efficient operation of power grids. In this paper, a physics-informed Gaussian process regression (PhI-GPR) method is presented and used for forecasting and estimating the phase angle, angular speed, and wind mechanical power of a three-generator power grid system using sparse measurements. In standard data-driven Gaussian process regression (GPR), parameterized models for the prior statistics are fit by maximizing the marginal likelihood of observed data. In the PhI-GPR method, we propose to compute the prior statistics offline by solving stochastic differential equations (SDEs) governing the power grid dynamics. The short-term forecast of a power grid system dominated by wind generation is complicated by the stochastic nature of the wind and the resulting uncertainty in wind mechanical power. Here, we assume that the power grid dynamics are governed by swing equations, with the wind mechanical power fluctuating randomly in time. We solve these equations for the mean and covariances of the power grid states using the Monte Carlo simulation method.We demonstrate that the proposed PhI-GPR method can accurately forecast and estimate observed and unobserved states. For the considered problem, PhI-GPR has computational advantages over the ensemble Kalman filter (EnKF) method: In PhI-GPR, ensembles are computed offline and independently of the data acquisition process, whereas for EnFK, ensembles are computed online with data acquisition, rendering real-time forecast more challenging. We also demonstrate that the PhI-GPR forecast is more accurate than the EnKF forecast when the random mechanical wind power is non-Markovian. In contrast, the two methods produce similar forecasts for the Markovian mechanical wind power.For observed states, we show that PhI-GPR provides a forecast comparable to the standard data-driven GPR; both forecasts are significantly more accurate than the autoregressive integrated moving average (ARIMA) forecast. We also show that the ARIMA forecast is more sensitive to observation frequency and measurement errors than the PhI-GPR forecast.     

Intercept corrections and structural change

Analyses of forecasting that assume a constant, time-invariant data generating process (DGP), and so implicitly rule out structural change or regime shifts in the economy, ignore an aspect of the real world responsible for some of the more dramatic historical episodes of predictive failure. Some models may offer greater protection against unforeseen structural breaks than others, and various tricks may be employed to robustify forecasts to change. We show that in certain states of nature, vector autoregressions in the differences of the variables (in the spirit of Box-Jenkins time-series modelling), can outperform vector ‘equilibrium-correction’ mechanisms. However, appropriate intercept corrections can enhance the performance of the latter, albeit that reductions in forecast bias may only be achieved at the cost of inflated forecast error variances.     

Selecting a Nonlinear Time Series Model using Weighted Tests of Equal Forecast Accuracy*

Nonlinear time series models have become fashionable tools to describe and forecast a variety of economic time series. A closer look at reported empirical studies, however, reveals that these models apparently fit well in‐sample, but rarely show a substantial improvement in out‐of‐sample forecasts, at least over linear models. One of the many possible reasons for this finding is the use of inappropriate model selection criteria and forecast evaluation criteria. In this paper we therefore propose a novel criterion, which we believe does more justice to the very nature of nonlinear models. Simulations show that this criterion outperforms those criteria currently in use, in the sense that the true nonlinear model is more often found to perform better in out‐of‐sample forecasting than a benchmark linear model. An empirical illustration for US GDP emphasizes its relevance.     

区间时间序列预测准确度探讨

区间时间序列在决策过程中提供重要的信息,特别是在经济发展、人口政策、规划管理或金融监管等方面,因此如何计算出预测区间的精确度成为一个重要议题。本文提出两种区间预测准确度分析的方法,通过估计预测结果的平均区间误差平方和及平均相对区间误差和,比较不同预测方法的优劣。并由预测区间与实际区间的重叠位置,充分说明预测方法所具有的有效性。这些分析预测区间准确度的方法,将为管理者提供更客观的决策空间。     

Design and development of inventory knowledge discovery system

Inventory management (IM) performance is affected by the forecasting accuracy of both demand and supply. In this paper, an inventory knowledge discovery system (IKDS) is designed and developed to forecast and acquire knowledge among variables for demand forecasting. In IKDS, the TREes PArroting Networks (TREPAN) algorithm is used to extract knowledge from trained networks in the form of decision trees which can be used to understand previously unknown relationships between the input variables so as to improve the forecasting performance for IM. The experimental results show that the forecasting accuracy using TREPAN is superior to traditional methods like moving average and autoregressive integrated moving average. In addition, the knowledge extracted from IKDS is represented in a comprehensible way and can be used to facilitate human decision-making.     

A combined random effect and fixed effect forecast for panel data models

When some of the regressors in a panel data model are correlated with the random individual effects, the random effect (RE) estimator becomes inconsistent while the fixed effect (FE) estimator is consistent. Depending on the various degree of such correlation, we can combine the RE estimator and FE estimator to form a combined estimator which can be better than each of the FE and RE estimators. In this paper, we are interested in whether the combined estimator may be used to form a combined forecast to improve upon the RE forecast (forecast made using the RE estimator) and the FE forecast (forecast using the FE estimator) in out-of-sample forecasting. Our simulation experiment shows that the combined forecast does dominate the FE forecast for all degrees of endogeneity in terms of mean squared forecast errors (MSFE), demonstrating that the theoretical results of the risk dominance for the in-sample estimation carry over to the out-of-sample forecasting. It also shows that the combined forecast can reduce MSFE relative to the RE forecast for moderate to large degrees of endogeneity and for large degrees of heterogeneity in individual effects.     

Spotting the Danger Zone: Forecasting Financial Crises With Classification Tree Ensembles and Many Predictors

This paper introduces classification tree ensembles (CTEs) to the banking crisis forecasting literature. I show that CTEs substantially improve out‐of‐sample forecasting performance over best‐practice early‐warning systems. CTEs enable policymakers to correctly forecast 80% of crises with a 20% probability of incorrectly forecasting a crisis. These findings are based on a long‐run sample (1870–2011), and two broad post‐1970 samples which together cover almost all known systemic banking crises. I show that the marked improvement in forecasting performance results from the combination of many classification trees into an ensemble, and the use of many predictors. Copyright © 2016 John Wiley & Sons, Ltd.     

Data visualization and forecast combination for probabilistic load forecasting in GEFCom2017 final match

This paper describes the methods used by Team Cassandra, a joint effort between IBM Research Australia and the University of Melbourne, in the GEFCom2017 load forecasting competition. An important first phase in the forecasting effort involved a deep exploration of the underlying dataset. Several data visualisation techniques were applied to help us better understand the nature and size of gaps, outliers, the relationships between different entities in the dataset, and the relevance of custom date ranges. Improved, cleaned data were then used to train multiple probabilistic forecasting models. These included a number of standard and well-known approaches, as well as a neural-network based quantile forecast model that was developed specifically for this dataset. Finally, model selection and forecast combination were used to choose a custom forecasting model for every entity in the dataset.     

Anticipating special events in Emergency Department forecasting

Accurate daily forecast of Emergency Department (ED) attendance helps roster planners in allocating available resources more effectively and potentially influences staffing. Since special events affect human behaviours, they may increase or decrease the demand for ED services. Therefore, it is crucial to model their impact and use them to forecast future attendance to improve roster planning and avoid reactive strategies. In this paper, we propose, for the first time, a forecasting model to generate both point and probabilistic daily forecast of ED attendance. We model the impact of special events on ED attendance by considering real-life ED data. We benchmark the accuracy of our model against three time-series techniques and a regression model that does not consider special events. We show that the proposed model outperforms its benchmarks across all horizons for both point and probabilistic forecasts. Results also show that our model is more robust with an increasing forecasting horizon. Moreover, we provide evidence on how different types of special events may increase or decrease ED attendance. Our model can easily be adapted for use not only by EDs but also by other health services. It could also be generalised to include more types of special events.     

Forecasting welfare caseloads: The case of the Japanese public assistance program

Forecasting welfare caseloads has grown in importance in Japan because of their recent rapid increase. Given that the forecasting literature on welfare caseloads only focuses on US cases and utilizes limited classes of forecasting models, this study employs multiple alternative methods in order to forecast Japanese welfare caseloads and compare forecasting performances. In pseudo real-time forecasting, VAR and forecast combinations tend to outperform the other methods investigated. In real-time forecasting, however, a simple version of forecast combinations seems to perform better than the remaining models, predicting that welfare caseloads in Japan will surpass 1.7 million by the beginning of 2016, an approximately 20% increase in five years from the beginning of 2011.     

The asymmetry of judgemental confidence intervals in time series forecasting

In forecasting a time series, one may be asked to communicate the likely distribution of the future actual value, often expressed as a confidence interval. Whilst the accuracy (calibration) of these intervals has dominated most studies to date, this paper is concerned with other possible characteristics of the intervals. It reports a study in which the prevalence and determinants of the symmetry of judgemental confidence intervals in time series forecasting was examined. Most prior work has assumed that this interval is symmetrically placed around the forecast. However, this study shows that people generally estimate asymmetric confidence intervals where the forecast is not the midpoint of the estimated interval. Many of these intervals are grossly asymmetric. Results indicate that the placement of the forecast in relation to the last actual value of a time series is a major determinant of the direction and size of the asymmetry.     

Recent advances in intra-hour solar forecasting: A review of ground-based sky image methods

As the penetration of solar energy generation into power systems keeps rising, intra-hour solar forecasting (IHSF) is becoming increasingly important for the secure and economical operation of a power system. One major difficulty in providing very accurate IHSF emanates from rapid cloud changes in the sky. The ground-based sky image (GSI) provides the intuitive information of intra-hour cloud changes and has thus been widely utilized in studies on IHSF. This paper presents a systematic review of the state-of-the-art of ground-based sky image-based intra-hour solar forecasting (GSI-IHSF). To our knowledge, we first propose a generic framework of GSI-IHSF consisting of four modules, i.e., sky image acquisition, sky image preprocessing, cloud forecasting, and solar forecasting. Then, as for each module, this paper introduces its core function, shows the major challenges, briefly reviews several extensively used techniques, summarizing research trends. Finally, this paper offers a prospect of GSI-IHSF research, discusses recent advances that demonstrate the potential for a great improvement in forecast accuracy, pointing out some new requirements and challenges that should be further investigated in the future.     

组合负荷预测方法综述

电力系统负荷具有很多不确定因素,针对单一模型进行负荷预测时,预测精度不高这一问题,可采用组合预测法将多种预测方法所得的预测值进行加权平均而得到最终预测结果,以满足现代电力对负荷预测结果的准确性、快速性和智能化的要求。该文首先简要介绍了几种常用的负荷预测方法,接着详细介绍了组合负荷预测的研究现状及确定组合预测中各模型最优权重的几种方法,最后介绍了组合负荷预测模型的误差修正方法,对提高负荷预测的准确性有一定的现实意义。     

New Methods for Forecasting Inflation,Applied to the US*

Models for the 12‐month‐ahead US rate of inflation, measured by the chain‐weighted consumer expenditure deflator, are estimated for 1974–98 and subsequent pseudo out‐of‐sample forecasting performance is examined. Alternative forecasting approaches for different information sets are compared with benchmark univariate autoregressive models, and substantial out‐performance is demonstrated including against Stock and Watson's unobserved components‐stochastic volatility model. Three key ingredients to the out‐performance are: including equilibrium correction component terms in relative prices; introducing nonlinearities to proxy state‐dependence in the inflation process and replacing the information criterion, commonly used in VARs to select lag length, with a ‘parsimonious longer lags’ parameterization. Forecast pooling or averaging also improves forecast performance.     

Volatility forecasting in the Bitcoin market: A new proposed measure based on the VS-ACARR approach

This paper proposes a new volatility-spillover-asymmetric conditional autoregressive range (VS-ACARR) approach that takes into account the intraday information, the volatility spillover from crude oil as well as the volatility asymmetry (leverage effect) to model/forecast Bitcoin volatility (price range). An empirical application to Bitcoin and crude oil (WTI) price ranges shows the existence of strong volatility spillover from crude oil to the Bitcoin market and a weak leverage effect in the Bitcoin market. The VS-ACARR model yields higher forecasting accuracy than the GARCH, CARR, and VS-CARR models regarding out-of-sample forecast performance, suggesting that accounting for the volatility spillover and asymmetry can significantly improve the forecasting accuracy of Bitcoin volatility. The superior forecast performance of the VS-ACARR model is robust to alternative out-of-sample forecast windows. Our findings highlight the importance of accommodating intraday information, spillover from crude oil, and volatility asymmetry in forecasting Bitcoin volatility.     

Adaptive forecasting in the presence of recent and ongoing structural change

We consider time series forecasting in the presence of ongoing structural change where both the time series dependence and the nature of the structural change are unknown. Methods that downweight older data, such as rolling regressions, forecast averaging over different windows and exponentially weighted moving averages, known to be robust to historical structural change, are found also to be useful in the presence of ongoing structural change in the forecast period. A crucial issue is how to select the degree of downweighting, usually defined by an arbitrary tuning parameter. We make this choice data-dependent by minimising the forecast mean square error, and provide a detailed theoretical analysis of our proposal. Monte Carlo results illustrate the methods. We examine their performance on 97 US macro series. Forecasts using data-based tuning of the data discount rate are shown to perform well.