Forecasting Macroeconomic Labour Market Flows: What Can We Learn from Micro‐level Analysis?

Forecasting labour market flows is important for budgeting and decision‐making in government departments and public administration. Macroeconomic forecasts are normally obtained from time series data. In this article, we follow another approach that uses individual‐level statistical analysis to predict the number of exits out of unemployment insurance claims. We present a comparative study of econometric, actuarial and statistical methodologies that base on different data structures. The results with records of the German unemployment insurance suggest that prediction based on individual‐level statistical duration analysis constitutes an interesting alternative to aggregate data‐based forecasting. In particular, forecasts of up to six months ahead are surprisingly precise and are found to be more precise than considered time series forecasts.     

LoMEF: A framework to produce local explanations for global model time series forecasts

Global forecasting models (GFMs) that are trained across a set of multiple time series have shown superior results in many forecasting competitions and real-world applications compared with univariate forecasting approaches. One aspect of the popularity of statistical forecasting models such as ETS and ARIMA is their relative simplicity and interpretability (in terms of relevant lags, trend, seasonality, and other attributes), while GFMs typically lack interpretability, especially relating to particular time series. This reduces the trust and confidence of stakeholders when making decisions based on the forecasts without being able to understand the predictions. To mitigate this problem, we propose a novel local model-agnostic interpretability approach to explain the forecasts from GFMs. We train simpler univariate surrogate models that are considered interpretable (e.g., ETS) on the predictions of the GFM on samples within a neighbourhood that we obtain through bootstrapping, or straightforwardly as the one-step-ahead global black-box model forecasts of the time series which needs to be explained. After, we evaluate the explanations for the forecasts of the global models in both qualitative and quantitative aspects such as accuracy, fidelity, stability, and comprehensibility, and are able to show the benefits of our approach.     

GMDH网络在短期负荷预测中的应用

文章提出基于自组织方法的GMDH(Group Method of Data Handling)型神经网络并将它应用于短期负荷预测.与一般的前馈神经网络不同,GMDH网络的结构确定于训练过程之中,因而可大大提高神经网络性能.它能充分、合理地利用数据,自动进行变量组合,筛选及判断从而得到合适的模型,特别适用于数据预测.将这种用自组织方法所构成的GMDH型神经网络应用于广西某地区电力局的短期负荷预测,采用Matlab6.5进行仿真实验,证明其在短期负荷预测方面有很好的应用前景.     

GMDH网络在短期负荷预测中的应用

文章提出基于自组织方法的GMDH（Group Method of Data Halldlin亩型神经网络并将它应用于短期负荷预测。与一般的前馈神经网络不同,GMDH网络的结构确定于训练过程之中,因而可大大提高神经网络性能。它能充分、合理地利用数据,自动进行变量组合,筛选及判断从而得到合适的模型,特别适用于数据预测。将这种用自组织方法所构成的GMDH型神经网络应用于广西某地区电力局的短期负荷预测,采用Matlab6．5进行仿真实验,证明其在短期负荷预测方面有很好的应用前景。     

Forecasting from time series subject to sporadic perturbations: Effectiveness of different types of forecasting support

How effective are different approaches for the provision of forecasting support? Forecasts may be either unaided or made with the help of statistical forecasts. In practice, the latter are often crude forecasts that do not take sporadic perturbations into account. Most research considers forecasts based on series that have been cleansed of perturbation effects. This paper considers an experiment in which people made forecasts from time series that were disturbed by promotions. In all conditions, under-forecasting occurred during promotional periods and over-forecasting during normal ones. The relative sizes of these effects depended on the proportions of periods in the data series that contained promotions. The statistical forecasts improved the forecasting accuracy, not because they reduced these biases, but because they decreased the random error (scatter). The performance improvement did not depend on whether the forecasts were based on cleansed series. Thus, the effort invested in producing cleansed time series from which to forecast may not be warranted: companies may benefit from giving their forecasters even crude statistical forecasts. In a second experiment, forecasters received optimal statistical forecasts that took the effects of promotions into account fully. This increased the accuracy because the biases were almost eliminated and the random error was reduced by 20%. Thus, the additional effort required to produce forecasts that take promotional effects into account is worthwhile.     

Sensitivity to autocorrelation in judgmental time series forecasting

How well can people use autocorrelation information when making judgmental forecasts? In Experiment 1, participants forecast from 12 series in which the autocorrelation varied within subjects. The participants showed a sensitivity to the degree of autocorrelation. However, their forecasts indicated that they implicitly assumed positive autocorrelation in uncorrelated time series. Experiments 2 and 2a used a one-shot single-trial between-subjects design and obtained similar results. Experiment 3 investigated the way in which the between-trials context influenced forecasting. The results showed that forecasts are affected by the characteristics of previous series, as well as those of the series from which forecasts are to be made. Our findings can be accommodated within an adaptive approach. Forecasters base their initial expectations of series characteristics on their past experience and modify these expectations in a pseudo-Bayesian manner on the basis of their analysis of those characteristics in the series to be forecast.     

fETSmcs: Feature-based ETS model component selection

The well-developed ETS (ExponenTial Smoothing, or Error, Trend, Seasonality) method incorporates a family of exponential smoothing models in state space representation and is widely used for automatic forecasting. The existing ETS method uses information criteria for model selection by choosing an optimal model with the smallest information criterion among all models fitted to a given time series. The ETS method under such a model selection scheme suffers from computational complexity when applied to large-scale time series data. To tackle this issue, we propose an efficient approach to ETS model selection by training classifiers on simulated data to predict appropriate model component forms for a given time series. We provide a simulation study to show the model selection ability of the proposed approach on simulated data. We evaluate our approach on the widely used M4 forecasting competition dataset in terms of both point forecasts and prediction intervals. To demonstrate the practical value of our method, we showcase the performance improvements from our approach on a monthly hospital dataset.     

An accurate and fully-automated ensemble model for weekly time series forecasting

Many businesses and industries require accurate forecasts for weekly time series nowadays. However, the forecasting literature does not currently provide easy-to-use, automatic, reproducible and accurate approaches dedicated to this task. We propose a forecasting method in this domain to fill this gap, leveraging state-of-the-art forecasting techniques, such as forecast combination, meta-learning, and global modelling. We consider different meta-learning architectures, algorithms, and base model pools. Based on all considered model variants, we propose to use a stacking approach with lasso regression which optimally combines the forecasts of four base models: a global Recurrent Neural Network (RNN) model, Theta, Trigonometric Box–Cox ARMA Trend Seasonal (TBATS), and Dynamic Harmonic Regression ARIMA (DHR-ARIMA), as it shows the overall best performance across seven experimental weekly datasets on four evaluation metrics. Our proposed method also consistently outperforms a set of benchmarks and state-of-the-art weekly forecasting models by a considerable margin with statistical significance. Our method can produce the most accurate forecasts, in terms of mean sMAPE, for the M4 weekly dataset among all benchmarks and all original competition participants.     

Automatic feature identification and graphical support in rule-based forecasting: a comparison

We examined automatic feature identification and graphical support in rule-based expert systems for forecasting. The rule-based expert forecasting system (RBEFS) includes predefined rules to automatically identify features of a time series and selects the extrapolation method to be used. The system can also integrate managerial judgment using a graphical interface that allows a user to view alternate extrapolation methods two at a time. The use of the RBEFS led to a significant improvement in accuracy compared to equal-weight combinations of forecasts. Further improvement were achieved with the user interface. For 6-year ahead ex ante forecasts, the rule-based expert forecasting system has a median absolute percentage error (MdAPE) 15% less than that of equally weighted combined forecasts and a 33% improvement over the random walk. The user adjusted forecasts had a MdAPE 20% less than that of the expert system. The results of the system are also compared to those of an earlier rule-based expert system which required human judgments about some features of the time series data. The results of the comparison of the two rule-based expert systems showed no significant differences between them.     

A comparison of extrapolation models on yearly sales forecasts

This study compares the performance of seven extrapolation models and three combinations of models on nearly 1,500 forecasts of annual, unit sales series. The focus is on two important issues — the identification of those instances when forecasting with extrapolation models is likely to be successful (irrespective of the model selected), and which extrapolation approaches offer the greatest potential. This study replicates many of the finding of the M-competition. It also adds some new evidence. For example, Gardner's dampened smoothing was found to perform especially well on the series tested. Also, extrapolation forecasts of durable good series and ‘mature’ product categories were rarely superior to forecasts made using a simple random-walk model.     

Forecast combinations under structural break uncertainty

This paper proposes two new weighting schemes that average forecasts based on different estimation windows in order to account for possible structural change. The first scheme weights the forecasts according to the values of reversed ordered CUSUM (ROC) test statistics, while the second weighting method simply assigns heavier weights to forecasts that use more recent information. Simulation results show that, when structural breaks are present, forecasts based on the first weighting scheme outperform those based on a procedure that simply uses ROC tests to choose and forecast from a single post-break estimation window. Combination forecasts based on our second weighting scheme outperform equally weighted combination forecasts. An empirical application based on a NAIRU Phillips curve model for the G7 countries illustrates these findings, and also shows that combination forecasts can outperform the random walk forecasting model.     

Forecasting the UK economy with a medium-scale Bayesian VAR

We estimate a Bayesian VAR (BVAR) for the UK economy and assess its performance in forecasting GDP growth and CPI inflation in real time relative to forecasts from COMPASS, the Bank of England’s DSGE model, and other benchmarks. We find that the BVAR outperformed COMPASS when forecasting both GDP and its expenditure components. In contrast, their performances when forecasting CPI were similar. We also find that the BVAR density forecasts outperformed those of COMPASS, despite under-predicting inflation at most forecast horizons. Both models over-predicted GDP growth at all forecast horizons, but the issue was less pronounced in the BVAR. The BVAR’s point and density forecast performances are also comparable to those of a Bank of England in-house statistical suite for both GDP and CPI inflation, as well as to the official Inflation Report projections. Our results are broadly consistent with the findings of similar studies for other advanced economies.     

Forecasting Euro‐Area Macroeconomic Variables Using a Factor Model Approach for Backdating

We suggest to use a factor model based backdating procedure to construct historical Euro‐area macroeconomic time series data for the pre‐Euro period. We argue that this is a useful alternative to standard contemporaneous aggregation methods. The article investigates for a number of Euro‐area variables whether forecasts based on the factor‐backdated data are more precise than those obtained with standard area‐wide data. A recursive pseudo‐out‐of‐sample forecasting experiment using quarterly data is conducted. Our results suggest that some key variables (e.g. real GDP, inflation and long‐term interest rate) can indeed be forecasted more precisely with the factor‐backdated data.     

Analysts' utilization of historical earnings information

This study examines whether security analysts (in)efficiently utilize the information contained in past series of annual and quarterly earnings in producing earnings forecasts. To do so, it investigates whether equal-weighted combinations of security analysts' forecasts with forecasts from statistical models based on historical earnings are superior, both in terms of being a better surrogate for the market's expectations of earnings and of accuracy, to forecasts from either one of these two sources. The empirical findings indicate that, although analysts' forecasts are superior to forecasts from statistical models, performance can be improved—both in terms of accuracy and also of being a better surrogate for market earnings expectations—by combining analysts' forecasts with forecasts from statistical models based on past quarterly earnings. Improvements in proxying for market earnings expectations were obtained even when analysts' forecasts made in June of the forecast year were used in the combinations. An implication of these findings is that investors can improve their investment decisions by using an average of the mean analysts' forecasts and the forecast produced by a time-series model of quarterly earnings in their investment decisions.     

Differencing versus nondifferencing in factor-based forecasting

This paper studies performance of factor-based forecasts using differenced and nondifferenced data. Approximate variances of forecasting errors from the two forecasts are derived and compared. It is reported that the forecast using nondifferenced data tends to be more accurate than that using differenced data. This paper conducts simulations to compare root mean squared forecasting errors of the two competing forecasts. Simulation results indicate that forecasting using nondifferenced data performs better. The advantage of using nondifferenced data is more pronounced when a forecasting horizon is long and the number of factors is large. This paper applies the two competing forecasting methods to 68 I(1) monthly US macroeconomic variables across a range of forecasting horizons and sampling periods. We also provide detailed forecasting analysis on US inflation and industrial production. We find that forecasts using nondifferenced data tend to outperform those using differenced data.     

A bootstrap-based non-parametric forecast density

Interest in density forecasts (as opposed to solely modeling the conditional mean) arises from the possibility of dynamics in higher moments of a time series, as well as in forecasting the probability of future events in some applications. By combining the idea of Markov bootstrapping with that of kernel density estimation, this paper presents a simple non-parametric method for estimating out-of-sample multi-step density forecasts. The paper also considers a host of evaluation tests for examining the dynamic misspecification of estimated density forecasts by targeting autocorrelation, heteroskedasticity and neglected non-linearity. These tests are useful, as a rejection of the tests gives insight into ways to improve a particular forecasting model. In an extensive Monte Carlo analysis involving a range of commonly used linear and non-linear time series processes, the non-parametric method is shown to work reasonably well across the simulated models for a suitable choice of the bandwidth (smoothing parameter). Furthermore, an application of the method to the U.S. Industrial Production series provides multi-step density forecasts that show no sign of dynamic misspecification.     

Econometric Models and Economic Forecasting

This Briefing Paper is thejirst ofa series of three designeddiscussed is the process of making 'constant adjustments' in forecasts. This process involves modifying the results generated by the econometric model. For the first time we are publishing tables of the constant adjustments used in the current forecast. We explain in general why such adjustments are made and also explain the actual adjustments we have made for this forecast.
The second article of the series, to be published in our February 1983 edition, will describe the potential sources of error in forecasts. In particular it will describe the inevitable stochastic or random element involved in e tatistical attempts to quantify economic behaviour. As a completely new departure the article will report estimates of future errors based on stochastic simulations of the LBS. model and will provide statistical error bad for the main elements of the forecast.
The final article, to be published in our June 1983 edition, will contrast the measures of forecast error that e e obtain from the estimation process and our stochastic e imulationsp with the errors that we have actually made, as revealed by an examination of our forecasting 'track record'. It is hoped to draw, from this comparison, some e eneral conclusions about the scope and limits of econometric forecasting producers.     

Population forecasting theory,methods and assessments of accuracy. The magnitude of error due to different vital processes in population forecasts

The accuracy of population forecasts depends in part upon the method chosen for forecasting the vital rates of fertility, mortality, and migration. Methods for handling the stochastic propagation of error calculations in demographic forecasting are hard to do precisely. This paper discusses this obstacle in stochastic cohort-component population forecasts. The uncertainty of forecasts is due to uncertain estimates of the jump-off population and to errors in the forecasts of the vital rates. Empirically based of each source are presented and propagated through a simplified analytical model of population growth that allows assessment of the role of each component in the total error. Numerical estimates based on the errors of an actual vector ARIMA forecast of the US female population. These results broadly agree with those of the analytical model. This work especially uncertainty in the fertility forecasts to be so much higher than that in the other sources that the latter can be ignored in the propagation of error calculations for those cohorts that are born after the jump-off year of the forecast. A methodology is therefore presented which far simplifies the propagation of error calculations. It is noted, however, that the uncertainty of the jump-off population, migration, and mortality in the propagation of error for those alive at the jump-off time of the forecast must still be considered.     

Stability in the inefficient use of forecasting systems: A case study in a supply chain company

Computer-based demand forecasting systems have been widely adopted in supply chain companies, but little research has studied how these systems are actually used in the forecasting process. We report the findings of a case study of demand forecasting in a pharmaceutical company over a 15-year period. At the start of the study, managers believed that they were making extensive use of their forecasting system that was marketed based on the accuracy of its advanced statistical methods. Yet most forecasts were obtained using the system’s facility for judgmentally overriding the automatic statistical forecasts. Carrying out the judgmental interventions involved considerable management effort as part of a sales & operations planning (S&OP) process, yet these often only served to reduce forecast accuracy. This study uses observations of the forecasting process, interviews with participants and data on the accuracy of forecasts to investigate why the managers continued to use non-normative forecasting practices for many years despite the potential economic benefits that could be achieved through change. The reasons for the longevity of these practices are examined both from the perspective of the individual forecaster and the organization as a whole.     

Influence of differentiated roles on group forecasting accuracy

While behavioral research on forecasting has mostly examined the individual forecaster, organizationally-based forecasting processes typically tend to rely on groups with members from different functional areas for arriving at ‘consensus’ forecasts. The forecasting performance could also vary depending on the particular group structuring utilized in reaching a final prediction. The current study compares the forecasting performance of modified consensus groups with that of staticized groups using formal role-playing. It is found that, when undistorted model forecasts are given, group forecasts (whether they are arrived at through averaging or by a detailed discussion of the forecasts) contribute positively to the forecasting accuracy. However, providing distorted initial forecasts affects the final accuracy with varying degrees of improvement over the initial forecasts. The results show a strong tendency to favor optimistic forecasts for both the staticized and modified consensus group forecasts. Overall, the role modifications are found to be successful in eliciting a differential adjustment behavior, effectively mimicking the disparities between different organizational roles. Current research suggests that group discussions may be an efficient method of displaying and resolving differential motivational contingencies, potentially leading to group forecasts that perform quite well.