Forecasting of density functions with an application to cross-sectional and intraday returns

This paper is concerned with the forecasting of probability density functions. Density functions are nonnegative and have a constrained integral, and thus do not constitute a vector space. The implementation of established functional time series forecasting methods for such nonlinear data is therefore problematic. Two new methods are developed and compared to two existing methods. The comparison is based on the densities derived from cross-sectional and intraday returns. For such data, one of our new approaches is shown to dominate the existing methods, while the other is comparable to one of the existing approaches.     

Mixture of MLP-experts for trend forecasting of time series: A case study of the Tehran stock exchange

A new method for forecasting the trend of time series, based on mixture of MLP experts, is presented. In this paper, three neural network combining methods and an Adaptive Network-Based Fuzzy Inference System (ANFIS) are applied to trend forecasting in the Tehran stock exchange. There are two experiments in this study. In experiment I, the time series data are the Kharg petrochemical company’s daily closing prices on the Tehran stock exchange. In this case study, which considers different schemes for forecasting the trend of the time series, the recognition rates are 75.97%, 77.13% and 81.64% for stacked generalization, modified stacked generalization and ANFIS, respectively. Using the mixture of MLP experts (ME) scheme, the recognition rate is strongly increased to 86.35%. A gain and loss analysis is also used, showing the relative forecasting success of the ME method with and without rejection criteria, compared to a simple buy and hold approach. In experiment II, the time series data are the daily closing prices of 37 companies on the Tehran stock exchange. This experiment is conducted to verify the results of experiment I and to show the efficiency of the ME method compared to stacked generalization, modified stacked generalization and ANFIS.     

A hybrid system-identification method for forecasting telecommunications product demands

A crucial challenge for telecommunications companies is how to forecast changes in demand for specific products over the next 6 to 18 months—the length of a typical short-range capacity-planning and capital-budgeting planning horizon. The problem is especially acute when only short histories of product sales are available. This paper presents a new two-level approach to forecasting demand from short-term data. The lower of the two levels consists of adaptive system-identification algorithms borrowed from signal processing, especially, Hidden Markov Model (HMM) methods [Hidden Markov Models: Estimation and Control (1995) Springer Verlag]. Although they have primarily been used in engineering applications such as automated speech recognition and seismic data processing, HMM techniques also appear to be very promising for predicting probabilities of individual customer behaviors from relatively short samples of recent product-purchasing histories. The upper level of our approach applies a classification tree algorithm to combine information from the lower-level forecasting algorithms. In contrast to other forecast-combination algorithms, such as weighted averaging or Bayesian aggregation formulas, the classification tree approach exploits high-order interactions among error patterns from different predictive systems. It creates a hybrid, forecasting algorithm that out-performs any of the individual algorithms on which it is based. This tree-based approach to hybridizing forecasts provides a new, general way to combine and improve individual forecasts, whether or not they are based on HMM algorithms. The paper concludes with the results of validation tests. These show the power of HMM methods to forecast what individual customers are likely to do next. They also show the gain from classification tree post-processing of the predictions from lower-level forecasts. In essence, these techniques enhance the limited techniques available for new product forecasting.     

Forecasting the volatility of asset returns: The informational gains from option prices

A new class of forecasting models is proposed that extends the realized GARCH class of models through the inclusion of option prices to forecast the variance of asset returns. The VIX is used to approximate option prices, resulting in a set of cross-equation restrictions on the model’s parameters. The full model is characterized by a nonlinear system of three equations containing asset returns, the realized variance, and the VIX, with estimation of the parameters based on maximum likelihood methods. The forecasting properties of the new class of forecasting models, as well as a number of special cases, are investigated and applied to forecasting the daily S&P500 index realized variance using intra-day and daily data from September 2001 to November 2017. The forecasting results provide strong support for including the realized variance and the VIX to improve variance forecasts, with linear conditional variance models performing well for short-term one-day-ahead forecasts, whereas log-linear conditional variance models tend to perform better for intermediate five-day-ahead forecasts.     

Evaluating density forecasts: forecast combinations,model mixtures,calibration and sharpness

This paper reviews current density forecast evaluation procedures, and considers a proposal that such procedures be augmented by an assessment of ‘sharpness’. This was motivated by an example in which some standard evaluation procedures using probability integral transforms cannot distinguish the ideal forecast from several competing forecasts. We show that this example has some unrealistic features from a time series forecasting perspective, and so provides insecure foundations for the argument that existing calibration procedures are inadequate in practice. Our alternative, more realistic example shows how relevant statistical methods, including information‐based methods, provide the required discrimination between competing forecasts. We introduce a new test of density forecast efficiency. Copyright © 2010 John Wiley & Sons, Ltd.     

FFORMA: Feature-based forecast model averaging

We propose an automated method for obtaining weighted forecast combinations using time series features. The proposed approach involves two phases. First, we use a collection of time series to train a meta-model for assigning weights to various possible forecasting methods with the goal of minimizing the average forecasting loss obtained from a weighted forecast combination. The inputs to the meta-model are features that are extracted from each series. Then, in the second phase, we forecast new series using a weighted forecast combination, where the weights are obtained from our previously trained meta-model. Our method outperforms a simple forecast combination, as well as all of the most popular individual methods in the time series forecasting literature. The approach achieved second position in the M4 competition.     

Adding dummy variables: A simple approach for improved volatility forecasting in electricity market

This study used dummy variables to measure the influence of day-of-the-week effects and structural breaks on volatility. Considering day-of-the-week effects, structural breaks, or both, we propose three classes of HAR models to forecast electricity volatility based on existing HAR models. The estimation results of the models showed that day-of-the-week effects only improve the fitting ability of HAR models for electricity volatility forecasting at the daily horizon, whereas structural breaks can improve the in-sample performance of HAR models when forecasting electricity volatility at daily, weekly, and monthly horizons. The out-of-sample analysis indicated that both day-of-the-week effects and structural breaks contain additional ex ante information for predicting electricity volatility, and in most cases, dummy variables used to measure structural breaks contain more out-of-sample predictive information than those used to measure day-of-the-week effects. The out-of-sample results were robust across three different methods. More importantly, we argue that adding dummy variables to measure day-of-the-week effects and structural breaks can improve the performance of most other existing HAR models for volatility forecasting in the electricity market.     

Optimal Portfolio Choice Under Decision‐Based Model Combinations

We propose a density combination approach featuring combination weights that depend on the past forecast performance of the individual models entering the combination through a utility‐based objective function. We apply this model combination scheme to forecast stock returns, both at the aggregate level and by industry, and investigate its forecasting performance relative to a host of existing combination methods, both within the class of linear and time‐varying coefficients, stochastic volatility models. Overall, we find that our combination scheme produces markedly more accurate predictions than the existing alternatives, both in terms of statistical and economic measures of out‐of‐sample predictability. Copyright © 2016 John Wiley & Sons, Ltd.     

Risk measures for variable annuities: A hermite series expansion approach

In this study, we propose an efficient approach to the calculation of risk measures for an insurer's liability from writing a variable annuity with guaranteed benefits. Our approach is based on a novel application of the Hermite series expansions on the transition density of a diffusion process to the insurance setting. We compare our method with existing methods in the literature, including the analytical method, spectral method and Green's function method, and illustrate its substantial advantages in calculating risk measures for variable annuities with different guarantee structures. The improved efficiency makes our method flexible to practical implementation in reporting risk measures on a daily basis. We also conduct a sensitivity analysis of the risk measures with respect to key parameters.     

Forecasting spare part demand with installed base information: A review

The classical spare part demand forecasting literature studies methods for forecasting intermittent demand. However, the majority of these methods do not consider the underlying demand-generating factors. The demand for spare parts originates from the replacement of parts in the installed base of machines, either preventively or upon breakdown of the part. This information from service operations, which we refer to as installed base information, can be used to forecast the future demand for spare parts. This paper reviews the literature on the use of such installed base information for spare part demand forecasting in order to asses (1) what type of installed base information can be useful; (2) how this information can be used to derive forecasts; (3) the value of using installed base information to improve forecasting; and (4) the limits of the existing methods. This serves as motivation for future research.     

A note on multi-step forecasting with functional coefficient autoregressive models

This paper presents and evaluates alternative methods for multi-step forecasting using univariate and multivariate functional coefficient autoregressive (FCAR) models. The methods include a simple “plug-in” approach, a bootstrap-based approach, and a multi-stage smoothing approach, where the functional coefficients are updated at each step to incorporate information from the time series captured in the previous predictions. The three methods are applied to a series of U.S. GNP and unemployment data to compare performance in practice. We find that the bootstrap-based approach out-performs the other two methods for nonlinear prediction, and that little forecast accuracy is sacrificed using any of the methods if the underlying process is actually linear.     

The inventory performance of forecasting methods: Evidence from the M3 competition data

Forecasting competitions have been a major driver not only of improvements in forecasting methods’ performances, but also of the development of new forecasting approaches. However, despite the tremendous value and impact of these competitions, they do suffer from the limitation that performances are measured only in terms of the forecast accuracy and bias, ignoring utility metrics. Using the monthly industry series of the M3 competition, we empirically explore the inventory performances of various widely used forecasting techniques, including exponential smoothing, ARIMA models, the Theta method, and approaches based on multiple temporal aggregation. We employ a rolling simulation approach and analyse the results for the order-up-to policy under various lead times. We find that the methods that are based on combinations result in superior inventory performances, while the Naïve, Holt, and Holt-Winters methods perform poorly.     

Large time-varying parameter VARs

In this paper, we develop methods for estimation and forecasting in large time-varying parameter vector autoregressive models (TVP-VARs). To overcome computational constraints, we draw on ideas from the dynamic model averaging literature which achieve reductions in the computational burden through the use forgetting factors. We then extend the TVP-VAR so that its dimension can change over time. For instance, we can have a large TVP-VAR as the forecasting model at some points in time, but a smaller TVP-VAR at others. A final extension lies in the development of a new method for estimating, in a time-varying manner, the parameter(s) of the shrinkage priors commonly-used with large VARs. These extensions are operationalized through the use of forgetting factor methods and are, thus, computationally simple. An empirical application involving forecasting inflation, real output and interest rates demonstrates the feasibility and usefulness of our approach.     

Forecasting economic time series using score-driven dynamic models with mixed-data sampling

We introduce a mixed-frequency score-driven dynamic model for multiple time series where the score contributions from high-frequency variables are transformed by means of a mixed-data sampling weighting scheme. The resulting dynamic model delivers a flexible and easy-to-implement framework for the forecasting of low-frequency time series variables through the use of timely information from high-frequency variables. We verify the in-sample and out-of-sample performances of the model in an empirical study on the forecasting of U.S. headline inflation and GDP growth. In particular, we forecast monthly headline inflation using daily oil prices and quarterly GDP growth using a measure of financial risk. The forecasting results and other findings are promising. Our proposed score-driven dynamic model with mixed-data sampling weighting outperforms competing models in terms of both point and density forecasts.     

Forecasting temperature to price CME temperature derivatives

This paper seeks to forecast temperatures in US cities in order to price temperature derivatives on the Chicago Mercantile Exchange (CME). The CME defines the average daily temperature underlying its contracts as the average of the maximum and minimum daily temperatures, yet all published work on temperature forecasting for pricing purposes has ignored this peculiar definition of the average and sought to model the average temperature directly. This paper is the first to look at the average temperature forecasting problem as an analysis of extreme values. The theory of extreme values guides model selection for temperature maxima and minima, and a forecast distribution for the CME’s daily average temperature is found through convolution. While univariate time series AR-GARCH and regression models generally yield superior point forecasts of temperatures, our extreme-value-based model consistently outperforms these models in density forecasting, the most important risk management tool.     

Forecasting monthly and quarterly time series using STL decomposition

This paper is a re-examination of the benefits and limitations of decomposition and combination techniques in the area of forecasting, and also a contribution to the field, offering a new forecasting method. The new method is based on the disaggregation of time series components through the STL decomposition procedure, the extrapolation of linear combinations of the disaggregated sub-series, and the reaggregation of the extrapolations to obtain estimates for the global series. Applying the forecasting method to data from the NN3 and M1 Competition series, the results suggest that it can perform well relative to four other standard statistical techniques from the literature, namely the ARIMA, Theta, Holt-Winters’ and Holt’s Damped Trend methods. The relative advantages of the new method are then investigated further relative to a simple combination of the four statistical methods and a Classical Decomposition forecasting method. The strength of the method lies in its ability to predict long lead times with relatively high levels of accuracy, and to perform consistently well for a wide range of time series, irrespective of the characteristics, underlying structure and level of noise of the data.     

A new structural break model,with an application to Canadian inflation forecasting

This paper develops an efficient approach to modelling and forecasting time series data with an unknown number of change-points. Using a conjugate prior and conditioning on time-invariant parameters, the predictive density and the posterior distribution of the change-points have closed forms. Furthermore, the conjugate prior is modeled as hierarchical in order to exploit the information across regimes. This framework allows breaks in the variance, the regression coefficients, or both. The regime duration can be modelled as a Poisson distribution. A new, efficient Markov chain Monte Carlo sampler draws the parameters from the posterior distribution as one block. An application to a Canadian inflation series shows the gains in forecasting precision that our model provides.     

What determines forecasters’ forecasting errors?

This paper contributes to the growing body of literature in macroeconomics and finance on expectation formation and information processing by analyzing the relationship between expectation formation at the individual level and the prediction of macroeconomic aggregates. Using information from business tendency surveys, we present a new approach of analyzing forecasters’ qualitative forecasting errors. Based on a quantal response approach with misclassification, we define forecasters’ qualitative mispredictions in terms of deviations from the qualitative rational expectation forecast, and relate them to the individual and macro factors that are driving these mispredictions. Our approach permits a detailed analysis of individual forecasting decisions, allowing for the introduction of individual and economy-wide determinants that affect the individual forecasting error process.     

Short interval forecasting of emergency phone call (911) work loads

There has been an increasing emphasis over the last 5 to 10 years to improve productivity in the Service Sector of the U.S. economy. Much of the improvement obtained by these managers has come about through better scheduling of the work force in these organizations. Effective scheduling of this personnel requires good estimates of demand, which may exhibit substantial variations between days for certain times of the year. The Indianapolis Police Department (IPD) Communications area is one such organization that exhibits varying workloads and is interested in improving staff scheduling of dispatch operators.This article explores the use of six different forecasting techniques for predicting daily emergency call workloads for the IPD's communications area. Historical call volume data are used to estimate the model parameters. A hold-out sample of five months compares forecasts and actual daily call levels. The forecast system utilizes a rolling horizon approach, where daily forecasts are made for the coming month from the end of the prior month. The forecast origin is then advanced to the end of the month, where the current month's actual call data are added to the historical database, new parameters are estimated, and then the next month's daily estimates are generated. Error measures of residual standard deviation, mean absolute percent error, and bias are used to measure performance. Statistical analyses are conducted to evaluate if significant differences in performance are present among the six models.The research presented in this article indicates that there are clearly significant differences in performance for the six models analyzed. These models were tailored to the specific structure and this work suggests that the short interval forecasting problems faced by many service organizations has several structural differences compared to the typical manufacturing firm in a made-to-stock environment. The results also suggests two other points. First, simple modeling approaches can perform well in complex environments that are present in many service organizations. Second, special tailoring of the forecasting model is necessary for many service firms. Historical data patterns for these organizations tend to be more complex than just trend and seasonal elements, which are normally tracked in smoothing models. These are important conclusions for both managers of operating systems and staff analysts supporting these operating systems. The design of an appropriate forecasting system to support effective staff planning must consider the nature, scope, and complexity of these environments.     

Correlated daily time series and forecasting in the M4 competition

We participated in the M4 competition for time series forecasting and here describe our methods for forecasting daily time series. We used an ensemble of five statistical forecasting methods and a method that we refer to as the correlator. Our retrospective analysis using the ground truth values published by the M4 organisers after the competition demonstrates that the correlator was responsible for most of our gains over the naïve constant forecasting method. We identify data leakage as one reason for its success, due partly to test data selected from different time intervals, and partly to quality issues with the original time series. We suggest that future forecasting competitions should provide actual dates for the time series so that some of these leakages could be avoided by participants.