Comparison of intraday probabilistic forecasting of solar irradiance using only endogenous data

Accurate solar forecasts are necessary to improve the integration of solar renewables into the energy grid. In recent years, numerous methods have been developed for predicting the solar irradiance or the output of solar renewables. By definition, a forecast is uncertain. Thus, the models developed predict the mean and the associated uncertainty. Comparisons are therefore necessary and useful for assessing the skill and accuracy of these new methods in the field of solar energy.The aim of this paper is to present a comparison of various models that provide probabilistic forecasts of the solar irradiance within a very strict framework. Indeed, we consider focusing on intraday forecasts, with lead times ranging from 1 to 6 h. The models selected use only endogenous inputs for generating the forecasts. In other words, the only inputs of the models are the past solar irradiance data. In this context, the most common way of generating the forecasts is to combine point forecasting methods with probabilistic approaches in order to provide prediction intervals for the solar irradiance forecasts. For this task, we selected from the literature three point forecasting models (recursive autoregressive and moving average (ARMA), coupled autoregressive and dynamical system (CARDS), and neural network (NN)), and seven methods for assessing the distribution of their error (linear model in quantile regression (LMQR), weighted quantile regression (WQR), quantile regression neural network (QRNN), recursive generalized autoregressive conditional heteroskedasticity (GARCHrls), sieve bootstrap (SB), quantile regression forest (QRF), and gradient boosting decision trees (GBDT)), leading to a comparison of 20 combinations of models.None of the model combinations clearly outperform the others; nevertheless, some trends emerge from the comparison. First, the use of the clear sky index ensures the accuracy of the forecasts. This derived parameter permits time series to be deseasonalized with missing data, and is also a good explanatory variable of the distribution of the forecasting errors. Second, regardless of the point forecasting method used, linear models in quantile regression, weighted quantile regression and gradient boosting decision trees are able to forecast the prediction intervals accurately.     

Macroeconomic Forecasting Performance under Alternative Specifications of Time‐Varying Volatility

This paper compares alternative models of time‐varying volatility on the basis of the accuracy of real‐time point and density forecasts of key macroeconomic time series for the USA. We consider Bayesian autoregressive and vector autoregressive models that incorporate some form of time‐varying volatility, precisely random walk stochastic volatility, stochastic volatility following a stationary AR process, stochastic volatility coupled with fat tails, GARCH and mixture of innovation models. The results show that the AR and VAR specifications with conventional stochastic volatility dominate other volatility specifications, in terms of point forecasting to some degree and density forecasting to a greater degree. Copyright © 2014 John Wiley & Sons, Ltd.     

Bootstrap prediction intervals for SETAR models

This paper considers four methods for obtaining bootstrap prediction intervals (BPIs) for the self-exciting threshold autoregressive (SETAR) model. Method 1 ignores the sampling variability of the threshold parameter estimator. Method 2 corrects the finite sample biases of the autoregressive coefficient estimators before constructing BPIs. Method 3 takes into account the sampling variability of both the autoregressive coefficient estimators and the threshold parameter estimator. Method 4 resamples the residuals in each regime separately. A Monte Carlo experiment shows that (1) accounting for the sampling variability of the threshold parameter estimator is necessary, despite its super-consistency; (2) correcting the small-sample biases of the autoregressive parameter estimators improves the small-sample properties of bootstrap prediction intervals under certain circumstances; and (3) the two-sample bootstrap can improve the long-term forecasts when the error terms are regime-dependent.     

Forecasting cryptocurrencies under model and parameter instability

This paper studies the predictability of cryptocurrency time series. We compare several alternative univariate and multivariate models for point and density forecasting of four of the most capitalized series: Bitcoin, Litecoin, Ripple and Ethereum. We apply a set of crypto-predictors and rely on dynamic model averaging to combine a large set of univariate dynamic linear models and several multivariate vector autoregressive models with different forms of time variation. We find statistically significant improvements in point forecasting when using combinations of univariate models, and in density forecasting when relying on the selection of multivariate models. Both schemes deliver sizable directional predictability.     

Distributed ARIMA models for ultra-long time series

Providing forecasts for ultra-long time series plays a vital role in various activities, such as investment decisions, industrial production arrangements, and farm management. This paper develops a novel distributed forecasting framework to tackle the challenges of forecasting ultra-long time series using the industry-standard MapReduce framework. The proposed model combination approach retains the local time dependency. It utilizes a straightforward splitting across samples to facilitate distributed forecasting by combining the local estimators of time series models delivered from worker nodes and minimizing a global loss function. Instead of unrealistically assuming the data generating process (DGP) of an ultra-long time series stays invariant, we only make assumptions on the DGP of subseries spanning shorter time periods. We investigate the performance of the proposed approach with AutoRegressive Integrated Moving Average (ARIMA) models using the real data application as well as numerical simulations. Our approach improves forecasting accuracy and computational efficiency in point forecasts and prediction intervals, especially for longer forecast horizons, compared to directly fitting the whole data with ARIMA models. Moreover, we explore some potential factors that may affect the forecasting performance of our approach.     

Evaluating factor forecasts for the UK: The role of asset prices

This paper applies a large data set, consisting of 167 monthly time series for the UK, both economic and financial, to simulate out-of-sample predictions of industrial production, inflation, 3-month Treasury Bills, and other variables. Fifteen dynamic factor models that allow forecasting based on large panels of time series are considered. The performances of these factor models are then compared to the following competing models: a simple univariate autoregressive, a vector autoregressive, a leading indicator, and a Phillips curve models. The results show that the best dynamic factor models outperform the competing models in forecasting at 6-, 12-, and 24-month horizons. Thus, the financial markets may have predictive power for the economic activity. This can be a useful tool for central banks and financial institutions, which may use the factor models to construct leading indicators of the economic conditions. In addition, researchers can see a strategic application of factor models.     

BAYESIAN MODEL SELECTION AND FORECASTING IN NONCAUSAL AUTOREGRESSIVE MODELS

In this paper, we propose a Bayesian estimation and forecasting procedure for noncausal autoregressive (AR) models. Specifically, we derive the joint posterior density of the past and future errors and the parameters, yielding predictive densities as a by‐product. We show that the posterior model probabilities provide a convenient model selection criterion in discriminating between alternative causal and noncausal specifications. As an empirical application, we consider US inflation. The posterior probability of noncausality is found to be high—over 98%. Furthermore, the purely noncausal specifications yield more accurate inflation forecasts than alternative causal and noncausal AR models. Copyright © 2010 John Wiley & Sons, Ltd.     

Conformal prediction interval estimation and applications to day-ahead and intraday power markets

In this study, we investigated the application of the conformal prediction (CP) concept in the context of short-term electricity price forecasting. In particular, we determined the most important aspects related to the utility of CP, as well as explaining why this simple but highly effective idea has proved useful in other application areas and why its characteristics make it promising for short-term power applications. We compared the performance of CP with various state-of-the-art electricity price forecasting models, such as quantile regression averaging, in an empirical out-of-sample study of three short-term electricity time series. We combined CP with various underlying point forecast models to demonstrate its versatility and behavior under changing conditions. Our findings suggest that CP yields sharp and reliable prediction intervals in short-term power markets. We also inspected the effects of each of the model components to provide path-based guideline regarding how to find the best CP model for each market.     

Forecasting exchange rate volatility using high-frequency data: Is the euro different?

We assess the performances of alternative procedures for forecasting the daily volatility of the euro’s bilateral exchange rates using 15 min data. We use realized volatility and traditional time series volatility models. Our results indicate that using high-frequency data and considering their long memory dimension enhances the performance of volatility forecasts significantly. We find that the intraday FIGARCH model and the ARFIMA model outperform other traditional models for all exchange rate series.     

The tourism forecasting competition

We evaluate the performances of various methods for forecasting tourism data. The data used include 366 monthly series, 427 quarterly series and 518 annual series, all supplied to us by either tourism bodies or academics who had used them in previous tourism forecasting studies. The forecasting methods implemented in the competition are univariate and multivariate time series approaches, and econometric models. This forecasting competition differs from previous competitions in several ways: (i) we concentrate on tourism data only; (ii) we include approaches with explanatory variables; (iii) we evaluate the forecast interval coverage as well as the point forecast accuracy; (iv) we observe the effect of temporal aggregation on the forecasting accuracy; and (v) we consider the mean absolute scaled error as an alternative forecasting accuracy measure. We find that pure time series approaches provide more accurate forecasts for tourism data than models with explanatory variables. For seasonal data we implement three fully automated pure time series algorithms that generate accurate point forecasts, and two of these also produce forecast coverage probabilities which are satisfactorily close to the nominal rates. For annual data we find that Naïve forecasts are hard to beat.     

Forecasting realized variance measures using time-varying coefficient models

This paper considers the problem of forecasting realized variance measures. These measures are highly persistent estimates of the underlying integrated variance, but are also noisy. Bollerslev, Patton and Quaedvlieg (2016), Journal of Econometrics 192(1), 1–18 exploited this so as to extend the commonly used heterogeneous autoregressive (HAR) by letting the model parameters vary over time depending on the estimated measurement error variances. We propose an alternative specification that allows the autoregressive parameters of HAR models to be driven by a latent Gaussian autoregressive process that may also depend on the estimated measurement error variance. The model parameters are estimated by maximum likelihood using the Kalman filter. Our empirical analysis considers the realized variances of 40 stocks from the S&P 500. Our model based on log variances shows the best overall performance and generates superior forecasts both in terms of a range of different loss functions and for various subsamples of the forecasting period.     

Evaluating the forecasting performance of econometric models of air passenger traffic flows using multiple error measures

Airline traffic forecasting is important to airlines and regulatory authorities. This paper examines a number of approaches to forecasting short- to medium-term air traffic flows. It contributes as a rare replication, testing a variety of alternative modelling approaches. The econometric models employed include autoregressive distributed lag (ADL) models, time-varying parameter (TVP) models and an automatic method for econometric model specification. A vector autoregressive (VAR) model and various univariate alternatives are also included to deliver unconditional forecast comparisons. Various approaches for taking into account interactions between contemporaneous air traffic flows are examined, including pooled ADL models and the enhanced models with the addition of a “world trade” variable. Based on the analysis of a number of forecasting error measures, it is concluded that pooled ADL models that include the “world trade” variable outperform the alternatives, and in particular univariate methods; and, second, that automatic modelling procedures are enhanced through judgmental intervention. In contrast to earlier results, the TVP models do not improve accuracy. Depending on the preferred error measure, the difference in accuracy may be substantial.     

Coherent forecasting for count time series using Box–Jenkins's AR(p) model

During the last three decades, integer‐valued autoregressive process of order p [or INAR(p)] based on different operators have been proposed as a natural, intuitive and maybe efficient model for integer‐valued time‐series data. However, this literature is surprisingly mute on the usefulness of the standard AR(p) process, which is otherwise meant for continuous‐valued time‐series data. In this paper, we attempt to explore the usefulness of the standard AR(p) model for obtaining coherent forecasting from integer‐valued time series. First, some advantages of this standard Box–Jenkins's type AR(p) process are discussed. We then carry out our some simulation experiments, which show the adequacy of the proposed method over the available alternatives. Our simulation results indicate that even when samples are generated from INAR(p) process, Box–Jenkins's model performs as good as the INAR(p) processes especially with respect to mean forecast. Two real data sets have been employed to study the expediency of the standard AR(p) model for integer‐valued time‐series data.     

ARIMA融合神经网络的人民币汇率预测模型研究

本文在深入分析了单整自回归移动平均(ARIMA)模型与神经网络(NN)模型特点的基础上,建立了ARIMA融合NN的人民币汇率时间序列预测模型。其基本思想是充分发挥两种模型在线性空间和非线性空间的预测优势,即将汇率时间序列的数据结构分解为线性自相关主体和非线性残差两部分,首先用ARI-MA模型预测序列的线性主体,然后用NN模型对其非线性残差进行估计,最终合成为整个序列的预测结果。通过对三种人民币汇率序列的仿真实验表明,融合模型的预测准确率显著高于包括随机游走模型在内的单一模型的预测准确率,从而证实了融合模型用于汇率预测的有效性。这一结果也表明,人民币汇率市场并不符合有效市场假设,可以通过模型对汇率未来走势做出较准确预测。     

Probabilistic forecasting of industrial electricity load with regime switching behavior

This paper suggests a novel inhomogeneous Markov switching approach for the probabilistic forecasting of industrial companies’ electricity loads, for which the load switches at random times between production and standby regimes. The model that we propose describes the transitions between the regimes using a hidden Markov chain with time-varying transition probabilities that depend on calendar variables. We model the demand during the production regime using an autoregressive moving-average (ARMA) process with seasonal patterns, whereas we use a much simpler model for the standby regime in order to reduce the complexity. The maximum likelihood estimation of the parameters is implemented using a differential evolution algorithm. Using the continuous ranked probability score (CRPS) to evaluate the goodness-of-fit of our model for probabilistic forecasting, it is shown that this model often outperforms classical additive time series models, as well as homogeneous Markov switching models. We also propose a simple procedure for classifying load profiles into those with and without regime-switching behaviors.     

DeepAR: Probabilistic forecasting with autoregressive recurrent networks

Probabilistic forecasting, i.e., estimating a time series’ future probability distribution given its past, is a key enabler for optimizing business processes. In retail businesses, for example, probabilistic demand forecasts are crucial for having the right inventory available at the right time and in the right place. This paper proposes DeepAR, a methodology for producing accurate probabilistic forecasts, based on training an autoregressive recurrent neural network model on a large number of related time series. We demonstrate how the application of deep learning techniques to forecasting can overcome many of the challenges that are faced by widely-used classical approaches to the problem. By means of extensive empirical evaluations on several real-world forecasting datasets, we show that our methodology produces more accurate forecasts than other state-of-the-art methods, while requiring minimal manual work.     

A note on multi-step forecasting with functional coefficient autoregressive models

This paper presents and evaluates alternative methods for multi-step forecasting using univariate and multivariate functional coefficient autoregressive (FCAR) models. The methods include a simple “plug-in” approach, a bootstrap-based approach, and a multi-stage smoothing approach, where the functional coefficients are updated at each step to incorporate information from the time series captured in the previous predictions. The three methods are applied to a series of U.S. GNP and unemployment data to compare performance in practice. We find that the bootstrap-based approach out-performs the other two methods for nonlinear prediction, and that little forecast accuracy is sacrificed using any of the methods if the underlying process is actually linear.     

Forecasting the Chinese stock market volatility with international market volatilities: The role of regime switching

The purpose of this paper is to investigate the role of regime switching in the prediction of the Chinese stock market volatility with international market volatilities. Our work is based on the heterogeneous autoregressive (HAR) model and we further extend this simple benchmark model by incorporating an individual volatility measure from 27 international stock markets. The in-sample estimation results show that the transition probabilities are significant and the high volatility regime exhibits substantially higher volatility level than the low volatility regime. The out-of-sample forecasting results based on the Diebold-Mariano (DM) test suggest that the regime switching models consistently outperform their original counterparts with respect to not only the HAR and its extended models but also the five used combination approaches. In addition to point accuracy, the regime switching models also exhibit substantially higher directional accuracy. Furthermore, compared to time-varying parameter, Markov regime switching is found to be a more efficient way to process the volatility information in the changing world. Our results are also robust to alternative evaluation methods, various loss functions, alternative volatility estimators, various sample periods, and various settings of Markov regime switching. Finally, we provide an extension of forecasting aggregate market volatility on monthly frequency and observe mixed results.     

Tourism forecasting: accuracy of alternative econometric models

This study evaluates the forecasting accuracy of six alternative econometric models in the context of the demand for international tourism in Denmark. These econometric models are special cases of a general autoregressive distributed lag specification. In addition, the forecasting accuracy of two univariate time series models is evaluated for benchmark comparison purposes. The forecasting competition is based on annual data on inbound tourism to Denmark. Individual models are estimated for each of the six major origin countries over the period 1969–93 and forecasting performance is assessed using data for the period 1994–97. Rankings of these forecasting models over different time horizons are established based on mean absolute percentage error and root mean square percentage error.