The value of feedback in forecasting competitions

In this paper we challenge the traditional design used for forecasting competitions. We implement an online competition with a public leaderboard that provides instant feedback to competitors who are allowed to revise and resubmit forecasts. The results show that feedback significantly improves forecasting accuracy.     

Multi-step forecasting in emerging economies: An investigation of the South African GDP

To forecast at several, say h, periods into the future, a modeller faces a choice between iterating one-step-ahead forecasts (the IMS technique), or directly modeling the relationship between observations separated by an h-period interval and using it for forecasting (DMS forecasting). It is known that structural breaks, unit-root non-stationarity and residual autocorrelation may improve DMS accuracy in finite samples, all of which occur when modelling the South African GDP over the period 1965–2000. This paper analyzes the forecasting properties of 779 multivariate and univariate models that combine different techniques of robust forecasting. We find strong evidence supporting the use of DMS and intercept correction, and attribute their superior forecasting performance to their robustness in the presence of breaks.     

Ensemble forecast of photovoltaic power with online CRPS learning

We provide probabilistic forecasts of photovoltaic (PV) production, for several PV plants located in France up to 6 days of lead time, with a 30-min timestep. First, we derive multiple forecasts from numerical weather predictions (ECMWF and Météo France), including ensemble forecasts. Second, our parameter-free online learning technique generates a weighted combination of the production forecasts for each PV plant. The weights are computed sequentially before each forecast using only past information. Our strategy is to minimize the Continuous Ranked Probability Score (CRPS). We show that our technique provides forecast improvements for both deterministic and probabilistic evaluation tools.     

Learning cycles in Bertrand competition with differentiated commodities and competing learning rules

This paper stresses the importance of heterogeneity in learning. We consider a Bertrand oligopoly with firms using either least squares learning or gradient learning for determining the price. We demonstrate that convergence properties of the rules are strongly affected by heterogeneity. In particular, gradient learning may become unstable as the number of gradient learners increases. Endogenous choice between the learning rules may induce cyclical switching. Stable gradient learning gives higher average profit than least squares learning, making firms switch to gradient learning. This can destabilize gradient learning which, because of decreasing profits, makes firms switch back to least squares learning.     

Forecasting high resolution electricity demand data with additive models including smooth and jagged components

Short-Term Load Forecasting (STLF) is a fundamental instrument in the efficient operational management and planning of electric utilities. Emerging smart grid technologies pose new challenges and opportunities. Although load forecasting at the aggregate level has been extensively studied, electrical load forecasting at fine-grained geographical scales of households is more challenging. Among existing approaches, semi-parametric generalized additive models (GAM) have been increasingly popular due to their accuracy, flexibility, and interpretability. Their applicability is justified when forecasting is addressed at higher levels of aggregation, since the aggregated load pattern contains relatively smooth additive components. High resolution data are highly volatile, forecasting the average load using GAM models with smooth components does not provide meaningful information about the future demand. Instead, we need to incorporate irregular and volatile effects to enhance the forecast accuracy. We focus on the analysis of such hybrid additive models applied on smart meters data and show that it leads to improvement of the forecasting performances of classical additive models at low aggregation levels.     

Recent advances in intra-hour solar forecasting: A review of ground-based sky image methods

As the penetration of solar energy generation into power systems keeps rising, intra-hour solar forecasting (IHSF) is becoming increasingly important for the secure and economical operation of a power system. One major difficulty in providing very accurate IHSF emanates from rapid cloud changes in the sky. The ground-based sky image (GSI) provides the intuitive information of intra-hour cloud changes and has thus been widely utilized in studies on IHSF. This paper presents a systematic review of the state-of-the-art of ground-based sky image-based intra-hour solar forecasting (GSI-IHSF). To our knowledge, we first propose a generic framework of GSI-IHSF consisting of four modules, i.e., sky image acquisition, sky image preprocessing, cloud forecasting, and solar forecasting. Then, as for each module, this paper introduces its core function, shows the major challenges, briefly reviews several extensively used techniques, summarizing research trends. Finally, this paper offers a prospect of GSI-IHSF research, discusses recent advances that demonstrate the potential for a great improvement in forecast accuracy, pointing out some new requirements and challenges that should be further investigated in the future.     

Probabilistic forecasting of industrial electricity load with regime switching behavior

This paper suggests a novel inhomogeneous Markov switching approach for the probabilistic forecasting of industrial companies’ electricity loads, for which the load switches at random times between production and standby regimes. The model that we propose describes the transitions between the regimes using a hidden Markov chain with time-varying transition probabilities that depend on calendar variables. We model the demand during the production regime using an autoregressive moving-average (ARMA) process with seasonal patterns, whereas we use a much simpler model for the standby regime in order to reduce the complexity. The maximum likelihood estimation of the parameters is implemented using a differential evolution algorithm. Using the continuous ranked probability score (CRPS) to evaluate the goodness-of-fit of our model for probabilistic forecasting, it is shown that this model often outperforms classical additive time series models, as well as homogeneous Markov switching models. We also propose a simple procedure for classifying load profiles into those with and without regime-switching behaviors.     

Nowcasting GDP using machine-learning algorithms: A real-time assessment

Can machine-learning algorithms help central banks understand the current state of the economy? Our results say yes! We contribute to the emerging literature on forecasting macroeconomic variables using machine-learning algorithms by testing the nowcast performance of common algorithms in a full ‘real-time’ setting—that is, with real-time vintages of New Zealand GDP growth (our target variable) and real-time vintages of around 600 predictors. Our results show that machine-learning algorithms are able to significantly improve over a simple autoregressive benchmark and a dynamic factor model. We also show that machine-learning algorithms have the potential to add value to, and in one case improve on, the official forecasts of the Reserve Bank of New Zealand.