Machine learning methods for GEFCom2017 probabilistic load forecasting

This paper describes the preprocessing and forecasting methods used by team Orbuculum during the qualifying match of the Global Energy Forecasting Competition 2017 (GEFCom2017). Tree-based algorithms (gradient boosting and quantile random forest) and neural networks made up an ensemble. The ensemble prediction quantiles were obtained by a simple averaging of the ensemble members’ prediction quantiles. The result shows a robust performance according to the pinball loss metric, with the ensemble model achieving third place in the qualifying match of the competition.     

Probabilistic wind forecasting up to three months ahead using ensemble predictions for geopotential height

We develop a method for forecasting the distribution of the daily surface wind speed at timescales from 15-days to 3-months in France. On such long-term timescales, ensemble predictions of the surface wind speed have poor performance, however, the wind speed distribution may be related to the large-scale circulation of the atmosphere, for which the ensemble forecasts have better skill. The information from the large-scale circulation, represented by the 500 hPa geopotential height, is summarized into a single index by first running a PCA and then a polynomial regression. We estimate, over 20 years of daily data, the conditional probability density of the wind speed at a specific location given the index. We then use the ECMWF seasonal forecast ensemble to predict the index for horizons from 15-days to 3-months. These predictions are plugged into the conditional density to obtain a distributional forecast of surface wind. These probabilistic forecasts remain sharper than the climatology up to 1-month forecast horizon. Using a statistical postprocessing method to recalibrate the ensemble leads to further improvement of our probabilistic forecast, which then remains calibrated and sharper than the climatology up to 3-months horizon, particularly in the north of France in winter and fall.     

Comparing trained and untrained probabilistic ensemble forecasts of COVID-19 cases and deaths in the United States

The U.S. COVID-19 Forecast Hub aggregates forecasts of the short-term burden of COVID-19 in the United States from many contributing teams. We study methods for building an ensemble that combines forecasts from these teams. These experiments have informed the ensemble methods used by the Hub. To be most useful to policymakers, ensemble forecasts must have stable performance in the presence of two key characteristics of the component forecasts: (1) occasional misalignment with the reported data, and (2) instability in the relative performance of component forecasters over time. Our results indicate that in the presence of these challenges, an untrained and robust approach to ensembling using an equally weighted median of all component forecasts is a good choice to support public health decision-makers. In settings where some contributing forecasters have a stable record of good performance, trained ensembles that give those forecasters higher weight can also be helpful.     

基于集成学习的多式联运货运量预测模型构建

货运量精准预测是多式联运网络高效协同发展的重要基础,货运量时变性强、数据多样性缺失是实现精准货运量预测的问题所在。基于此,通过挖掘货物运输量(集装箱)的时间变化特征,构建初始相关时间特征输入集,结合斯皮尔曼相关性系数分布,采用Bagging+BP集成学习方法训练多个弱分类器,最终组合获取高精度的强学习模型。以南京龙潭港为例,对自回归移动平均模型(ARIMA)、Bagging+BP集成学习网络以及长短时记忆神经网络(LSTM)三种模型进行评价,实验结果表明,相比于其他模型,提出的Bagging+BP集成学习网络预测性能良好,有一定的实用价值。     

Predicting monthly biofuel production using a hybrid ensemble forecasting methodology

This paper proposes a hybrid ensemble forecasting methodology that integrating empirical mode decomposition (EMD), long short-term memory (LSTM) and extreme learning machine (ELM) for the monthly biofuel (a typical agriculture-related energy) production based on the principle of decomposition—reconstruction—ensemble. The proposed methodology involves four main steps: data decomposition via EMD, component reconstruction via a fine-to-coarse (FTC) method, individual prediction via LSTM and ELM algorithms, and ensemble prediction via a simple addition (ADD) method. For illustration and verification, the biofuel monthly production data of the USA is used as the our sample data, and the empirical results indicate that the proposed hybrid ensemble forecasting model statistically outperforms all considered benchmark models considered in terms of the forecasting accuracy. This indicates that the proposed hybrid ensemble forecasting methodology integrating the EMD-LSTM-ELM models based on the decomposition—reconstruction—ensemble principle has been proved to be a competitive model for the prediction of biofuel production.     

Comparing probabilistic forecasts of the daily minimum and maximum temperature

Understanding changes in the frequency, severity, and seasonality of daily temperature extremes is important for public policy decisions regarding heat waves and cold snaps. A heat wave is sometimes defined in terms of both the daily minimum and maximum temperature, which necessitates the generation of forecasts of their joint distribution. In this paper, we develop time series models with the aim of providing insight and producing forecasts of the joint distribution that can challenge the accuracy of forecasts based on ensemble predictions from a numerical weather prediction model. We use ensemble model output statistics to recalibrate the raw ensemble predictions for the marginal distributions, with ensemble copula coupling used to capture the dependency between the marginal distributions. In terms of time series modelling, we consider a bivariate VARMA-MGARCH model. We use daily Spanish data recorded over a 65-year period, and find that, for the 5-year out-of-sample period, the recalibrated ensemble predictions outperform the time series models in terms of forecast accuracy.     

Forecasting the NN5 time series with hybrid models

We propose a simple way of predicting time series with recurring seasonal periods. Missing values of the time series are estimated and interpolated in a preprocessing step. We combine several forecasting methods by taking the weighted mean of forecasts that were generated with time-domain models which were validated on left-out parts of the time series. The hybrid model is a combination of a neural network ensemble, an ensemble of nearest trajectory models and a model for the 7-day cycle. We apply this approach to the NN5 time series competition data set.     

Using weather ensemble predictions in electricity demand forecasting

Weather forecasts are an important input to many electricity demand forecasting models. This study investigates the use of weather ensemble predictions in electricity demand forecasting for lead times from 1 to 10 days ahead. A weather ensemble prediction consists of 51 scenarios for a weather variable. We use these scenarios to produce 51 scenarios for the weather-related component of electricity demand. The results show that the average of the demand scenarios is a more accurate demand forecast than that produced using traditional weather forecasts. We use the distribution of the demand scenarios to estimate the demand forecast uncertainty. This compares favourably with estimates produced using univariate volatility forecasting methods.     

Combining predictive distributions for the statistical post-processing of ensemble forecasts

Statistical post-processing techniques are now used widely for correcting systematic biases and errors in the calibration of ensemble forecasts obtained from multiple runs of numerical weather prediction models. A standard approach is the ensemble model output statistics (EMOS) method, which results in a predictive distribution that is given by a single parametric law, with parameters that depend on the ensemble members. This article assesses the merits of combining multiple EMOS models based on different parametric families. In four case studies with wind speed and precipitation forecasts from two ensemble prediction systems, we investigate the performances of state of the art forecast combination methods and propose a computationally efficient approach for determining linear pool combination weights. We study the performance of forecast combination compared to that of the theoretically superior but cumbersome estimation of a full mixture model, and assess which degree of flexibility of the forecast combination approach yields the best practical results for post-processing applications.     

Robust recurrent network model for intermittent time-series forecasting

This paper describes a deep-learning-based time-series forecasting method that was ranked third in the accuracy challenge of the M5 competition. We solved the problem using a deep-learning approach based on DeepAR, which is an auto-regressive recurrent network model conditioned on historical inputs. To address the intermittent and irregular characteristics of sales demand, we modified the training procedure of DeepAR; instead of using actual values for the historical inputs, our model uses values sampled from a trained distribution and feeds them to the network as past values. We obtained the final result using an ensemble of multiple models to make a robust and stable prediction. To appropriately select a model for the ensemble, each model was evaluated using the average weighted root mean squared scaled error, calculated for all levels of a wide range of past periods.     

MLP ensembles improve long term prediction accuracy over single networks

This work describes an award winning approach for solving the NN3 Forecasting Competition problem, focusing on the sound experimental validation of its main innovative feature. The NN3 forecasting task consisted of predicting 18 future values of 111 short monthly time series. The main feature of the approach was the use of the median for combining the forecasts of an ensemble of 15 MLPs to predict each time series. Experimental comparison to a single MLP shows that the ensemble increases the performance accuracy for multiple-step ahead forecasting. This system performed well on the withheld data, having finished as the second best solution of the competition with an SMAPE of 16.17%.     

A decomposition clustering ensemble learning approach for forecasting foreign exchange rates

A decomposition clustering ensemble (DCE) learning approach is proposed for forecasting foreign exchange rates by integrating the variational mode decomposition (VMD), the self-organizing map (SOM) network, and the kernel extreme learning machine (KELM). First, the exchange rate time series is decomposed into N subcomponents by the VMD method. Second, each subcomponent series is modeled by the KELM. Third, the SOM neural network is introduced to cluster the subcomponent forecasting results of the in-sample dataset to obtain cluster centers. Finally, each cluster's ensemble weight is estimated by another KELM, and the final forecasting results are obtained by the corresponding clusters' ensemble weights. The empirical results illustrate that our proposed DCE learning approach can significantly improve forecasting performance, and statistically outperform some other benchmark models in directional and level forecasting accuracy.     

Testing the predictive accuracy of COVID-19 forecasts

We test the predictive accuracy of forecasts of the number of COVID-19 fatalities produced by several forecasting teams and collected by the United States Centers for Disease Control and Prevention for the epidemic in the United States. We find three main results. First, at the short horizon (1 week ahead) no forecasting team outperforms a simple time-series benchmark. Second, at longer horizons (3 and 4 week ahead) forecasters are more successful and sometimes outperform the benchmark. Third, one of the best performing forecasts is the Ensemble forecast, that combines all available predictions using uniform weights. In view of these results, collecting a wide range of forecasts and combining them in an ensemble forecast may be a superior approach for health authorities, rather than relying on a small number of forecasts.     

Ensemble RBF modeling technique for quality design

This paper proposes an ensemble radial basis function neural network that selects important RBF subsets based on Pareto chart using Bootstrap samples. Then, the analysis of variance method is used to determine the choice of the unequal/equal weights. The effectiveness of the proposed technique is illustrated with a micro-drilling process. The comparison results show that the proposed technique can not only improve the model prediction performance, but also generate a reliable scheme for quality design.     

ARIMA融合神经网络的人民币汇率预测模型研究

本文在深入分析了单整自回归移动平均(ARIMA)模型与神经网络(NN)模型特点的基础上,建立了ARIMA融合NN的人民币汇率时间序列预测模型。其基本思想是充分发挥两种模型在线性空间和非线性空间的预测优势,即将汇率时间序列的数据结构分解为线性自相关主体和非线性残差两部分,首先用ARI-MA模型预测序列的线性主体,然后用NN模型对其非线性残差进行估计,最终合成为整个序列的预测结果。通过对三种人民币汇率序列的仿真实验表明,融合模型的预测准确率显著高于包括随机游走模型在内的单一模型的预测准确率,从而证实了融合模型用于汇率预测的有效性。这一结果也表明,人民币汇率市场并不符合有效市场假设,可以通过模型对汇率未来走势做出较准确预测。     

Measuring output gap nowcast uncertainty

We propose a methodology for gauging the uncertainty in output gap nowcasts across a large number of commonly-deployed vector autoregressive (VAR) specifications for inflation and the output gap. Our approach utilises many output gap measures to construct ensemble nowcasts for inflation using a linear opinion pool. The predictive densities for the latent output gap utilise weights based on the ability of each specification to provide accurate probabilistic forecasts of inflation. In an application based on US real-time data, nowcasting over the out-of-sample evaluation period from 1991q2 to 2010q1, we demonstrate that a system of bivariate VARs produces well-calibrated ensemble densities for inflation, in contrast to univariate autoregressive benchmarks. The implied nowcast densities for the output gap are multimodal and indicate a considerable degree of uncertainty. For example, we assess the probability of a negative output gap at around 45% between 2004 and 2007. Despite the Greenspan policy regime, there still remained a substantial risk that the nowcast for output was below potential in real time. We extend our methodology to include distinct output gap measures, based on alternative filters, and show that, in our application, the nowcast density for the output gap is sensitive to the detrending method.     

An ensemble approach to GEFCom2017 probabilistic load forecasting

We present an ensembling approach to medium-term probabilistic load forecasting which ranked second out of 73 competitors in the defined data track of the GEFCom2017 qualifying match. In addition to being accurate, the ensemble method is highly scalable, due to the fact that it had to be applied to nine quantiles in ten zones and for six rounds. Candidate forecasts were generated using random settings for input data, covariates, and learning algorithms. The best candidate forecasts were averaged to create the final forecast, with the number of candidate forecasts being chosen based on their accuracy in similar validation periods.     

项目驱动法在高职制图学习领域中的实践探索

提出项目驱动教学法在制图学习领域的可行性措施和效果分析,探索项目驱动教学法实施过程的规律,对项目驱动下的制图学习领域整体设计、内容整体优化、教学内容序化和教学组织等方面进行了有益探究。     

Fast and accurate yearly time series forecasting with forecast combinations

It has long been known that combination forecasting strategies produce superior out-of-sample forecasting performances. In the M4 forecasting competition, a very simple forecast combination strategy achieved third place on yearly time series. An analysis of the ensemble model and its component models suggests that the competitive accuracy comes from avoiding poor forecasts, rather than from beating the best individual models. Moreover, the simple ensemble model can be fitted very quickly, can easily scale horizontally with additional CPU cores or a cluster of computers, and can be implemented by users very quickly and easily. This approach might be of particular interest to users who need accurate yearly forecasts without being able to spend significant time, resources, or expertise on tuning models. Users of the R statistical programming language can access this modeling approach using the “forecastHybrid” package.     

Modelling Group Heterogeneity for Small Area Estimation Using M‐Quantiles

Small area estimation typically requires model‐based methods that depend on isolating the contribution to overall population heterogeneity associated with group (i.e. small area) membership. One way of doing this is via random effects models with latent group effects. Alternatively, one can use an M‐quantile ensemble model that assigns indices to sampled individuals characterising their contribution to overall sample heterogeneity. These indices are then aggregated to form group effects. The aim of this article is to contrast these two approaches to characterising group effects and to illustrate them in the context of small area estimation. In doing so, we consider a range of different data types, including continuous data, count data and binary response data.