Elman网络在短期负荷预测中的应用

文章介绍的Elman神经网络的短期负荷预测模型,具有模型简单、运算效率高的特点,并具有较好的全局最优性能,从而很好地克服了传统BP算法容易陷入局部极小点的缺陷。文章还比较了Elman网络和BP网络结构的建模效果。通过仿真实验证明了Elman神经网络具有动态特性好、逼近速度快、精度高等特点,是一种实用、可靠的负荷预测方法。     

A hybrid machine learning model for forecasting a billing period’s peak electric load days

Many models have been studied for forecasting the peak electric load, but studies focusing on forecasting peak electric load days for a billing period are scarce. This focus is highly relevant to consumers, as their electricity costs are determined based not only on total consumption, but also on the peak load required during a period. Forecasting these peak days accurately allows demand response actions to be planned and executed efficiently in order to mitigate these peaks and their associated costs. We propose a hybrid model based on ARIMA, logistic regression and artificial neural networks models. This hybrid model evaluates the individual results of these statistical and machine learning models in order to forecast whether a given day will be a peak load day for the billing period. The proposed model predicted 70% (40/57) of actual peak load days accurately and revealed potential savings of approximately USD $80,000 for an American university during a one-year testing period.     

Text-based crude oil price forecasting: A deep learning approach

This study proposes a new, novel crude oil price forecasting method based on online media text mining, with the aim of capturing the more immediate market antecedents of price fluctuations. Specifically, this is an early attempt to apply deep learning techniques to crude oil forecasting, and to extract hidden patterns within online news media using a convolutional neural network (CNN). While the news-text sentiment features and the features extracted by the CNN model reveal significant relationships with the price change, they need to be grouped according to their topics in the price forecasting in order to obtain a greater forecasting accuracy. This study further proposes a feature grouping method based on the Latent Dirichlet Allocation (LDA) topic model for distinguishing effects from various online news topics. Optimized input variable combination is constructed using lag order selection and feature selection methods. Our empirical results suggest that the proposed topic-sentiment synthesis forecasting models perform better than the older benchmark models. In addition, text features and financial features are shown to be complementary in producing more accurate crude oil price forecasts.     

Data visualization and forecast combination for probabilistic load forecasting in GEFCom2017 final match

This paper describes the methods used by Team Cassandra, a joint effort between IBM Research Australia and the University of Melbourne, in the GEFCom2017 load forecasting competition. An important first phase in the forecasting effort involved a deep exploration of the underlying dataset. Several data visualisation techniques were applied to help us better understand the nature and size of gaps, outliers, the relationships between different entities in the dataset, and the relevance of custom date ranges. Improved, cleaned data were then used to train multiple probabilistic forecasting models. These included a number of standard and well-known approaches, as well as a neural-network based quantile forecast model that was developed specifically for this dataset. Finally, model selection and forecast combination were used to choose a custom forecasting model for every entity in the dataset.     

基于回归BP神经网络的短期负荷预测

负荷的形成受多方面因素的影响,在建立短期负荷预测模型时,需要综合考虑多种因素。同时,负荷是一种时间序列信号,目前的数据能够对以后的数据产生重要的影响,所以文章采用回归BP神经网络模型应用于短期负荷预测。实例计算表明,该方法有效,预测精度比常规方法高,收敛性好,运算速度快。     

A hybrid method of exponential smoothing and recurrent neural networks for time series forecasting

This paper presents the winning submission of the M4 forecasting competition. The submission utilizes a dynamic computational graph neural network system that enables a standard exponential smoothing model to be mixed with advanced long short term memory networks into a common framework. The result is a hybrid and hierarchical forecasting method.     

Forecasting CPI inflation components with Hierarchical Recurrent Neural Networks

We present a hierarchical architecture based on recurrent neural networks for predicting disaggregated inflation components of the Consumer Price Index (CPI). While the majority of existing research is focused on predicting headline inflation, many economic and financial institutions are interested in its partial disaggregated components. To this end, we developed the novel Hierarchical Recurrent Neural Network (HRNN) model, which utilizes information from higher levels in the CPI hierarchy to improve predictions at the more volatile lower levels. Based on a large dataset from the US CPI-U index, our evaluations indicate that the HRNN model significantly outperforms a vast array of well-known inflation prediction baselines. Our methodology and results provide additional forecasting measures and possibilities to policy and market makers on sectoral and component-specific price changes.     

Kaggle forecasting competitions: An overlooked learning opportunity

We review the results of six forecasting competitions based on the online data science platform Kaggle, which have been largely overlooked by the forecasting community. In contrast to the M competitions, the competitions reviewed in this study feature daily and weekly time series with exogenous variables, business hierarchy information, or both. Furthermore, the Kaggle data sets all exhibit higher entropy than the M3 and M4 competitions, and they are intermittent.In this review, we confirm the conclusion of the M4 competition that ensemble models using cross-learning tend to outperform local time series models and that gradient boosted decision trees and neural networks are strong forecast methods. Moreover, we present insights regarding the use of external information and validation strategies, and discuss the impacts of data characteristics on the choice of statistics or machine learning methods. Based on these insights, we construct nine ex-ante hypotheses for the outcome of the M5 competition to allow empirical validation of our findings.     

Quantile regression for the qualifying match of GEFCom2017 probabilistic load forecasting

We present a simple quantile regression-based forecasting method that was applied in the probabilistic load forecasting framework of the Global Energy Forecasting Competition 2017 (GEFCom2017). The hourly load data are log transformed and split into a long-term trend component and a remainder term. The key forecasting element is the quantile regression approach for the remainder term, which takes into account both weekly and annual seasonalities, such as their interactions. Temperature information is used only for stabilizing the forecast of the long-term trend component. Information on public holidays is ignored. However, the forecasting method still placed second in the open data track and fourth in the definite data track, which is remarkable given the simplicity of the model. The method also outperforms the Vanilla benchmark consistently.     

Machine learning methods for GEFCom2017 probabilistic load forecasting

This paper describes the preprocessing and forecasting methods used by team Orbuculum during the qualifying match of the Global Energy Forecasting Competition 2017 (GEFCom2017). Tree-based algorithms (gradient boosting and quantile random forest) and neural networks made up an ensemble. The ensemble prediction quantiles were obtained by a simple averaging of the ensemble members’ prediction quantiles. The result shows a robust performance according to the pinball loss metric, with the ensemble model achieving third place in the qualifying match of the competition.     

Benchmarking robustness of load forecasting models under data integrity attacks

As the internet’s footprint continues to expand, cybersecurity is becoming a major concern for both governments and the private sector. One such cybersecurity issue relates to data integrity attacks. This paper focuses on the power industry, where the forecasting processes rely heavily on the quality of the data. Data integrity attacks are expected to harm the performances of forecasting systems, which will have a major impact on both the financial bottom line of power companies and the resilience of power grids. This paper reveals the effect of data integrity attacks on the accuracy of four representative load forecasting models (multiple linear regression, support vector regression, artificial neural networks, and fuzzy interaction regression). We begin by simulating some data integrity attacks through the random injection of some multipliers that follow a normal or uniform distribution into the load series. Then, the four aforementioned load forecasting models are used to generate one-year-ahead ex post point forecasts in order to provide a comparison of their forecast errors. The results show that the support vector regression model is most robust, followed closely by the multiple linear regression model, while the fuzzy interaction regression model is the least robust of the four. Nevertheless, all four models fail to provide satisfying forecasts when the scale of the data integrity attacks becomes large. This presents a serious challenge to both load forecasters and the broader forecasting community: the generation of accurate forecasts under data integrity attacks. We construct our case study using the publicly-available data from Global Energy Forecasting Competition 2012. At the end, we also offer an overview of potential research topics for future studies.     

Forecasting exchange rates using feedforward and recurrent neural networks

In this paper we investigate the out-of-sample forecasting ability of feedforward and recurrent neural networks based on empirical foreign exchange rate data. A two-step procedure is proposed to construct suitable networks, in which networks are selected based on the predictive stochastic complexity (PSC) criterion, and the selected networks are estimated using both recursive Newton algorithms and the method of nonlinear least squares. Our results show that PSC is a sensible criterion for selecting networks and for certain exchange rate series, some selected network models have significant market timing ability and/or significantly lower out-of-sample mean squared prediction error relative to the random walk model.     

基于神经网络集成的失业预警方法

提出采用神经网络集成技术对中国失业预警系统进行建模,以克服当前失业预警系统建模中存在的小样本、高维度、非线性、噪音数据等难题。采用BP神经网络回归模型对失业率进行预测;基于两种集成技术Bagging与AdaBoost对多个神经网络进行集成,以获得比单个预测模型更好的精度与稳定性;最后基于广东省的社会经济调查数据进行了实证分析,实验结果表明:在对失业率的预测上,Bagging集成方法的预测效果优于Adaboost集成方法,也优于单个最好的神经网络模型。     

公路运输货运量预测方法研究

介绍了国内外公路运输货运量的预测方法,分析各种预测方法的优缺点,以及实际的预测效果。针对公路运输货运量受很多相关因素的影响,使得现有的一些预测方法预测精度不高的问题,应用混沌神经网络,建立了公路运输货运量预测的混沌神经网络预测模型,并与传统的BP神经网络预测结果对比,表明此模型具有较好的预测效果。     

Dynamic logistic regression and variable selection: Forecasting and contextualizing civil unrest

Civil unrest can range from peaceful protest to violent furor, and researchers are working to monitor, forecast, and assess such events to allocate resources better. Twitter has become a real-time data source for forecasting civil unrest because millions of people use the platform as a social outlet. Daily word counts are used as model features, and predictive terms contextualize the reasons for the protest. To forecast civil unrest and infer the reasons for the protest, we consider the problem of Bayesian variable selection for the dynamic logistic regression model and propose using penalized credible regions to select parameters of the updated state vector. This method avoids the need for shrinkage priors, is scalable to high-dimensional dynamic data, and allows the importance of variables to vary in time as new information becomes available. A substantial improvement in both precision and F1-score using this approach is demonstrated through simulation. Finally, we apply the proposed model fitting and variable selection methodology to the problem of forecasting civil unrest in Latin America. Our dynamic logistic regression approach shows improved accuracy compared to the static approach currently used in event prediction and feature selection.     

基于粒子群优化算法(PSO)的电力需求预测分析

在电力需求预测领域,本文提出了基于粒子群优化算法(PSO)的组合预测模型,选用灰色GM(1,1)模型和BP神经网络作为单个预测模型,并在BP神经网络中将GDP指标做为输入。同时考虑了GDP对电力需求的影响,最后利用PSO对组合预测模型中的权系数进行优化以得到最优结果。根据真实数据所做对比,本文所提出的PSO算法在预测精度上较单一预测模型相比有了较大幅度的提高。     

Leading Indicators for Euro‐area Inflation and GDP Growth*

In this paper, we evaluate the role of a set of variables as leading indicators for Euro‐area inflation and GDP growth. Our leading indicators are taken from the variables in the European Central Bank's (ECB) Euro‐area‐wide model database, plus a set of similar variables for the US. We compare the forecasting performance of each indicator ex post with that of purely autoregressive models. We also analyse three different approaches to combining the information from several indicators. First, ex post, we discuss the use as indicators of the estimated factors from a dynamic factor model for all the indicators. Secondly, within an ex ante framework, an automated model selection procedure is applied to models with a large set of indicators. No future information is used, future values of the regressors are forecast, and the choice of the indicators is based on their past forecasting records. Finally, we consider the forecasting performance of groups of indicators and factors and methods of pooling the ex ante single‐indicator or factor‐based forecasts. Some sensitivity analyses are also undertaken for different forecasting horizons and weighting schemes of forecasts to assess the robustness of the results.     

Blending gradient boosted trees and neural networks for point and probabilistic forecasting of hierarchical time series

In this study, we addressed the problem of point and probabilistic forecasting by describing a blending methodology for machine learning models from the gradient boosted trees and neural networks families. These principles were successfully applied in the recent M5 Competition in both the Accuracy and Uncertainty tracks. The key points of our methodology are: (a) transforming the task into regression on sales for a single day; (b) information-rich feature engineering; (c) creating a diverse set of state-of-the-art machine learning models; and (d) carefully constructing validation sets for model tuning. We show that the diversity of the machine learning models and careful selection of validation examples are most important for the effectiveness of our approach. Forecasting data have an inherent hierarchical structure (12 levels) but none of our proposed solutions exploited the hierarchical scheme. Using the proposed methodology, we ranked within the gold medal range in the Accuracy track and within the prizes in the Uncertainty track. Inference code with pre-trained models are available on GitHub.¹     

人工神经网络用于短期电力负荷预测网络结构初探

目前,在电力系统短期负荷预测的手段中,已由人工预测方式逐步被软件预测方式所代替。BP人工神经网络是最常用的建立负荷预测模型的工具之一,文章对建立电力负荷BP神经网络预测模型（网络结构）进行了讨论。     

Rethinking weather station selection for electric load forecasting using genetic algorithms

Demand forecasting is and has been for years a topic of great interest in the electricity sector, being the temperature one of its major drivers. Indeed, one of the challenges when modelling the load is to choose the right weather station, or set of stations, for a given load time series. However, only a few research papers have been devoted to this topic. This paper reviews the most relevant methods that were applied during the Global Energy Forecasting Competition of 2014 (GEFCom2014) and presents a new approach to weather station selection, based on Genetic Algorithms (GA), which allows finding the best set of stations for any demand forecasting model, and outperforms the results of existing methods. Furthermore its performance has also been tested using GEFCom2012 data, providing significant error improvements. Finally, the possibility of combining the weather stations selected by the proposed GA using the BFGS algorithm is briefly tested, providing promising results.