Online hierarchical forecasting for power consumption data

This paper proposes a three-step approach to forecasting time series of electricity consumption at different levels of household aggregation. These series are linked by hierarchical constraints—global consumption is the sum of regional consumption, for example. First, benchmark forecasts are generated for all series using generalized additive models. Second, for each series, the aggregation algorithm ML-Poly, introduced by Gaillard, Stoltz, and van Erven in 2014, finds an optimal linear combination of the benchmarks. Finally, the forecasts are projected onto a coherent subspace to ensure that the final forecasts satisfy the hierarchical constraints. By minimizing a regret criterion, we show that the aggregation and projection steps improve the root mean square error of the forecasts. Our approach is tested on household electricity consumption data; experimental results suggest that successive aggregation and projection steps improve the benchmark forecasts at different levels of household aggregation.     

Time Series Based Errors and Empirical Errors in Fertility Forecasts in the Nordic Countries*

We use ARCH time series models to derive model based prediction intervals for the Total Fertility Rate (TFR) in Norway, Sweden, Finland, and Denmark up to 2050. For the short term (5–10 yrs), expected TFR‐errors are compared with empirical forecast errors observed in historical population forecasts prepared by the statistical agencies in these countries since 1969. Medium‐term and long‐term (up to 50 years) errors are compared with error patterns based on so‐called naïve forecasts, i.e. forecasts that assume that recently observed TFR‐levels also apply for the future.     

INTERFUEL SUBSTITUTION: A META‐ANALYSIS

Abstract This paper provides the first meta‐analysis of the interfuel substitutability literature. The sample includes 47 studies of interfuel substitution in the industrial sector, in manufacturing industry or manufacturing sub‐industries, or in the macro‐economy of a variety of developed and developing countries. Meta‐regressions are estimated for the six shadow elasticities of substitution between coal, oil, gas and electricity. I find that at the level of the industrial sector as a whole the oil–coal, oil–gas, oil–electricity and gas–electricity shadow elasticities of substitution are significantly greater than unity. The remaining elasticities – between coal and gas and coal and electricity – are insignificantly different from unity or zero due to their large standard errors. Substitution possibilities seem more constrained at the macro level and less constrained at lower levels of aggregation. Estimates of the elasticities of substitution from cross‐section regressions are generally largest whereas fixed effects panel estimates are intermediate in magnitude, and time‐series estimates are mostly much smaller. In order to obtain more precise and less biased estimates of long‐run elasticities of substitution, there is a need for additional primary studies using large samples and/or the between estimator which econometric research suggests is likely to provide the best estimates of long‐run elasticities.     

Forecasting Macroeconomic Labour Market Flows: What Can We Learn from Micro‐level Analysis?

Forecasting labour market flows is important for budgeting and decision‐making in government departments and public administration. Macroeconomic forecasts are normally obtained from time series data. In this article, we follow another approach that uses individual‐level statistical analysis to predict the number of exits out of unemployment insurance claims. We present a comparative study of econometric, actuarial and statistical methodologies that base on different data structures. The results with records of the German unemployment insurance suggest that prediction based on individual‐level statistical duration analysis constitutes an interesting alternative to aggregate data‐based forecasting. In particular, forecasts of up to six months ahead are surprisingly precise and are found to be more precise than considered time series forecasts.     

Forecast Pooling for European Macroeconomic Variables*

We compare alternative forecast pooling methods and 58 forecasts from linear, time‐varying and non‐linear models, using a very large dataset of about 500 macroeconomic variables for the countries in the European Monetary Union. On average, combination methods work well but single non‐linear models can outperform them for several series. The performance of pooled forecasts, and of non‐linear models, improves when focusing on a subset of unstable series, but the gains are minor. Finally, on average over the EMU countries, the pooled forecasts behave well for industrial production growth, unemployment and inflation, but they are often beaten by non‐linear models for each country and variable.     

Subjective evaluation of composite econometric policy inputs

Studies have suggested that a composite forecast may be preferred to a single forecast. In addition, forecasting objectives are often conflicting. For example, one forecast may have the smallest sum of absolute forecast errors, while another has the smallest maximum absolute error. This paper examines the appropriateness of using multiple objective linear programming to determine weighted linear combinations of forecasts to be used as inputs for policy analysis. An example is presented where the methodology is used to combine the forecasts for several policy variables. The forecasts are selected from large econometric, consensus, and univariate time series models.     

The tourism forecasting competition

We evaluate the performances of various methods for forecasting tourism data. The data used include 366 monthly series, 427 quarterly series and 518 annual series, all supplied to us by either tourism bodies or academics who had used them in previous tourism forecasting studies. The forecasting methods implemented in the competition are univariate and multivariate time series approaches, and econometric models. This forecasting competition differs from previous competitions in several ways: (i) we concentrate on tourism data only; (ii) we include approaches with explanatory variables; (iii) we evaluate the forecast interval coverage as well as the point forecast accuracy; (iv) we observe the effect of temporal aggregation on the forecasting accuracy; and (v) we consider the mean absolute scaled error as an alternative forecasting accuracy measure. We find that pure time series approaches provide more accurate forecasts for tourism data than models with explanatory variables. For seasonal data we implement three fully automated pure time series algorithms that generate accurate point forecasts, and two of these also produce forecast coverage probabilities which are satisfactorily close to the nominal rates. For annual data we find that Naïve forecasts are hard to beat.     

CONSTRUCTING OPTIMAL DENSITY FORECASTS FROM POINT FORECAST COMBINATIONS

Decision makers often observe point forecasts of the same variable computed, for instance, by commercial banks, IMF and the World Bank, but the econometric models used by such institutions are frequently unknown. This paper shows how to use the information available on point forecasts to compute optimal density forecasts. Our idea builds upon the combination of point forecasts under general loss functions and unknown forecast error distributions. We use real‐time data to forecast the density of US inflation. The results indicate that the proposed method materially improves the real‐time accuracy of density forecasts vis‐à‐vis those from the (unknown) individual econometric models. Copyright © 2013 John Wiley & Sons, Ltd.     

Inversion copulas from nonlinear state space models with an application to inflation forecasting

We propose the construction of copulas through the inversion of nonlinear state space models. These copulas allow for new time series models that have the same serial dependence structure as a state space model, but with an arbitrary marginal distribution, and flexible density forecasts. We examine the time series properties of the copulas, outline serial dependence measures, and estimate the models using likelihood-based methods. Copulas constructed from three example state space models are considered: a stochastic volatility model with an unobserved component, a Markov switching autoregression, and a Gaussian linear unobserved component model. We show that all three inversion copulas with flexible margins improve the fit and density forecasts of quarterly U.S. broad inflation and electricity inflation.     

Forecasting electricity prices using bid data

Market liberalization and the expansion of variable renewable energy sources in power systems have made the dynamics of electricity prices more uncertain, leading them to show high volatility with sudden, unexpected price spikes. Thus, developing more accurate price modeling and forecasting techniques is a challenge for all market participants and regulatory authorities. This paper proposes a forecasting approach based on using auction data to fit supply and demand electricity curves. More specifically, we fit linear (LinX-Model) and logistic (LogX-Model) curves to historical sale and purchase bidding data from the Iberian electricity market to estimate structural parameters from 2015 to 2019. Then we use time series models on structural parameters to predict day-ahead prices. Our results provide a solid framework for forecasting electricity prices by capturing the structural characteristics of markets.     

Experience curve models in the electricity supply industry

There has been much controversy over the use of the Experience Curve for forecasting purposes. The Experience Curve model has been criticised both on theoretical grounds and because of the practical problems of using it. An alternative model of experience effects due to Towill has certain attractions from the standpoint of theory. However, a rather deeper question is whether experience curve type models produce superior forecasts to those derived using extrapolative techniques.This paper examines these questions in the context of three time series taken from the electricity supply industry, viz: average thermal efficiency; works costs; and price of electricity. The two latter series require price deflation. Both the implied GDP consumption deflator, and a wholesale price index for fuel and electricity were used for this purpose. It is argued that because of the absence of substitutes and of the effects of competition, along with the high quality of data available on the electricity supply industry, these three series provide a favourable test of the experience curve approach to forecasting. The two experience curves performed on the whole markedly worse than the simpler extrapolative methods on the two financial series examined. For the average thermal efficiency series the Towill model and the Experience Curve model marginally outperformed the extrapolative methods.Overall, there was little support for using either the Experience Curve or Towill models. These are obviously more difficult to use than simple univariate models and do not provide significantly better forecasts. Moreover, the Towill model gave rise to considerable estimation and specification problems with the data used here.     

Combination of long term and short term forecasts, with application to tourism demand forecasting

Forecast combination is a well-established and well-tested approach for improving the forecasting accuracy. One beneficial strategy is to use constituent forecasts that have diverse information. In this paper we consider the idea of diversity being accomplished by using different time aggregations. For example, we could create a yearly time series from a monthly time series and produce forecasts for both, then combine the forecasts. These forecasts would each be tracking the dynamics of different time scales, and would therefore add diverse types of information. A comparison of several forecast combination methods, performed in the context of this setup, shows that this is indeed a beneficial strategy and generally provides a forecasting performance that is better than the performances of the individual forecasts that are combined.As a case study, we consider the problem of forecasting monthly tourism numbers for inbound tourism to Egypt. Specifically, we consider 33 individual source countries, as well as the aggregate. The novel combination strategy also produces a generally improved forecasting accuracy.     

Modelling and Forecasting Fiscal Variables for the Euro Area*

In this paper, we assess the possibility of producing unbiased forecasts for fiscal variables in the Euro area by comparing a set of procedures that rely on different information sets and econometric techniques. In particular, we consider autoregressive moving average models, Vector autoregressions, small‐scale semistructural models at the national and Euro area level, institutional forecasts (Organization for Economic Co‐operation and Development), and pooling. Our small‐scale models are characterized by the joint modelling of fiscal and monetary policy using simple rules, combined with equations for the evolution of all the relevant fundamentals for the Maastricht Treaty and the Stability and Growth Pact. We rank models on the basis of their forecasting performance using the mean square and mean absolute error criteria at different horizons. Overall, simple time‐series methods and pooling work well and are able to deliver unbiased forecasts, or slightly upward‐biased forecast for the debt–GDP dynamics. This result is mostly due to the short sample available, the robustness of simple methods to structural breaks, and to the difficulty of modelling the joint behaviour of several variables in a period of substantial institutional and economic changes. A bootstrap experiment highlights that, even when the data are generated using the estimated small‐scale multi‐country model, simple time‐series models can produce more accurate forecasts, because of their parsimonious specification.     

Selling prices and profits: what survey data tell about firms’ rationality

This paper states that the strong biases found in survey expectations do not necessarily distort economic decisions. An econometric analysis of price and profit data suggests that Swiss manufacturers do not base their production decisions on the forecasts they supply to the surveying institution. Instead, production decisions are based on data of past prices. This suggests that in their production management, firms make adjustments for biased marketing projections of selling prices. However, the practice of these adjustments is not optimal since it neglects the valuable information contained in these price forecasts. Copyright © 1999 John Wiley & Sons, Ltd.     

Econometric Models and Economic Forecasting

This Briefing Paper is thejirst ofa series of three designeddiscussed is the process of making 'constant adjustments' in forecasts. This process involves modifying the results generated by the econometric model. For the first time we are publishing tables of the constant adjustments used in the current forecast. We explain in general why such adjustments are made and also explain the actual adjustments we have made for this forecast.
The second article of the series, to be published in our February 1983 edition, will describe the potential sources of error in forecasts. In particular it will describe the inevitable stochastic or random element involved in e tatistical attempts to quantify economic behaviour. As a completely new departure the article will report estimates of future errors based on stochastic simulations of the LBS. model and will provide statistical error bad for the main elements of the forecast.
The final article, to be published in our June 1983 edition, will contrast the measures of forecast error that e e obtain from the estimation process and our stochastic e imulationsp with the errors that we have actually made, as revealed by an examination of our forecasting 'track record'. It is hoped to draw, from this comparison, some e eneral conclusions about the scope and limits of econometric forecasting producers.     

Forecasting with nonstationary dynamic factor models

In this paper we analyze the structure and the forecasting performance of the dynamic factor model. It is shown that the forecasts obtained by the factor model imply shrinkage pooling terms, similar to the ones obtained from hierarchical Bayesian models that have been applied successfully in the econometric literature. Thus, the results obtained in this paper provide an additional justification for these and other types of pooling procedures. The expected decrease in MSE for using a factor model versus univariate ARIMA and shrinkage models are studied for the one factor model. Monte Carlo simulations are presented to illustrate this result. A factor model is also built to forecast GNP of European countries and it is shown that the factor model can provide a substantial improvement in forecasts with respect to both univariate and shrinkage univariate forecasts.     

EVALUATING MACROECONOMIC FORECASTS: A CONCISE REVIEW OF SOME RECENT DEVELOPMENTS

Macroeconomic forecasts are frequently produced, widely published, intensively discussed, and comprehensively used. The formal evaluation of such forecasts has a long research history. Recently, a new angle to the evaluation of forecasts has been addressed, and in this review we analyze some recent developments from that perspective. The literature on forecast evaluation predominantly assumes that macroeconomic forecasts are generated from econometric models. In practice, however, most macroeconomic forecasts, such as those from the IMF, World Bank, OECD, Federal Reserve Board, Federal Open Market Committee (FOMC), and the ECB, are typically based on econometric model forecasts jointly with human intuition. This seemingly inevitable combination renders most of these forecasts biased and, as such, their evaluation becomes nonstandard. In this review, we consider the evaluation of two forecasts in which: (i) the two forecasts are generated from two distinct econometric models; (ii) one forecast is generated from an econometric model and the other is obtained as a combination of a model and intuition; and (iii) the two forecasts are generated from two distinct (but unknown) combinations of different models and intuition. It is shown that alternative tools are needed to compare and evaluate the forecasts in each of these three situations. These alternative techniques are illustrated by comparing the forecasts from the (econometric) Staff of the Federal Reserve Board and the FOMC on inflation, unemployment, and real GDP growth. It is shown that the FOMC does not forecast significantly better than the Staff, and that the intuition of the FOMC does not add significantly in forecasting the actual values of the economic fundamentals. This would seem to belie the purported expertise of the FOMC.     

Forecasting automobile insurance paid claim costs using econometric and ARIMA models

Automobile insurance companies in the United States currently utilize simple exponential trend models to forecast paid claim costs, an important variable in ratemaking. This paper tests the performance of econometric and ARIMA models, as well as the current insurance industry method, in forecasting two paid claim cost series. The experiments encompass eight forecast periods ranging from 1974 through early 1983. The results indicate that automobile insurers could significantly improve their forecasts of property damage liability claim costs by adopting econometric models. For bodily injury liability claim costs, the accuracy of the econometric and insurance industry methods is approximately the same, and both outperform the ARIMA models. Overall, a net gain in accuracy could be achieved by adopting econometric models.     

Consumption patterns for electricity

A substantial body of literature in economics has focused on appropriate pricing under conditions in which demand varies through time and the product supplied cannot be stored. However, only limited attention has been paid to modeling or estimating consumer demand under these conditions. This paper deals with these issues in the context of the demand for electricity. A periodic cubic spline formulation is presented which bridges the gap between econometric and pure time series methods of estimating the path of demand through time.