The tourism forecasting competition

We evaluate the performances of various methods for forecasting tourism data. The data used include 366 monthly series, 427 quarterly series and 518 annual series, all supplied to us by either tourism bodies or academics who had used them in previous tourism forecasting studies. The forecasting methods implemented in the competition are univariate and multivariate time series approaches, and econometric models. This forecasting competition differs from previous competitions in several ways: (i) we concentrate on tourism data only; (ii) we include approaches with explanatory variables; (iii) we evaluate the forecast interval coverage as well as the point forecast accuracy; (iv) we observe the effect of temporal aggregation on the forecasting accuracy; and (v) we consider the mean absolute scaled error as an alternative forecasting accuracy measure. We find that pure time series approaches provide more accurate forecasts for tourism data than models with explanatory variables. For seasonal data we implement three fully automated pure time series algorithms that generate accurate point forecasts, and two of these also produce forecast coverage probabilities which are satisfactorily close to the nominal rates. For annual data we find that Naïve forecasts are hard to beat.     

Forecasting economic and financial variables with global VARs

This paper considers the problem of forecasting economic and financial variables across a large number of countries in the global economy. To this end a global vector autoregressive (GVAR) model, previously estimated by Dees, di Mauro, Pesaran, and Smith (2007) and Dees, Holly, Pesaran, and Smith (2007) over the period 1979Q1–2003Q4, is used to generate out-of-sample forecasts one and four quarters ahead for real output, inflation, real equity prices, exchange rates and interest rates over the period 2004Q1–2005Q4. Forecasts are obtained for 134 variables from 26 regions, which are made up of 33 countries and cover about 90% of the world output. The forecasts are compared to typical benchmarks: univariate autoregressive and random walk models. Building on the forecast combination literature, the effects of model and estimation uncertainty on forecast outcomes are examined by pooling forecasts obtained from different GVAR models estimated over alternative sample periods. Given the size of the modelling problem, and the heterogeneity of the economies considered–industrialised, emerging, and less developed countries–as well as the very real likelihood of possibly multiple structural breaks, averaging forecasts across both models and windows makes a significant difference. Indeed, the double-averaged GVAR forecasts perform better than the benchmark competitors, especially for output, inflation and real equity prices.     

Forecasting cryptocurrencies under model and parameter instability

This paper studies the predictability of cryptocurrency time series. We compare several alternative univariate and multivariate models for point and density forecasting of four of the most capitalized series: Bitcoin, Litecoin, Ripple and Ethereum. We apply a set of crypto-predictors and rely on dynamic model averaging to combine a large set of univariate dynamic linear models and several multivariate vector autoregressive models with different forms of time variation. We find statistically significant improvements in point forecasting when using combinations of univariate models, and in density forecasting when relying on the selection of multivariate models. Both schemes deliver sizable directional predictability.     

Forecasting macroeconomic variables using collapsed dynamic factor analysis

We explore a new approach to the forecasting of macroeconomic variables based on a dynamic factor state space analysis. Key economic variables are modeled jointly with principal components from a large time series panel of macroeconomic indicators using a multivariate unobserved components time series model. When the key economic variables are observed at a low frequency and the panel of macroeconomic variables is at a high frequency, we can use our approach for both nowcasting and forecasting purposes. Given a dynamic factor model as the data generation process, we provide Monte Carlo evidence of the finite-sample justification of our parsimonious and feasible approach. We also provide empirical evidence for a US macroeconomic dataset. The unbalanced panel contains quarterly and monthly variables. The forecasting accuracy is measured against a set of benchmark models. We conclude that our dynamic factor state space analysis can lead to higher levels of forecasting precision when the panel size and time series dimensions are moderate.     

Investigating the accuracy of cross-learning time series forecasting methods

The M4 competition identified innovative forecasting methods, advancing the theory and practice of forecasting. One of the most promising innovations of M4 was the utilization of cross-learning approaches that allow models to learn from multiple series how to accurately predict individual ones. In this paper, we investigate the potential of cross-learning by developing various neural network models that adopt such an approach, and we compare their accuracy to that of traditional models that are trained in a series-by-series fashion. Our empirical evaluation, which is based on the M4 monthly data, confirms that cross-learning is a promising alternative to traditional forecasting, at least when appropriate strategies for extracting information from large, diverse time series data sets are considered. Ways of combining traditional with cross-learning methods are also examined in order to initiate further research in the field.     

When was the U.S. housing downturn predictable? A comparison of univariate forecasting methods

This paper uses three classes of univariate time series techniques (ARIMA type models, switching regression models, and state-space/structural time series models) to forecast, on an ex post basis, the downturn in U.S. housing prices starting around 2006. The performance of the techniques is compared within each class and across classes by out-of-sample forecasts for a number of different forecast points prior to and during the downturn. Most forecasting models are able to predict a downturn in future home prices by mid 2006. Some state-space models can predict an impending downturn as early as June 2005. State-space/structural time series models tend to produce the most accurate forecasts, although they are not necessarily the models with the best in-sample fit.     

Short‐Term Wind Speed Forecasting for Power System Operations

The emphasis on renewable energy and concerns about the environment have led to large‐scale wind energy penetration worldwide. However, there are also significant challenges associated with the use of wind energy due to the intermittent and unstable nature of wind. High‐quality short‐term wind speed forecasting is critical to reliable and secure power system operations. This article begins with an overview of the current status of worldwide wind power developments and future trends. It then reviews some statistical short‐term wind speed forecasting models, including traditional time series approaches and more advanced space–time statistical models. It also discusses the evaluation of forecast accuracy, in particular, the need for realistic loss functions. New challenges in wind speed forecasting regarding ramp events and offshore wind farms are also presented.     

Rent-seeking in an emerging market: A DSGE approach

Due to the fact that rent-seeking is by definition an unobservable variable, measuring its size and evolution over the business cycle can be a daunting challenge. In this article, by embedding rent-seeking behavior in an otherwise standard open-economy DSGE model, we are able to derive a quarterly time series of this variable (expressed as a percentage deviation from the trend) for an emerging economy such as Brazil. The estimated series, spanning the period 2002Q1?2017Q4, shows a strong positive correlation with the “Commodity Super Cycle” of the 2000 decade and falls as a result of some political scandals and their ensuing investigations, among other driving forces. We also rely on the same model to assess how several shocks hitting the economy affect both rent-seeking and the relevant macroeconomic variables in our model. Barring monetary expansions, increased exports and higher income transfers to households, expansionary shocks are associated with lower rent-seeking activity. Factoring in these two sets of results, the upshot is that rent-seeking behavior shows a pattern of procyclicality in the Brazilian economy.     

On the forecasting performance of a small-scale DSGE model

Dynamic stochastic general equilibrium (DSGE) models have recently become standard tools for policy analysis. Nevertheless, their forecasting properties have still barely been explored. In this article, we address this problem by examining the quality of forecasts of the key U.S. economic variables: the three-month Treasury bill yield, the GDP growth rate and GDP price index inflation, from a small-size DSGE model, trivariate vector autoregression (VAR) models and the Philadelphia Fed Survey of Professional Forecasters (SPF). The ex post forecast errors are evaluated on the basis of the data from the period 1994–2006. We apply the Philadelphia Fed “Real-Time Data Set for Macroeconomists” to ensure that the data used in estimating the DSGE and VAR models was comparable to the information available to the SPF.Overall, the results are mixed. When comparing the root mean squared errors for some forecast horizons, it appears that the DSGE model outperforms the other methods in forecasting the GDP growth rate. However, this characteristic turned out to be statistically insignificant. Most of the SPF's forecasts of GDP price index inflation and the short-term interest rate are better than those from the DSGE and VAR models.     

The M4 Competition: 100,000 time series and 61 forecasting methods

The M4 Competition follows on from the three previous M competitions, the purpose of which was to learn from empirical evidence both how to improve the forecasting accuracy and how such learning could be used to advance the theory and practice of forecasting. The aim of M4 was to replicate and extend the three previous competitions by: (a) significantly increasing the number of series, (b) expanding the number of forecasting methods, and (c) including prediction intervals in the evaluation process as well as point forecasts. This paper covers all aspects of M4 in detail, including its organization and running, the presentation of its results, the top-performing methods overall and by categories, its major findings and their implications, and the computational requirements of the various methods. Finally, it summarizes its main conclusions and states the expectation that its series will become a testing ground for the evaluation of new methods and the improvement of the practice of forecasting, while also suggesting some ways forward for the field.     

Bayesian Model Averaging and exchange rate forecasts

Exchange rate forecasting is hard and the seminal result of Meese and Rogoff [Meese, R., Rogoff, K., 1983. Empirical exchange rate models of the seventies: Do they fit out of sample? Journal of International Economics 14, 3–24] that the exchange rate is well approximated by a driftless random walk, at least for prediction purposes, still stands despite much effort at constructing other forecasting models. However, in several other macro and financial forecasting applications, researchers in recent years have considered methods for forecasting that effectively combine the information in a large number of time series. In this paper, I apply one such method for pooling forecasts from several different models, Bayesian Model Averaging, to the problem of pseudo out-of-sample exchange rate predictions. For most currency–horizon pairs, the Bayesian Model Averaging forecasts using a sufficiently high degree of shrinkage, give slightly smaller out-of-sample mean square prediction error than the random walk benchmark. The forecasts generated by this model averaging methodology are however very close to, but not identical to, those from the random walk forecast.     

Mining the past to determine the future: Comments

In forecasting, data mining is frequently perceived as a distinct technological discipline without immediate relevance to the challenges of time series prediction. However, Hand (2009) postulates that when the large cross-sectional datasets of data mining and the high-frequency time series of forecasting converge, common problems and opportunities are created for the two disciplines. This commentary attempts to establish the relationship between data mining and forecasting via the dataset properties of aggregate and disaggregate modelling, in order to identify areas where research in data mining may contribute to current forecasting challenges, and vice versa. To forecasting, data mining offers insights on how to handle large, sparse datasets with many binary variables, in feature and instance selection. Furthermore data mining and related disciplines may stimulate research into how to overcome selectivity bias using reject inference on observational datasets and, through the use of experimental time series data, how to extend the utility and costs of errors beyond measuring performance, and how to find suitable time series benchmarks to evaluate computer intensive algorithms. Equally, data mining can profit from forecasting’s expertise in handling nonstationary data to counter the out-of-date-data problem, and how to develop empirical evidence beyond the fine tuning of algorithms, leading to a number of potential synergies and stimulating research in both data mining and forecasting.     

Correlated daily time series and forecasting in the M4 competition

We participated in the M4 competition for time series forecasting and here describe our methods for forecasting daily time series. We used an ensemble of five statistical forecasting methods and a method that we refer to as the correlator. Our retrospective analysis using the ground truth values published by the M4 organisers after the competition demonstrates that the correlator was responsible for most of our gains over the naïve constant forecasting method. We identify data leakage as one reason for its success, due partly to test data selected from different time intervals, and partly to quality issues with the original time series. We suggest that future forecasting competitions should provide actual dates for the time series so that some of these leakages could be avoided by participants.     

A decomposition clustering ensemble learning approach for forecasting foreign exchange rates

A decomposition clustering ensemble (DCE) learning approach is proposed for forecasting foreign exchange rates by integrating the variational mode decomposition (VMD), the self-organizing map (SOM) network, and the kernel extreme learning machine (KELM). First, the exchange rate time series is decomposed into N subcomponents by the VMD method. Second, each subcomponent series is modeled by the KELM. Third, the SOM neural network is introduced to cluster the subcomponent forecasting results of the in-sample dataset to obtain cluster centers. Finally, each cluster's ensemble weight is estimated by another KELM, and the final forecasting results are obtained by the corresponding clusters' ensemble weights. The empirical results illustrate that our proposed DCE learning approach can significantly improve forecasting performance, and statistically outperform some other benchmark models in directional and level forecasting accuracy.     

Out-of-sample tests of forecasting accuracy: an analysis and review

In evaluations of forecasting accuracy, including forecasting competitions, researchers have paid attention to the selection of time series and to the appropriateness of forecast-error measures. However, they have not formally analyzed choices in the implementation of out-of-sample tests, making it difficult to replicate and compare forecasting accuracy studies. In this paper, I (1) explain the structure of out-of-sample tests, (2) provide guidelines for implementing these tests, and (3) evaluate the adequacy of out-of-sample tests in forecasting software. The issues examined include series-splitting rules, fixed versus rolling origins, updating versus recalibration of model coefficients, fixed versus rolling windows, single versus multiple test periods, diversification through multiple time series, and design characteristics of forecasting competitions. For individual time series, the efficiency and reliability of out-of-sample tests can be improved by employing rolling-origin evaluations, recalibrating coefficients, and using multiple test periods. The results of forecasting competitions would be more generalizable if based upon precisely described groups of time series, in which the series are homogeneous within group and heterogeneous between groups. Few forecasting software programs adequately implement out-of-sample evaluations, especially general statistical packages and spreadsheet add-ins.     

Forecasting quarterly movements of the lira/pound-sterling exchange rate: Random walks,drift, seasonality and variable parameters

Quarterly logarithmic changes of the lira/pound-exchange rate for the period 1973 Q1 to 1989 Q1 are examined and the forecasting performance of some simple time series models is evalutated. The performance of the random walk model with drift is examined as a method of forecasting one quarter ahead lira/pound-sterling exchange rate changes. This model is then extended to incorporate seasonal movements. The assumptions of constant drift and seasonal patters are relaxed and the models are estimated using variable parameter regression based on state-space modelling using the Kalman filter. The within and out-of-sample performance of the models illustrates that an improvement in forecast accuracy is obtained by including seasonal variation. However, the results do not appear to be improved by allowing the parameters to follow a random walk, AR(1) or AR(2) process. The random walk model with drift and seasonal patterns performs better at predicting exchange rate movements than predictions based on the forward rate.

---

Riassunto Questo saggio esamina il movimcnto dei valori logaritmici dei dati trimestrali per i tassi di cambio tra la lira e la sterlina, per il periodo che va dal primo trimestre del 1973 al primo trimestre del 1989.Si valuta la bontà della previsione dei modelli semplici. Si dà una valutazione dell' attendibilità del modello di passeggiata a caso con variazione, intendendolo come un metodo per prevedere, con un anticipo di tre mesi, i movimenti dei tassi di cambio tra la lira e la sterlina.Questo modello viene poi esteso per incorporare movimenti stagionali, le ipotesi di movimenti costanti casuali e stagionali sono indebolite e i modelli vengono valutati usando analisi di regressione con parametri variabili fondate sui modelli di stato-spaziale usando il filtro di Kalman.L'attendibilità, dentro e fuori il campione, dei modelli dimostra che un miglioramento nell'esattezza delle precisioni viene ottenuto con l'inclusione della variazione stagionale.I risultati, però, non migliorano quando i parametri seguono una passeggiata a caso, un processo AR(1) o un processo AR(2).Il modello della passeggiata a caso con variazione e i movimenti stagionali riescono meglio a pronosticare movimenti dei tassi di cambio che non le previsioni fondate sui tassi fissi di cambio anticipati.

---

---

A revised draft of the paper presented at the 6th. Meeting of the European Working Group on Financial Modelling at Hautes Etudes Commerciales, Liège, Belgium, 27/28 November, 1989     

Forecasting macroeconomic time series: LASSO-based approaches and their forecast combinations with dynamic factor models

In a data-rich environment, forecasting economic variables amounts to extracting and organizing useful information from a large number of predictors. So far, the dynamic factor model and its variants have been the most successful models for such exercises. In this paper, we investigate a category of LASSO-based approaches and evaluate their predictive abilities for forecasting twenty important macroeconomic variables. These alternative models can handle hundreds of data series simultaneously, and extract useful information for forecasting. We also show, both analytically and empirically, that combing forecasts from LASSO-based models with those from dynamic factor models can reduce the mean square forecast error (MSFE) further. Our three main findings can be summarized as follows. First, for most of the variables under investigation, all of the LASSO-based models outperform dynamic factor models in the out-of-sample forecast evaluations. Second, by extracting information and formulating predictors at economically meaningful block levels, the new methods greatly enhance the interpretability of the models. Third, once forecasts from a LASSO-based approach are combined with those from a dynamic factor model by forecast combination techniques, the combined forecasts are significantly better than either dynamic factor model forecasts or the naïve random walk benchmark.     

A re-examination of housing bubbles: Evidence from European countries

This study uses data from six Eurozone countries and the United Kingdom between 1980Q1 and 2018Q4 to examine whether these countries had housing bubbles during the observed period. Whereas typical studies make strictly limited assumptions regarding interest rates, we make an unconventional argument for the necessity of testing the integration relationship between the price–rent ratio and the interest rate reciprocal to determine the existence of housing bubbles. To verify this study’s proposition, two housing bubble indicators were adopted to dynamically examine periods of housing bubbles in European countries by using a series of individual countries and panel data from Eurozone countries. According to the empirical results for individual countries, although the price–rent ratio indicates the occurrence of housing booms in the targeted countries, the evidence for housing bubbles is unclear. The dynamic bubble indicator revealed that housing bubbles occurred in France and Ireland within a short period in 1993Q3 and 2000Q2, respectively. Spain experienced two short-term housing bubbles in 1990Q1 and 2015Q1. The short-term bubbles signify that the housing markets were efficient. Once the price–rent ratio failed to converge toward the nominal interest rate, market traders’ rational behavior can immediately correct the short-term market divergence. The panel data of the Eurozone countries also reveals that simply using the price–rent ratio for examination may underestimate the correction of the housing markets. In conclusion, the results of this study demonstrate the importance of the interest rate in controlling the housing market.     

Damping seasonal factors: Shrinkage estimators for the X-12-ARIMA program

We examine the effect of damping X-12-ARIMA's estimated seasonal variation on the accuracy of its seasonal adjustments of time series. Two methods for damping seasonals are proposed. In a simulation experiment, we generated time series data for each of 90 distinct experimental conditions that, in aggregate, characterize the variety of monthly series in the M3-competition. X-12-ARIMA consistently overestimated the actual seasonal variation by an amount consistent with statistical theory. Damping seasonals reduced X-12-ARIMA's estimation error by as much as 79% and under no conditions was estimation error increased beyond a trivial amount. Improvement depended primarily on the degree to which random variation in a series dominated seasonal variation. When the multiplicative X-12-ARIMA model did not match the data-generating model, overestimation was less for trend series than for series with no trend; otherwise the presence of trend had no discernible effect. One of the proposed methods was somewhat more accurate and robust, but more complex, than the other. In an analysis of real data—the 1428 monthly series of the M3-competition-damping X-12-ARIMA seasonals prior to forecasting (1) reduced the average forecasting MAPE by 4.9–1.4% and (2) improved forecasting accuracy for 59–65% of the series, depending on the forecasting horizon. This research suggests that damping X-12-ARIMA seasonals leads to more accurate seasonal adjustments of time series, thus providing a more reliable basis for policy-making, forecasting, and the evaluation of forecasting methods by researchers.     

ARIMA融合神经网络的人民币汇率预测模型研究

本文在深入分析了单整自回归移动平均(ARIMA)模型与神经网络(NN)模型特点的基础上,建立了ARIMA融合NN的人民币汇率时间序列预测模型。其基本思想是充分发挥两种模型在线性空间和非线性空间的预测优势,即将汇率时间序列的数据结构分解为线性自相关主体和非线性残差两部分,首先用ARI-MA模型预测序列的线性主体,然后用NN模型对其非线性残差进行估计,最终合成为整个序列的预测结果。通过对三种人民币汇率序列的仿真实验表明,融合模型的预测准确率显著高于包括随机游走模型在内的单一模型的预测准确率,从而证实了融合模型用于汇率预测的有效性。这一结果也表明,人民币汇率市场并不符合有效市场假设,可以通过模型对汇率未来走势做出较准确预测。