Macroeconomic forecasting in Austria: An analysis of accuracy

In the present paper, we attempt a critical evaluation of macroeconomic forecasting in Austria. For this purpose, we calculate conventional magnitude measures of accuracy as well as probabilities of correctly predicting directional change for the forecasts made by two Austrian institutions (WIFO and IHS) and by the OECD. ARIMA models and Holt-Winters exponential smoothing serve as benchmarks for comparison.     

Emergent clustering methods for empirical OM research

To date, the vast majority of cluster analysis applications in OM research have relied on traditional hierarchical (e.g., Ward's algorithm) and nonhierarchical (e.g., K-means algorithms) methods. Although these venerable methods should continue to be employed effectively in the OM literature, we also believe there is a significant opportunity to expand the scope of clustering methods to emergent techniques. We provide an overview of some alternative clustering procedures (including advantages and disadvantages), identify software programs for implementing them, and discuss the circumstances where they might be employed gainfully in OM research. The implementation of emergent clustering methods in the OM literature should enable researchers to offer implications for practice that might not have been uncovered with traditional methods.     

Monthly forecasting of GDP with mixed-frequency multivariate singular spectrum analysis

The literature on mixed-frequency models is relatively recent and has found applications across economics and finance. The standard application in economics considers the use of (usually) monthly variables (e.g. industrial production) for predicting/fitting quarterly variables (e.g. real GDP). This paper proposes a multivariate singular spectrum analysis (MSSA) based method for mixed-frequency interpolation and forecasting, which can be used for any mixed-frequency combination. The novelty of the proposed approach rests on the grounds of simplicity within the MSSA framework. We present our method using a combination of monthly and quarterly series and apply MSSA decomposition and reconstruction to obtain monthly estimates and forecasts for the quarterly series. Our empirical application shows that the suggested approach works well, as it offers forecasting improvements on a dataset of eleven developed countries over the last 50 years. The implications for mixed-frequency modelling and forecasting, and useful extensions of this method, are also discussed.     

Models of exchange rates : A comparison of forecasting results

In this note we compare the results of several published papers on exchange rate forecasting. With regard to univariate time series models, we confirm the result that such models, on average, do not outperform the simple random walk forecasting rule. This conclusion corrects results reported in this Journal by Alexander and Thomas (1987).     

A comparison of two model averaging techniques with an application to growth empirics

Parameter estimation under model uncertainty is a difficult and fundamental issue in econometrics. This paper compares the performance of various model averaging techniques. In particular, it contrasts Bayesian model averaging (BMA) — currently one of the standard methods used in growth empirics — with a new method called weighted-average least squares (WALS). The new method has two major advantages over BMA: its computational burden is trivial and it is based on a transparent definition of prior ignorance. The theory is applied to and sheds new light on growth empirics where a high degree of model uncertainty is typically present.     

Forecasting sales response for multiple time horizons and temporally aggregated data: A comparison of constant and stochastic coefficient models

Past research on time-varying sales-response models emphasized the application of different estimation techniques in examining variation in advertising effectiveness over time. This study focuses on comparing sales forecasts using constant and stochastic coefficients sales-response models. Selected constant and stochastic coefficient models are applied to six sets of bimonthly and one set of annual advertising and sales data to assess forecasting accuracy for time horizons of various lengths. Results show improved forecasting accuracy for a first-order autoregressive stochastic coefficient model, particularly in short-run forecasting applications.     

FRED-SD: A real-time database for state-level data with forecasting applications

We construct a real-time dataset (FRED-SD) with vintage data for the U.S. states that can be used to forecast both state-level and national-level variables. Our dataset includes approximately 28 variables per state, including labor-market, production, and housing variables. We conduct two sets of real-time forecasting exercises. The first forecasts state-level labor-market variables using five different models and different levels of industrially disaggregated data. The second forecasts a national-level variable exploiting the cross-section of state data. The state-forecasting experiments suggest that large models with industrially disaggregated data tend to have higher predictive ability for industrially diversified states. For national-level data, we find that forecasting and aggregating state-level data can outperform a random walk but not an autoregression. We compare these real-time data experiments with forecasting experiments using final-vintage data and find very different results. Because these final-vintage results are obtained with revised data that would not have been available at the time the forecasts would have been made, we conclude that the use of real-time data is essential for drawing proper conclusions about state-level forecasting models.     

A comparison of monthly global indicators for forecasting growth

This paper evaluates the predictive content of a set of alternative monthly indicators of global economic activity for nowcasting and forecasting quarterly world real GDP growth using mixed-frequency models. It shows that a recently proposed indicator that covers multiple dimensions of the global economy consistently produces substantial improvements in forecasting accuracy, while other monthly measures have more mixed success. Specifically, the best-performing model yields impressive gains with MSPE reductions of up to 34% at short horizons and up to 13% at long horizons relative to an autoregressive benchmark. The global economic conditions indicator also contains valuable information for assessing the current and future state of the economy for a set of individual countries and groups of countries. This indicator is used to track the evolution of the nowcasts for the U.S., the OECD area, and the world economy during the COVID-19 pandemic and the main factors that drive the nowcasts are quantified.     

M-competition — A closer look at NAIVE2 and median APE : A note

Two observations regarding the M-Competition are presented. First, the seasonal indices that were used in the NAIVE2 method were not calculated using the exact procedures that were defined in the M-Competition paper. Second the median absolute percentage error comparative measure was not computed as one might expect it to have been and was not documented as such. The resolution of these matters might enhance the usefulness of the M-Competition study.     

A general method for addressing forecasting uncertainty in inventory models

In practice, inventory decisions depend heavily on demand forecasts, but the literature typically assumes that demand distributions are known. This means that estimates are substituted directly for the unknown parameters, leading to insufficient safety stocks, stock-outs, low service, and high costs. We propose a framework for addressing this estimation uncertainty that is applicable to any inventory model, demand distribution, and parameter estimator. The estimation errors are modeled and a predictive lead time demand distribution obtained, which is then substituted into the inventory model. We illustrate this framework for several different demand models. When the estimates are based on ten observations, the relative savings are typically between 10% and 30% for mean-stationary demand. However, the savings are larger when the estimates are based on fewer observations, when backorders are costlier, or when the lead time is longer. In the presence of a trend, the savings are between 50% and 80% for several scenarios.     

Use of the sign test to supplement the percentage better statistic

The utilization of an accuracy measure such as Percentage Better can be made more meaningful if it is supplemented with a statistical test of the significance of the results. For the Percentage Better, the Sign Test can be useful. In this paper, some of the results of the Makridakis competition are re-analyzed to illustrate this point. The results make for a clearer interpretation and easier use to identify the best forecasting method in a pairwise fashion     

A critical overview of privacy-preserving approaches for collaborative forecasting

Cooperation between different data owners may lead to an improvement in forecast quality—for instance, by benefiting from spatiotemporal dependencies in geographically distributed time series. Due to business competitive factors and personal data protection concerns, however, said data owners might be unwilling to share their data. Interest in collaborative privacy-preserving forecasting is thus increasing. This paper analyzes the state-of-the-art and unveils several shortcomings of existing methods in guaranteeing data privacy when employing vector autoregressive models. The methods are divided into three groups: data transformation, secure multi-party computations, and decomposition methods. The analysis shows that state-of-the-art techniques have limitations in preserving data privacy, such as (i) the necessary trade-off between privacy and forecasting accuracy, empirically evaluated through simulations and real-world experiments based on solar data; and (ii) iterative model fitting processes, which reveal data after a number of iterations.     

Macroeconomic forecasting with large Bayesian VARs: Global-local priors and the illusion of sparsity

A class of global-local hierarchical shrinkage priors for estimating large Bayesian vector autoregressions (BVARs) has recently been proposed. We question whether three such priors: Dirichlet-Laplace, Horseshoe, and Normal-Gamma, can systematically improve the forecast accuracy of two commonly used benchmarks (the hierarchical Minnesota prior and the stochastic search variable selection (SSVS) prior), when predicting key macroeconomic variables. Using small and large data sets, both point and density forecasts suggest that the answer is no. Instead, our results indicate that a hierarchical Minnesota prior remains a solid practical choice when forecasting macroeconomic variables. In light of existing optimality results, a possible explanation for our finding is that macroeconomic data is not sparse, but instead dense.     

A Markov chain model for forecasting results of mixed martial arts contests

In this paper, we present a new methodology for forecasting the results of mixed martial arts contests. Our approach utilises data scraped from freely available websites to estimate fighters’ skills in various key aspects of the sport. With these skill estimates, we simulate the contest as an actual fight using Markov chains, rather than predicting a binary outcome. We compare the model’s accuracy to that of the bookmakers using their historical odds and show that the model can be used as the basis of a successful betting strategy.     

A tale of forecasting 1001 series : The Bayesian knight strikes again

In this paper it is pointed out that a Bayesian forecasting procedure performed better according to an average mean square error (MSE) criterion than the many other forecasting procedures utilized in the forecasting experiments reported in an extensive study by Makridakis et al. (1982). This fact was not mentioned or discussed by the authors. Also, it is emphasized that if criteria other than MSE are employed, Bayesian forecasts that are optimal relative to them should be employed. Specific examples are provided and analyzed to illustrate this point.     

A direct Monte Carlo approach for Bayesian analysis of the seemingly unrelated regression model

Computationally efficient methods for Bayesian analysis of seemingly unrelated regression (SUR) models are described and applied that involve the use of a direct Monte Carlo (DMC) approach to calculate Bayesian estimation and prediction results using diffuse or informative priors. This DMC approach is employed to compute Bayesian marginal posterior densities, moments, intervals and other quantities, using data simulated from known models and also using data from an empirical example involving firms’ sales. The results obtained by the DMC approach are compared to those yielded by the use of a Markov Chain Monte Carlo (MCMC) approach. It is concluded from these comparisons that the DMC approach is worthwhile and applicable to many SUR and other problems.     

A note on forecasting the prices of gold and silver: Asymmetric loss and forecast rationality

Given that the prices of gold and silver have witnessed large and substantial swings in recent years, policymakers and investors need readily available and reliable forecasts of the prices of these two precious metals. Survey data of forecasts of the prices of gold and silver provide a particularly rich data environment for policymakers and investors to study developments in the markets for gold and silver. Our research helps to develop a deeper understanding of the properties of survey data of the prices of gold and silver. We study the shape of forecasters’ loss function and the rationality of their forecasts. Assuming an asymmetric loss function weakens evidence against forecast rationality, but results depend on the empirical model being studied.     

Adjusting for the environment in DEA: A comparison of alternative models based on empirical data

Due to the existence of free software and pedagogical guides, the use of Data Envelopment Analysis (DEA) has been further democratized in recent years. Nowadays, it is quite usual for practitioners and decision makers with no or little knowledge in operational research to run their own efficiency analysis. Within DEA, several alternative models allow for an environmental adjustment. Four alternative models, each user-friendly and easily accessible to practitioners and decision makers, are performed using empirical data of 90 primary schools in the State of Geneva, Switzerland. Results show that the majority of alternative models deliver divergent results. From a political and a managerial standpoint, these diverging results could lead to potentially ineffective decisions. As no consensus emerges on the best model to use, practitioners and decision makers may be tempted to select the model that is right for them, in other words, the model that best reflects their own preferences. Further studies should investigate how an appropriate multi-criteria decision analysis method could help decision makers to select the right model.