The performance of alternative forecasting methods for SETAR models

We compare a number of methods that have been proposed in the literature for obtaining h-step ahead minimum mean square error forecasts for self-exciting threshold autoregressive (SETAR) models. These forecasts are compared to those from an AR model. The comparison of forecasting methods is made using Monte Carlo simulation. The Monte-Carlo method of calculating SETAR forecasts is generally at least as good as that of the other methods we consider. An exception is when the disturbances in the SETAR model come from a highly asymmetric distribution, when a Bootstrap method is to be preferred.An empirical application calculates multi-period forecasts from a SETAR model of US gross national product using a number of the forecasting methods. We find that whether there are improvements in forecast performance relative to a linear AR model depends on the historical epoch we select, and whether forecasts are evaluated conditional on the regime the process was in at the time the forecast was made.     

Business and consumer expectations and macroeconomic forecasts

Business and consumer surveys have become an essential tool for gathering information about different economic variables. While the fast availability of the results and the wide range of variables covered have made them very useful for monitoring the current state of the economy, there is no consensus on their usefulness for forecasting macroeconomic developments.The objective of this paper is to analyse the possibility of improving forecasts for selected macroeconomic variables for the euro area using the information provided by these surveys. After analyzing the potential presence of seasonality and the issue of quantification, we tested whether these indicators provide useful information for improving forecasts of the macroeconomic variables. With this aim, different sets of models have been considered (AR, ARIMA, SETAR, Markov switching regime models and VAR) to obtain forecasts for the selected macroeconomic variables. Then, information from surveys has been considered for forecasting these variables in the context of the following models: autoregressive, VAR, Markov switching regime and leading indicator models. In all cases, the root mean square error (RMSE) has been computed for different forecast horizons.The comparison of the forecasting performance of the two sets of models permits us to conclude that, in most cases, models that include information from the surveys have lower RMSEs than the best model without survey information. However, this reduction is only significant in a limited number of cases. In this sense, the results obtained extend the results of previous research that has included information from business and consumer surveys to explain the behaviour of macroeconomic variables, but are not conclusive about its role.     

Subsampling inference in threshold autoregressive models

This paper discusses inference in self-exciting threshold autoregressive (SETAR) models. Of main interest is inference for the threshold parameter. It is well-known that the asymptotics of the corresponding estimator depend upon whether the SETAR model is continuous or not. In the continuous case, the limiting distribution is normal and standard inference is possible. In the discontinuous case, the limiting distribution is non-normal and it is not known how to estimate it consistently. We show that valid inference can be drawn by the use of the subsampling method. Moreover, the method can even be extended to situations where the (dis)continuity of the model is unknown. In this case, the inference for the regression parameters of the model also becomes difficult and subsampling can be used again. In addition, we consider an hypothesis test for the continuity of a SETAR model. A simulation study examines small sample performance and an application illustrates how the proposed methodology works in practice.     

Testing for Linearity

The problem of testing for linearity and the number of regimes in the context of self‐exciting threshold autoregressive (SETAR) models is reviewed. We describe least‐squares methods of estimation and inference. The primary complication is that the testing problem is non‐standard, due to the presence of parameters which are only defined under the alternative, so the asymptotic distribution of the test statistics is non‐standard. Simulation methods to calculate asymptotic and bootstrap distributions are presented. As the sampling distributions are quite sensitive to conditional heteroskedasticity in the error, careful modeling of the conditional variance is necessary for accurate inference on the conditional mean. We illustrate these methods with two applications — annual sunspot means and monthly U.S. industrial production. We find that annual sunspots and monthly industrial production are SETAR(2) processes.     

Beyond point forecasting: Evaluation of alternative prediction intervals for tourist arrivals

This paper evaluates the performances of prediction intervals generated from alternative time series models, in the context of tourism forecasting. The forecasting methods considered include the autoregressive (AR) model, the AR model using the bias-corrected bootstrap, seasonal ARIMA models, innovations state space models for exponential smoothing, and Harvey’s structural time series models. We use thirteen monthly time series for the number of tourist arrivals to Hong Kong and Australia. The mean coverage rates and widths of the alternative prediction intervals are evaluated in an empirical setting. It is found that all models produce satisfactory prediction intervals, except for the autoregressive model. In particular, those based on the bias-corrected bootstrap perform best in general, providing tight intervals with accurate coverage rates, especially when the forecast horizon is long.     

Volatility forecasting in the Bitcoin market: A new proposed measure based on the VS-ACARR approach

This paper proposes a new volatility-spillover-asymmetric conditional autoregressive range (VS-ACARR) approach that takes into account the intraday information, the volatility spillover from crude oil as well as the volatility asymmetry (leverage effect) to model/forecast Bitcoin volatility (price range). An empirical application to Bitcoin and crude oil (WTI) price ranges shows the existence of strong volatility spillover from crude oil to the Bitcoin market and a weak leverage effect in the Bitcoin market. The VS-ACARR model yields higher forecasting accuracy than the GARCH, CARR, and VS-CARR models regarding out-of-sample forecast performance, suggesting that accounting for the volatility spillover and asymmetry can significantly improve the forecasting accuracy of Bitcoin volatility. The superior forecast performance of the VS-ACARR model is robust to alternative out-of-sample forecast windows. Our findings highlight the importance of accommodating intraday information, spillover from crude oil, and volatility asymmetry in forecasting Bitcoin volatility.     

A two-step approach for identifying seasonal autoregressive time series forecasting models

One of the most powerful and widely used methodologies for forecasting economic time series is the class of models known as seasonal autoregressive processes. In this article we present a new approach not only for identifying seasonal autoregressive models, but also the degree of differencing required to induce stationarity in the data. The identification method is iterative and consists in systematically fitting increasing order models to the data, and then verifying that the resulting residuals behave like white noise using a two stage autoregressive order determination criterion. Once the order of the process is determined the identified structure is tested to see if it can be simplified. The identification performance of this procedure is contrasted with other order selection procedures for models with ‘gaps.' We also illustrate the forecast performance of the identification method using monthly and quarterly economic data.     

Forecasting value at risk with intra-day return curves

Methods for incorporating high resolution intra-day asset price data into risk forecasts are being developed at an increasing pace. Existing methods such as those based on realized volatility depend primarily on reducing the observed intra-day price fluctuations to simple scalar summaries. In this study, we propose several methods that incorporate full intra-day price information as functional data objects in order to forecast value at risk (VaR). Our methods are based on the recently proposed functional generalized autoregressive conditionally heteroscedastic (GARCH) models and a new functional linear quantile regression model. In addition to providing daily VaR forecasts, these methods can be used to forecast intra-day VaR curves, which we considered and studied with companion backtests to evaluate the quality of these intra-day risk measures. Using high-frequency trading data from equity and foreign exchange markets, we forecast the one-day-ahead daily and intra-day VaR with the proposed methods and various benchmark models. The empirical results suggested that the functional GARCH models estimated based on the overnight cumulative intra-day return curves exhibited competitive performance with benchmark models for daily risk management, and they produced valid intra-day VaR curves.     

Combining Forecasts from Nested Models*

Motivated by the common finding that linear autoregressive models often forecast better than models that incorporate additional information, this paper presents analytical, Monte Carlo and empirical evidence on the effectiveness of combining forecasts from nested models. In our analytics, the unrestricted model is true, but a subset of the coefficients is treated as being local‐to‐zero. This approach captures the practical reality that the predictive content of variables of interest is often low. We derive mean square error‐minimizing weights for combining the restricted and unrestricted forecasts. Monte Carlo and empirical analyses verify the practical effectiveness of our combination approach.     

Linear models, smooth transition autoregressions, and neural networks for forecasting macroeconomic time series: A re-examination

In this paper, we examine the forecast accuracy of linear autoregressive, smooth transition autoregressive (STAR), and neural network (NN) time series models for 47 monthly macroeconomic variables of the G7 economies. Unlike previous studies that typically consider multiple but fixed model specifications, we use a single but dynamic specification for each model class. The point forecast results indicate that the STAR model generally outperforms linear autoregressive models. It also improves upon several fixed STAR models, demonstrating that careful specification of nonlinear time series models is of crucial importance. The results for neural network models are mixed in the sense that at long forecast horizons, an NN model obtained using Bayesian regularization produces more accurate forecasts than a corresponding model specified using the specific-to-general approach. Reasons for this outcome are discussed.     

Realized volatility forecast with the Bayesian random compressed multivariate HAR model

We develop a Bayesian random compressed multivariate heterogeneous autoregressive (BRC-MHAR) model to forecast the realized covariance matrices of stock returns. The proposed model randomly compresses the predictors and reduces the number of parameters. We also construct several competing multivariate volatility models with the alternative shrinkage methods to compress the parameter’s dimensions. We compare the forecast performances of the proposed models with the competing models based on both statistical and economic evaluations. The results of statistical evaluation suggest that the BRC-MHAR models have the better forecast precision than the competing models for the short-term horizon. The results of economic evaluation suggest that the BRC-MHAR models are superior to the competing models in terms of the average return, the Shape ratio and the economic value.     

A forecasting comparison of some var techniques

Higher dimensional multivariate time series models suffer from the problem of over-parametrisation which impairs their forecasting performance. Starting from such unrestricted vector autoregressive models the paper discusses two ways to cope with this difficulty. The first approach reduces the number of free parameters by applying a subset modelling strategy. The second approach takes a Bayesian point of view by formulating ‘priors’ which are then combined with sample information, but leaving the original specification unaltered. Using Austrian quarterly macroeconomic time series a comparative study is undertaken by running alternative forecasting exercises. Both methods improve out-of-sample forecasting performance substantially at the cost of some bias in ex-post simulations. Comparing the ex-ante predictions of the two approaches, the former does better at short horizons whereas the latter gains as the forecast horizon lengthens.     

Two are better than one: Volatility forecasting using multiplicative component GARCH-MIDAS models

We examine the properties and forecast performance of multiplicative volatility specifications that belong to the class of generalized autoregressive conditional heteroskedasticity–mixed-data sampling (GARCH-MIDAS) models suggested in Engle, Ghysels, and Sohn (Review of Economics and Statistics, 2013, 95, 776–797). In those models volatility is decomposed into a short-term GARCH component and a long-term component that is driven by an explanatory variable. We derive the kurtosis of returns, the autocorrelation function of squared returns, and the R² of a Mincer–Zarnowitz regression and evaluate the QMLE and forecast performance of these models in a Monte Carlo simulation. For S&P 500 data, we compare the forecast performance of GARCH-MIDAS models with a wide range of competitor models such as HAR (heterogeneous autoregression), realized GARCH, HEAVY (high-frequency-based volatility) and Markov-switching GARCH. Our results show that the GARCH-MIDAS based on housing starts as an explanatory variable significantly outperforms all competitor models at forecast horizons of 2 and 3 months ahead.     

Multimodality in GARCH regression models

It is shown empirically that mixed autoregressive moving average regression models with generalized autoregressive conditional heteroskedasticity (Reg-ARMA-GARCH models) can have multimodality in the likelihood that is caused by a dummy variable in the conditional mean. Maximum likelihood estimates at the local and global modes are investigated and turn out to be qualitatively different, leading to different model-based forecast intervals. In the simpler GARCH(p,q) regression model, we derive analytical conditions for bimodality of the corresponding likelihood. In that case, the likelihood is symmetrical around a local minimum. We propose a solution to avoid this bimodality.     

The importance of common cyclical features in VAR analysis: a Monte-Carlo study

Despite the commonly held belief that aggregate data display short-run comovement, there has been little discussion about the econometric consequences of this feature of the data. We use exhaustive Monte-Carlo simulations to investigate the importance of restrictions implied by common-cyclical features for estimates and forecasts based on vector autoregressive models. First, we show that the “best” empirical model developed without common cycle restrictions need not nest the “best” model developed with those restrictions. This is due to possible differences in the lag-lengths chosen by model selection criteria for the two alternative models. Second, we show that the costs of ignoring common cyclical features in vector autoregressive modelling can be high, both in terms of forecast accuracy and efficient estimation of variance decomposition coefficients. Third, we find that the Hannan–Quinn criterion performs best among model selection criteria in simultaneously selecting the lag-length and rank of vector autoregressions.     

Evaluating the forecasting performance of econometric models of air passenger traffic flows using multiple error measures

Airline traffic forecasting is important to airlines and regulatory authorities. This paper examines a number of approaches to forecasting short- to medium-term air traffic flows. It contributes as a rare replication, testing a variety of alternative modelling approaches. The econometric models employed include autoregressive distributed lag (ADL) models, time-varying parameter (TVP) models and an automatic method for econometric model specification. A vector autoregressive (VAR) model and various univariate alternatives are also included to deliver unconditional forecast comparisons. Various approaches for taking into account interactions between contemporaneous air traffic flows are examined, including pooled ADL models and the enhanced models with the addition of a “world trade” variable. Based on the analysis of a number of forecasting error measures, it is concluded that pooled ADL models that include the “world trade” variable outperform the alternatives, and in particular univariate methods; and, second, that automatic modelling procedures are enhanced through judgmental intervention. In contrast to earlier results, the TVP models do not improve accuracy. Depending on the preferred error measure, the difference in accuracy may be substantial.     

Establishing conditions for the functional central limit theorem in nonlinear and semiparametric time series processes

This paper considers methods of deriving sufficient conditions for the central limit theorem and functional central limit theorem to hold in a broad class of time series processes, including nonlinear processes and semiparametric linear processes. The common thread linking these results is the concept of near-epoch dependence on a mixing process, since powerful limit results are available under this limited-dependence property. The particular case of near-epoch dependence on an independent process provides a convenient framework for dealing with a range of nonlinear cases, including the bilinear, GARCH, and threshold autoregressive models. It is shown in particular that even SETAR processes with a unit root regime have short memory, under the right conditions. A simulation approach is also demonstrated, applicable to cases that are analytically intractable. A new FCLT is given for semiparametric linear processes, where the forcing processes are of the NED-on-mixing type, under conditions that are evidently close to necessary.     

Bootstrap prediction intervals for autoregressions: some alternatives

A new method is proposed to obtain interval forecasts for autoregressive models taking into account the variability due to the estimation of the order and the parameters. The procedure improves that introduced by Masarotto (1990), allows a substantial reduction of the variance of the predictive distribution percentile estimators and should thus be considered as a useful alternative to the classic Box and Jenkins interval forecast. The method uses the bootstrap technique and is distribution-free. An empirical application is considered.     

Forecast on silver futures linked with structural breaks and day-of-the-week effect

Silver future is crucial to global financial markets. However, the existing literature rarely considers the impacts of structural breaks and day-of-the-week effect simultaneously on the volatility of silver future price. Based on heterogeneous autoregressive (HAR) theory, we establish six new type heterogeneous autoregressive (HAR) models by incorporating structural breaks and day-of-the-week effect to forecast the volatility. The empirical results indicate that new models’ accuracy is better than the original HAR model. We find that structural breaks and the day-of-the-week effect contain much forecasting information on silver forecasting. In addition, structural breaks have a positive effect on the silver futures’ volatility. Day-of-the-week effect has a significantly negative influence on silver futures’ price volatility, especially in the mid-term and the long-term. Our works is the first to combine the structural breaks and day-of-the-week effect to identify more market information. This paper provides a better forecasting method to predict silver future volatility.     

Using qualitative approach to forecasting regime switches

Drastic changes (named regime switches) often exist in economic and financial time series causing the forecasting of time series difficult. Hence, we need robust models to detect and forecast the regime switches. Most previous studies apply quantitative methods to forecast time series and regime switches. Contrast to these studies, this study attempts a novel approach to use a qualitative method to forecast regime switches. Fuzzy set/qualitative comparative analysis (fsQCA), based on fuzzy set and logic theory, yields the relationships between antecedent combinations and outcome. Studies support fsQCA analysis is more proper to reflect the real situations. Hence, this study uses fsQCA to analyze the autoregressive relationships of the upward and downward regime switches in the in-sample data. Then, the relationships are used to forecast the regime switches in the out-of-sample data. Taiwan Capitalization Weighted Stock Index is taken as the data for analysis. The empirical results show that fsQCA provides strong predictive validities.