A sequential Monte Carlo approach to inference in multiple‐equation Markov‐switching models

Vector autoregressions with Markov‐switching parameters (MS‐VARs) offer substantial gains in data fit over VARs with constant parameters. However, Bayesian inference for MS‐VARs has remained challenging, impeding their uptake for empirical applications. We show that sequential Monte Carlo (SMC) estimators can accurately estimate MS‐VAR posteriors. Relative to multi‐step, model‐specific MCMC routines, SMC has the advantages of generality, parallelizability, and freedom from reliance on particular analytical relationships between prior and likelihood. We use SMC's flexibility to demonstrate that model selection among MS‐VARs can be highly sensitive to the choice of prior.     

Bayesian analysis of a Tobit quantile regression model

This paper develops a Bayesian framework for Tobit quantile regression. Our approach is organized around a likelihood function that is based on the asymmetric Laplace distribution, a choice that turns out to be natural in this context. We discuss families of prior distributions on the quantile regression vector that lead to proper posterior distributions with finite moments. We show how the posterior distribution can be sampled and summarized by Markov chain Monte Carlo methods. A method for comparing alternative quantile regression models is also developed and illustrated. The techniques are illustrated with both simulated and real data. In particular, in an empirical comparison, our approach out-performed two other common classical estimators.     

Estimation of Markov regime-switching regression models with endogenous switching

Following Hamilton [1989. A new approach to the economic analysis of nonstationary time series and the business cycle. Econometrica 57, 357–384], estimation of Markov regime-switching regressions typically relies on the assumption that the latent state variable controlling regime change is exogenous. We relax this assumption and develop a parsimonious model of endogenous Markov regime-switching. Inference via maximum likelihood estimation is possible with relatively minor modifications to existing recursive filters. The model nests the exogenous switching model, yielding straightforward tests for endogeneity. In Monte Carlo experiments, maximum likelihood estimates of the endogenous switching model parameters were quite accurate, even in the presence of certain model misspecifications. As an application, we extend the volatility feedback model of equity returns given in Turner et al. [1989. A Markov model of heteroskedasticity, risk, and learning in the stock market. Journal of Financial Economics 25, 3–22] to allow for endogenous switching.     

Bayesian identification,selection and estimation of semiparametric functions in high-dimensional additive models

In this paper we propose an approach to both estimate and select unknown smooth functions in an additive model with potentially many functions. Each function is written as a linear combination of basis terms, with coefficients regularized by a proper linearly constrained Gaussian prior. Given any potentially rank deficient prior precision matrix, we show how to derive linear constraints so that the corresponding effect is identified in the additive model. This allows for the use of a wide range of bases and precision matrices in priors for regularization. By introducing indicator variables, each constrained Gaussian prior is augmented with a point mass at zero, thus allowing for function selection. Posterior inference is calculated using Markov chain Monte Carlo and the smoothness in the functions is both the result of shrinkage through the constrained Gaussian prior and model averaging. We show how using non-degenerate priors on the shrinkage parameters enables the application of substantially more computationally efficient sampling schemes than would otherwise be the case. We show the favourable performance of our approach when compared to two contemporary alternative Bayesian methods. To highlight the potential of our approach in high-dimensional settings we apply it to estimate two large seemingly unrelated regression models for intra-day electricity load. Both models feature a variety of different univariate and bivariate functions which require different levels of smoothing, and where component selection is meaningful. Priors for the error disturbance covariances are selected carefully and the empirical results provide a substantive contribution to the electricity load modelling literature in their own right.     

A Markov Switching Factor‐Augmented VAR Model for Analyzing US Business Cycles and Monetary Policy

This paper develops a Markov switching factor‐augmented vector autoregression to investigate the transmission mechanisms of monetary policy for distinct stages of the US business cycle. We assume that autoregressive parameters and covariance matrices of the error terms are regime dependent, driven by an unobserved Markov indicator. Endogenously determined transition probabilities are governed by an underlying probit model that features a large set of possible predictors. The empirical findings provide evidence for differences in the transmission of monetary policy shocks that mainly stem from heterogeneity in the responses of financial market quantities.     

The ACR Model: A Multivariate Dynamic Mixture Autoregression*

This paper proposes and analyses the autoregressive conditional root (ACR) time‐series model. This multivariate dynamic mixture autoregression allows for non‐stationary epochs. It proves to be an appealing alternative to existing nonlinear models, e.g. the threshold autoregressive or Markov switching class of models, which are commonly used to describe nonlinear dynamics as implied by arbitrage in presence of transaction costs. Simple conditions on the parameters of the ACR process and its innovations are shown to imply geometric ergodicity, stationarity and existence of moments. Furthermore, consistency and asymptotic normality of the maximum likelihood estimators are established. An application to real exchange rate data illustrates the analysis.     

Testing the Markov property with high frequency data

This paper develops a framework to nonparametrically test whether discrete-valued irregularly spaced financial transactions data follow a Markov process. For that purpose, we consider a specific optional sampling in which a continuous-time Markov process is observed only when it crosses some discrete level. This framework is convenient for it accommodates the irregular spacing that characterizes transactions data. Under such an observation rule, the current price duration is independent of a previous price duration given the previous price realization. A simple nonparametric test then follows by examining whether this conditional independence property holds. Monte Carlo simulations suggest that the asymptotic test has huge size distortions, though a bootstrap-based variant entails reasonable size and power properties in finite samples. As for an empirical illustration, we investigate whether bid–ask spreads follow Markov processes using transactions data from the New York Stock Exchange. The motivation lies on the fact that asymmetric information models of market microstructures predict that the Markov property does not hold for the bid–ask spread. We robustly reject the Markov assumption for two out of the five stocks under scrutiny. Finally, it is reassuring that our results are consistent with two alternative measures of asymmetric information.     

Identification and estimation of statistical functionals using incomplete data

Incomplete data, due to missing observations or interval measurement of variables, usually cause parameters of interest in applications to be unidentified except under untestable and often controversial assumptions. However, it is often possible to identify sharp bounds on parameters without making untestable assumptions about the process through which data become incomplete. The bounds contain all logically possible values of the parameters and can be estimated consistently by replacing the population distribution of the data with the empirical distribution. This is straightforward in some circumstances but computationally burdensome in others. This paper describes the general problem and presents an empirical illustration.     

Improving Markov switching models using realized variance

This paper proposes a class of models that jointly model returns and ex post variance measures under a Markov switching framework. Both univariate and multivariate return versions of the model are introduced. Estimation can be conducted under a fixed dimension state space or an infinite one. The proposed models can be seen as nonlinear common factor models subject to Markov switching and are able to exploit the information content in both returns and ex post volatility measures. Applications to equity returns compare the proposed models to existing alternatives. The empirical results show that the joint models improve density forecasts for returns and point predictions of return variance. Using the information in ex post volatility measures can increase the precision of parameter estimates, sharpen the inference on the latent state variable, and improve portfolio decisions.     

Markov-switching model selection using Kullback–Leibler divergence

In Markov-switching regression models, we use Kullback–Leibler (KL) divergence between the true and candidate models to select the number of states and variables simultaneously. Specifically, we derive a new information criterion, Markov switching criterion (MSC), which is an estimate of KL divergence. MSC imposes an appropriate penalty to mitigate the over-retention of states in the Markov chain, and it performs well in Monte Carlo studies with single and multiple states, small and large samples, and low and high noise. We illustrate the usefulness of MSC via applications to the U.S. business cycle and to media advertising.     

Exit problems in regime-switching models

This paper provides a general framework for pricing of perpetual American and real options in regime-switching Lévy models. In each state of the Markov chain, which determines switches from one Lévy process to another, the payoff stream is a monotone function of the Lévy process labeled by the state. This allows for additional switching within each state of the Markov chain (payoffs can be different in different regions of the real line). The pricing procedure is efficient even if the number of states is large provided the transition rates are not very large w.r.t. the riskless rates. The payoffs and riskless rates may depend on a state. Special cases are stochastic volatility models and models with stochastic interest rate; both must be modeled as finite-state Markov chains. As an application, we solve exit problems for a price-taking firm, and study the dependence of the exit threshold on the interest rate uncertainty.     

Market fundamentals versus rational bubbles in stock prices: a Bayesian perspective

Using Bayesian Markov chain Monte Carlo methods, we decompose the log price‐dividend ratio into a market fundamentals component and a bubble component. The market fundamentals component depends on expectations of future dividend growth and required returns, while the bubble component is assumed to follow a Markov switching model that allows for the possibility of exploding and collapsing regimes. If prior beliefs allow for the possibility of persistent shocks to dividend growth and/or required returns, the posterior distribution suggests the bubble component contributes virtually nothing to the stock price movements over our sample. On the other hand, if one's priors rule out the possibility of persistent shocks to dividend growth and required returns, the bubble component can have a much larger role to play in stock price movements. However, the regime switching behavior of the bubble bears little resemblance to infrequent switching from an exploding bubble regime to a collapsing or dormant bubble regime. Copyright © 2008 John Wiley & Sons, Ltd.     

Regression density estimation using smooth adaptive Gaussian mixtures

We model a regression density flexibly so that at each value of the covariates the density is a mixture of normals with the means, variances and mixture probabilities of the components changing smoothly as a function of the covariates. The model extends the existing models in two important ways. First, the components are allowed to be heteroscedastic regressions as the standard model with homoscedastic regressions can give a poor fit to heteroscedastic data, especially when the number of covariates is large. Furthermore, we typically need fewer components, which makes it easier to interpret the model and speeds up the computation. The second main extension is to introduce a novel variable selection prior into all the components of the model. The variable selection prior acts as a self-adjusting mechanism that prevents overfitting and makes it feasible to fit flexible high-dimensional surfaces. We use Bayesian inference and Markov Chain Monte Carlo methods to estimate the model. Simulated and real examples are used to show that the full generality of our model is required to fit a large class of densities, but also that special cases of the general model are interesting models for economic data.     

Structural vector autoregressions with Markov switching: Combining conventional with statistical identification of shocks

In structural vector autoregressive (SVAR) analysis a Markov regime switching (MS) property can be exploited to identify shocks if the reduced form error covariance matrix varies across regimes. Unfortunately, these shocks may not have a meaningful structural economic interpretation. It is discussed how statistical and conventional identifying information can be combined. The discussion is based on a VAR model for the US containing oil prices, output, consumer prices and a short-term interest rate. The system has been used for studying the causes of the early millennium economic slowdown based on traditional identification with zero and long-run restrictions and using sign restrictions. We find that previously drawn conclusions are questionable in our framework.     

A Bayesian mixed logit–probit model for multinomial choice

In this paper, we introduce a new flexible mixed model for multinomial discrete choice where the key individual- and alternative-specific parameters of interest are allowed to follow an assumption-free nonparametric density specification, while other alternative-specific coefficients are assumed to be drawn from a multivariate Normal distribution, which eliminates the independence of irrelevant alternatives assumption at the individual level. A hierarchical specification of our model allows us to break down a complex data structure into a set of submodels with the desired features that are naturally assembled in the original system. We estimate the model, using a Bayesian Markov Chain Monte Carlo technique with a multivariate Dirichlet Process (DP) prior on the coefficients with nonparametrically estimated density. We employ a “latent class” sampling algorithm, which is applicable to a general class of models, including non-conjugate DP base priors. The model is applied to supermarket choices of a panel of Houston households whose shopping behavior was observed over a 24-month period in years 2004–2005. We estimate the nonparametric density of two key variables of interest: the price of a basket of goods based on scanner data, and driving distance to the supermarket based on their respective locations. Our semi-parametric approach allows us to identify a complex multi-modal preference distribution, which distinguishes between inframarginal consumers and consumers who strongly value either lower prices or shopping convenience.     

Probabilistic forecasting of industrial electricity load with regime switching behavior

This paper suggests a novel inhomogeneous Markov switching approach for the probabilistic forecasting of industrial companies’ electricity loads, for which the load switches at random times between production and standby regimes. The model that we propose describes the transitions between the regimes using a hidden Markov chain with time-varying transition probabilities that depend on calendar variables. We model the demand during the production regime using an autoregressive moving-average (ARMA) process with seasonal patterns, whereas we use a much simpler model for the standby regime in order to reduce the complexity. The maximum likelihood estimation of the parameters is implemented using a differential evolution algorithm. Using the continuous ranked probability score (CRPS) to evaluate the goodness-of-fit of our model for probabilistic forecasting, it is shown that this model often outperforms classical additive time series models, as well as homogeneous Markov switching models. We also propose a simple procedure for classifying load profiles into those with and without regime-switching behaviors.     

Pseudo-likelihood estimation and bootstrap inference for structural discrete Markov decision models

This paper analyzes the higher-order properties of the estimators based on the nested pseudo-likelihood (NPL) algorithm and the practical implementation of such estimators for parametric discrete Markov decision models. We derive the rate at which the NPL algorithm converges to the MLE and provide a theoretical explanation for the simulation results in Aguirregabiria and Mira [Aguirregabiria, V., Mira, P., 2002. Swapping the nested fixed point algorithm: A class of estimators for discrete Markov decision models. Econometrica 70, 1519–1543], in which iterating the NPL algorithm improves the accuracy of the estimator. We then propose a new NPL algorithm that can achieve quadratic convergence without fully solving the fixed point problem in every iteration and apply our estimation procedure to a finite mixture model. We also develop one-step NPL bootstrap procedures for discrete Markov decision models. The Monte Carlo simulation evidence based on a machine replacement model of Rust [Rust, J., 1987. Optimal replacement of GMC bus engines: An empirical model of Harold Zurcher. Econometrica 55, 999–1033] shows that the proposed one-step bootstrap test statistics and confidence intervals improve upon the first order asymptotics even with a relatively small number of iterations.     

The Credibility of Hong Kong's Currency Board System: Looking Through the Prism of MS‐VAR Models with Time‐Varying Transition Probabilities

This paper employs a Markov regime‐switching VAR model to describe and analyse the time‐varying credibility of Hong Kong's currency board system. The endogenously estimated discrete regime shifts are made dependent on macroeconomic fundamentals. This enables us to determine which changes in macroeconomic variables can trigger switches between the low and high credibility regimes. We carry out extensive testing to search for the most appropriate specification of the Markov regime‐switching model. We find strong evidence of regime switching behaviour that portrays the time‐varying nature of credibility in the historical data.     

COINTEGRATION AND CHANGES IN REGIME: THE JAPANESE CONSUMPTION FUNCTION

In this paper we examine a model of cointegration where long-run parameters are subject to switching between several different cointegrating regimes. These shifts are allowed to be governed by the outcome of an unobserved Markov chain with unknown transition probabilities. We illustrate this approach using Japanese data on consumption and disposable income, and find that the data favour a Markov-switching long-run relationship over a standard temporally stable formulation. © 1997 by John Wiley & Sons, Ltd.     

A flexible approach to parametric inference in nonlinear and time varying time series models

Many structural break and regime-switching models have been used with macroeconomic and financial data. In this paper, we develop an extremely flexible modeling approach which can accommodate virtually any of these specifications. We build on earlier work showing the relationship between flexible functional forms and random variation in parameters. Our contribution is based around the use of priors on the time variation that is developed from considering a hypothetical reordering of the data and distance between neighboring (reordered) observations. The range of priors produced in this way can accommodate a wide variety of nonlinear time series models, including those with regime-switching and structural breaks. By allowing the amount of random variation in parameters to depend on the distance between (reordered) observations, the parameters can evolve in a wide variety of ways, allowing for everything from models exhibiting abrupt change (e.g. threshold autoregressive models or standard structural break models) to those which allow for a gradual evolution of parameters (e.g. smooth transition autoregressive models or time varying parameter models). Bayesian econometric methods for inference are developed for estimating the distance function and types of hypothetical reordering. Conditional on a hypothetical reordering and distance function, a simple reordering of the actual data allows us to estimate our models with standard state space methods by a simple adjustment to the measurement equation. We use artificial data to show the advantages of our approach, before providing two empirical illustrations involving the modeling of real GDP growth.