A simple approach to the parametric estimation of potentially nonstationary diffusions

A simple and robust approach is proposed for the parametric estimation of scalar homogeneous stochastic differential equations. We specify a parametric class of diffusions and estimate the parameters of interest by minimizing criteria based on the integrated squared difference between kernel estimates of the drift and diffusion functions and their parametric counterparts. The procedure does not require simulations or approximations to the true transition density and has the simplicity of standard nonlinear least-squares methods in discrete time. A complete asymptotic theory for the parametric estimates is developed. The limit theory relies on infill and long span asymptotics and is robust to deviations from stationarity, requiring only recurrence.     

Empirical likelihood-based inference for nonparametric recurrent diffusions

This paper provides a new approach to constructing confidence intervals for nonparametric drift and diffusion functions in the continuous-time diffusion model via empirical likelihood (EL). The log EL ratios are constructed through the estimating equations satisfied by the local linear estimators. Limit theories are developed by means of increasing time span and shrinking observational intervals. The results apply to both stationary and nonstationary recurrent diffusion processes. Simulations show that for both drift and diffusion functions, the new procedure performs remarkably well in finite samples and clearly dominates the conventional method in constructing confidence intervals based on asymptotic normality. An empirical example is provided to illustrate the usefulness of the proposed method.     

Functional regression of continuous state distributions

In this paper, we consider a regression model to study the distributional relationship between economic variables. Unlike the classical regression dealing exclusively with mean relationship, our model can be used to analyze the entire dependent structure in distribution. Technically, we treat density functions as random elements and represent the regression relationship as a compact linear operator in the Hilbert spaces of square integrable functions. We propose a consistent estimation procedure for our model, and develop a test to investigate the dependent structure of moments. An empirical example is provided to illustrate how our methodology can be implemented in practical applications.     

Parameter estimation and bias correction for diffusion processes

This paper considers parameter estimation for continuous-time diffusion processes which are commonly used to model dynamics of financial securities including interest rates. To understand why the drift parameters are more difficult to estimate than the diffusion parameter, as observed in previous studies, we first develop expansions for the bias and variance of parameter estimators for two of the most employed interest rate processes, Vasicek and CIR processes. Then, we study the first order approximate maximum likelihood estimator for linear drift processes. A parametric bootstrap procedure is proposed to correct bias for general diffusion processes with a theoretical justification. Simulation studies confirm the theoretical findings and show that the bootstrap proposal can effectively reduce both the bias and the mean square error of parameter estimates, for both univariate and multivariate processes. The advantages of using more accurate parameter estimators when calculating various option prices in finance are demonstrated by an empirical study.     

Semi-nonparametric estimation and misspecification testing of diffusion models

Novel transition-based misspecification tests of semiparametric and fully parametric univariate diffusion models based on the estimators developed in [Kristensen, D., 2010. Pseudo-maximum likelihood estimation in two classes of semiparametric diffusion models. Journal of Econometrics 156, 239-259] are proposed. It is demonstrated that transition-based tests in general lack power in detecting certain departures from the null since they integrate out local features of the drift and volatility. As a solution to this, tests that directly compare drift and volatility estimators under the relevant null and alternative are also developed which exhibit better power against local alternatives.     

A martingale approach for testing diffusion models based on infinitesimal operator

I develop an omnibus specification test for diffusion models based on the infinitesimal operator. The infinitesimal operator based identification of the diffusion process is equivalent to a “martingale hypothesis” for the processes obtained by a transformation of the original diffusion model. My test procedure is then constructed by checking the “martingale hypothesis” via a multivariate generalized spectral derivative based approach that delivers a N(0,1) asymptotical null distribution for the test statistic. The infinitesimal operator of the diffusion process is a closed-form function of drift and diffusion terms. Consequently, my test procedure covers both univariate and multivariate diffusion models in a unified framework and is particularly convenient for the multivariate case. Moreover, different transformed martingale processes contain separate information about the drift and diffusion specifications. This motivates me to propose a separate inferential test procedure to explore the sources of rejection when a parametric form is rejected. Simulation studies show that the proposed tests have reasonable size and excellent power performance. An empirical application of my test procedure using Eurodollar interest rates finds that most popular short-rate models are rejected and the drift misspecification plays an important role in such rejections.     

Closed-form likelihood expansions for multivariate time-inhomogeneous diffusions

The aim of this paper is to find approximate log-transition density functions for multivariate time-inhomogeneous diffusions in closed form. There are many empirical evidences supporting that the data generating process governing dynamics of many economics variables might vary over time because of economic climate changes or time effects. One possible way to explain the time-dependent dynamics of state variables is to model the drift or volatility terms as functions of time t$t$ as well as state variables. A way to find closed-form likelihood expansion for a multivariate time-homogeneous diffusion has been developed by Aït-Sahalia (2008). This research is built on his work and extends his results to time-inhomogeneous cases. We conduct Monte Carlo simulation studies to examine performance of the approximate transition density function when it is used to obtain ML estimates. The results reveal that our method yields a very accurate approximate likelihood function, which can be a good candidate when the true likelihood function is unavailable as is often the case.     

Estimation of semiparametric locally stationary diffusion models

This paper proposes a class of locally stationary diffusion processes. The model has a time varying but locally linear drift and a volatility coefficient that is allowed to vary over time and space. The model is semiparametric because we allow these functions to be unknown and the innovation process is parametrically specified, indeed completely known. We propose estimators of all the unknown quantities based on long span data. Our estimation method makes use of the property of local stationarity. We establish asymptotic theory for the proposed estimators as the time span increases, so we do not rely on infill asymptotics. We apply this method to interest rate data to illustrate the validity of our model. Finally, we present a simulation study to provide the finite-sample performance of the proposed estimators.     

Estimation of objective and risk-neutral distributions based on moments of integrated volatility

In this paper, we present an estimation procedure which uses both option prices and high-frequency spot price feeds to estimate jointly the objective and risk-neutral parameters of stochastic volatility models. The procedure is based on a method of moments that uses analytical expressions for the moments of the integrated volatility and series expansions of option prices and implied volatilities. This results in an easily implementable and rapid estimation technique. An extensive Monte Carlo study compares various procedures and shows the efficiency of our approach. Empirical applications to the Deutsche mark–US dollar exchange rate futures and the S&P 500 index provide evidence that the method delivers results that are in line with the ones obtained in previous studies where much more involved estimation procedures were used.     

Econometric estimation in long-range dependent volatility models: Theory and practice

It is commonly accepted that some financial data may exhibit long-range dependence, while other financial data exhibit intermediate-range dependence or short-range dependence. These behaviours may be fitted to a continuous-time fractional stochastic model. The estimation procedure proposed in this paper is based on a continuous-time version of the Gauss–Whittle objective function to find the parameter estimates that minimize the discrepancy between the spectral density and the data periodogram. As a special case, the proposed estimation procedure is applied to a class of fractional stochastic volatility models to estimate the drift, standard deviation and memory parameters of the volatility process under consideration. As an application, the volatility of the Dow Jones, S&P 500, CAC 40, DAX 30, FTSE 100 and NIKKEI 225 is estimated.     

Panel data models with multiple time-varying individual effects

This paper considers a panel data model with time-varying individual effects. The data are assumed to contain a large number of cross-sectional units repeatedly observed over a fixed number of time periods. The model has a feature of the fixed-effects model in that the effects are assumed to be correlated with the regressors. The unobservable individual effects are assumed to have a factor structure. For consistent estimation of the model, it is important to estimate the true number of individual effects. We propose a generalized methods of moments procedure by which both the number of individual effects and the regression coefficients can be consistently estimated. Some important identification issues are also discussed. Our simulation results indicate that the proposed methods produce reliable estimates.     

Semiparametric estimation of Markov decision processes with continuous state space

We propose a general two-step estimator for a popular Markov discrete choice model that includes a class of Markovian games with continuous observable state space. Our estimation procedure generalizes the computationally attractive methodology of Pesendorfer and Schmidt-Dengler (2008) that assumed finite observable states. This extension is non-trivial as the policy value functions are solutions to some type II integral equations. We show that the inverse problem is well-posed. We provide a set of primitive conditions to ensure root-T consistent estimation for the finite dimensional structural parameters and the distribution theory for the value functions in a time series framework.     

Efficient estimation of probit models with correlated errors

Maximum Likelihood (ML) estimation of probit models with correlated errors typically requires high-dimensional truncated integration. Prominent examples of such models are multinomial probit models and binomial panel probit models with serially correlated errors. In this paper we propose to use a generic procedure known as Efficient Importance Sampling (EIS) for the evaluation of likelihood functions for probit models with correlated errors. Our proposed EIS algorithm covers the standard GHK probability simulator as a special case. We perform a set of Monte Carlo experiments in order to illustrate the relative performance of both procedures for the estimation of a multinomial multiperiod probit model. Our results indicate substantial numerical efficiency gains for ML estimates based on the GHK–EIS procedure relative to those obtained by using the GHK procedure.     

Distribution free estimation of heteroskedastic binary response models using Probit/Logit criterion functions

In this paper estimators for distribution free heteroskedastic binary response models are proposed. The estimation procedures are based on relationships between distribution free models with a conditional median restriction and parametric models (such as Probit/Logit) exhibiting (multiplicative) heteroskedasticity. The first proposed estimator is based on the observational equivalence between the two models, and is a semiparametric sieve estimator (see, e.g. Gallant and Nychka (1987), Ai and Chen (2003) and Chen et al. (2005)) for the regression coefficients, based on maximizing standard Logit/Probit criterion functions, such as NLLS and MLE. This procedure has the advantage that choice probabilities and regression coefficients are estimated simultaneously. The second proposed procedure is based on the equivalence between existing semiparametric estimators for the conditional median model (,  and ) and the standard parametric (Probit/Logit) NLLS estimator. This estimator has the advantage of being implementable with standard software packages such as Stata. Distribution theory is developed for both estimators and a Monte Carlo study indicates they both perform well in finite samples.     

Markov-switching models with endogenous explanatory variables II: A two-step MLE procedure

This paper proposes a two-step maximum likelihood estimation (MLE) procedure to deal with the problem of endogeneity in Markov-switching regression models. A joint estimation procedure provides us with an asymptotically most efficient estimator, but it is not always feasible, due to the ‘curse of dimensionality’ in the matrix of transition probabilities. A two-step estimation procedure, which ignores potential correlation between the latent state variables, suffers less from the ‘curse of dimensionality’, and it provides a reasonable alternative to the joint estimation procedure. In addition, our Monte Carlo experiments show that the two-step estimation procedure can be more efficient than the joint estimation procedure in finite samples, when there is zero or low correlation between the latent state variables.     

Partial parametric estimation for nonstationary nonlinear regressions

This paper proposes an estimation method for a partial parametric model with multiple integrated time series. Our estimation procedure is based on the decomposition of the nonparametric part of the regression function into homogeneous and integrable components. It consists of two steps: In the first step we parameterize and fit the homogeneous component of the nonparametric part by the nonlinear least squares with other parametric terms in the model, and use in the second step the standard kernel method to nonparametrically estimate the integrable component of the nonparametric part from the residuals in the first step. We establish consistency and obtain the asymptotic distribution of our estimator. A simulation shows that our estimator performs well in finite samples. For the empirical illustration, we estimate the money demand functions for the US and Japan using our model and methodology.     

Pseudo-maximum likelihood estimation in two classes of semiparametric diffusion models

Two classes of semiparametric diffusion models are considered, where either the drift or the diffusion term is parameterized, while the other term is left unspecified. We propose a pseudo-maximum likelihood estimator (PMLE) of the parametric component that maximizes the likelihood with a preliminary estimator of the unspecified term plugged in. It is demonstrated how models and estimators can be used in a two-step specification testing strategy of semiparametric and fully parametric models, and shown that approximate/simulated versions of the PMLE inherit the properties of the actual but infeasible estimator. A simulation study investigates the finite sample performance of the PMLE.     

Robust and consistent estimation of nonlinear errors-in-variables models

This paper considers the consistent estimation of nonlinear errors-in-variables models. It adopts the functional modeling approach by assuming that the true but unobserved regressors are random variables but making no parametric assumption on the distribution from which the latent variables are drawn. This paper shows how the information extracted from the replicate measurements can be used to identify and consistently estimate a general nonlinear errors-in-variables model. The identification is established through characteristic functions. The estimation procedure involves nonparametric estimation of the conditional density of the latent variables given the measurements using the identification results at the first stage, and at the second stage, a semiparametric nonlinear least-squares estimator is proposed. The consistency of the proposed estimator is also established. Finite sample performance of the estimator is investigated through a Monte Carlo study.     

Nonparametric function estimation subject to monotonicity, convexity and other shape constraints

This paper uses free-knot and fixed-knot regression splines in a Bayesian context to develop methods for the nonparametric estimation of functions subject to shape constraints in models with log-concave likelihood functions. The shape constraints we consider include monotonicity, convexity and functions with a single minimum. A computationally efficient MCMC sampling algorithm is developed that converges faster than previous methods for non-Gaussian models. Simulation results indicate the monotonically constrained function estimates have good small sample properties relative to (i) unconstrained function estimates, and (ii) function estimates obtained from other constrained estimation methods when such methods exist. Also, asymptotic results show the methodology provides consistent estimates for a large class of smooth functions. Two detailed illustrations exemplify the ideas.     

Empirical likelihood block bootstrapping

Monte Carlo evidence has made it clear that asymptotic tests based on generalized method of moments (GMM) estimation have disappointing size. The problem is exacerbated when the moment conditions are serially correlated. Several block bootstrap techniques have been proposed to correct the problem, including Hall and Horowitz (1996) and Inoue and Shintani (2006). We propose an empirical likelihood block bootstrap procedure to improve inference where models are characterized by nonlinear moment conditions that are serially correlated of possibly infinite order. Combining the ideas of Kitamura (1997) and Brown and Newey (2002), the parameters of a model are initially estimated by GMM which are then used to compute the empirical likelihood probability weights of the blocks of moment conditions. The probability weights serve as the multinomial distribution used in resampling. The first-order asymptotic validity of the proposed procedure is proven, and a series of Monte Carlo experiments show it may improve test sizes over conventional block bootstrapping.