Estimation of copula-based semiparametric time series models

This paper studies the estimation of a class of copula-based semiparametric stationary Markov models. These models are characterized by nonparametric marginal distributions and parametric copula functions, while the copulas capture all the scale-free temporal dependence of the processes. Simple estimators of the marginal distribution and the copula parameter are provided, and their asymptotic properties are established under easily verifiable conditions. These results are used to obtain root-n consistent and asymptotically normal estimators of important features of the transition distribution such as the (nonlinear) conditional moments and conditional quantiles. The semiparametric conditional quantile estimators are automatically monotonic across quantiles, which is attractive for portfolio conditional value-at-risk calculations.     

Distribution free estimation of heteroskedastic binary response models using Probit/Logit criterion functions

In this paper estimators for distribution free heteroskedastic binary response models are proposed. The estimation procedures are based on relationships between distribution free models with a conditional median restriction and parametric models (such as Probit/Logit) exhibiting (multiplicative) heteroskedasticity. The first proposed estimator is based on the observational equivalence between the two models, and is a semiparametric sieve estimator (see, e.g. Gallant and Nychka (1987), Ai and Chen (2003) and Chen et al. (2005)) for the regression coefficients, based on maximizing standard Logit/Probit criterion functions, such as NLLS and MLE. This procedure has the advantage that choice probabilities and regression coefficients are estimated simultaneously. The second proposed procedure is based on the equivalence between existing semiparametric estimators for the conditional median model (,  and ) and the standard parametric (Probit/Logit) NLLS estimator. This estimator has the advantage of being implementable with standard software packages such as Stata. Distribution theory is developed for both estimators and a Monte Carlo study indicates they both perform well in finite samples.     

Nonparametric estimation of conditional VaR and expected shortfall

This paper considers a new nonparametric estimation of conditional value-at-risk and expected shortfall functions. Conditional value-at-risk is estimated by inverting the weighted double kernel local linear estimate of the conditional distribution function. The nonparametric estimator of conditional expected shortfall is constructed by a plugging-in method. Both the asymptotic normality and consistency of the proposed nonparametric estimators are established at both boundary and interior points for time series data. We show that the weighted double kernel local linear conditional distribution estimator has the advantages of always being a distribution, continuous, and differentiable, besides the good properties from both the double kernel local linear and weighted Nadaraya–Watson estimators. Moreover, an ad hoc data-driven fashion bandwidth selection method is proposed, based on the nonparametric version of the Akaike information criterion. Finally, an empirical study is carried out to illustrate the finite sample performance of the proposed estimators.     

Semiparametric and nonparametric estimation of sample selection models under symmetry

This paper considers the semiparametric estimation of binary choice sample selection models under a joint symmetry assumption. Our approaches overcome various drawbacks associated with existing estimators. In particular, our method provides root-n$n$ consistent estimators for both the intercept and slope parameters of the outcome equation in a heteroscedastic framework, without the usual cross equation exclusion restriction or parametric specification for the error distribution and/or the form of heteroscedasticity. Our two-step estimators are shown to be consistent and asymptotically normal. A Monte Carlo simulation study indicates the usefulness of our approaches.     

Instrumental variables estimators of nonparametric models with discrete endogenous regressors

This paper discusses estimation of nonparametric models whose regressor vectors consist of a vector of exogenous variables and a univariate discrete endogenous regressor with finite support. Both identification and estimators are derived from a transform of the model that evaluates the nonparametric structural function via indicator functions in the support of the discrete regressor. A two-step estimator is proposed where the first step constitutes nonparametric estimation of the instrument and the second step is a nonparametric version of two-stage least squares. Linear functionals of the model are shown to be asymptotically normal, and a consistent estimator of the asymptotic covariance matrix is described. For the binary endogenous regressor case, it is shown that one functional of the model is a conditional (on covariates) local average treatment effect, that permits both unobservable and observable heterogeneity in treatments. Finite sample properties of the estimators from a Monte Carlo simulation study illustrate the practicability of the proposed estimators.     

Local polynomial estimation of nonparametric simultaneous equations models

We define a new procedure for consistent estimation of nonparametric simultaneous equations models under the conditional mean independence restriction of Newey et al. [1999. Nonparametric estimation of triangular simultaneous equation models. Econometrica 67, 565–603]. It is based upon local polynomial regression and marginal integration techniques. We establish the asymptotic distribution of our estimator under weak data dependence conditions. Simulation evidence suggests that our estimator may significantly outperform the estimators of Pinkse [2000. Nonparametric two-step regression estimation when regressors and errors are dependent. Canadian Journal of Statistics 28, 289–300] and Newey and Powell [2003. Instrumental variable estimation of nonparametric models. Econometrica 71, 1565–1578].     

A flexible parametric approach for estimating switching regime models and treatment effect parameters

In this paper, we propose a flexible, parametric class of switching regime models allowing for both skewed and fat-tailed outcome and selection errors. Specifically, we model the joint distribution of each outcome error and the selection error via a newly constructed class of multivariate distributions which we call generalized normal mean–variance mixture distributions. We extend Heckman’s two-step estimation procedure for the Gaussian switching regime model to the new class of models. When the distributions of the outcome errors are asymmetric, we show that an additional correction term accounting for skewness in the outcome error distribution (besides the analogue of the well known inverse mill’s ratio) needs to be included in the second step regression. We use the two-step estimators of parameters in the model to construct simple estimators of average treatment effects and establish their asymptotic properties. Simulation results confirm the importance of accounting for skewness in the outcome errors in estimating both model parameters and the average treatment effect and the treatment effect for the treated.     

Bayesian modeling of joint and conditional distributions

In this paper, we study a Bayesian approach to flexible modeling of conditional distributions. The approach uses a flexible model for the joint distribution of the dependent and independent variables and then extracts the conditional distributions of interest from the estimated joint distribution. We use a finite mixture of multivariate normals (FMMN) to estimate the joint distribution. The conditional distributions can then be assessed analytically or through simulations. The discrete variables are handled through the use of latent variables. The estimation procedure employs an MCMC algorithm. We provide a characterization of the Kullback–Leibler closure of FMMN and show that the joint and conditional predictive densities implied by the FMMN model are consistent estimators for a large class of data generating processes with continuous and discrete observables. The method can be used as a robust regression model with discrete and continuous dependent and independent variables and as a Bayesian alternative to semi- and non-parametric models such as quantile and kernel regression. In experiments, the method compares favorably with classical nonparametric and alternative Bayesian methods.     

Conditional moment models under semi-strong identification

We consider conditional moment models under semi-strong identification. Identification strength is directly defined through the conditional moments that flatten as the sample size increases. Our new minimum distance estimator is consistent, asymptotically normal, robust to semi-strong identification, and does not rely on the choice of a user-chosen parameter, such as the number of instruments or some smoothing parameter. Heteroskedasticity-robust inference is possible through Wald testing without prior knowledge of the identification pattern. Simulations show that our estimator is competitive with alternative estimators based on many instruments, being well-centered with better coverage rates for confidence intervals.     

A regularization approach to the many instruments problem

This paper focuses on the estimation of a finite dimensional parameter in a linear model where the number of instruments is very large or infinite. In order to improve the small sample properties of standard instrumental variable (IV) estimators, we propose three modified IV estimators based on three different ways of inverting the covariance matrix of the instruments. These inverses involve a regularization or smoothing parameter. It should be stressed that no restriction on the number of instruments is needed and that all the instruments are used in the estimation. We show that the three estimators are asymptotically normal and attain the semiparametric efficiency bound. Higher-order analysis of the MSE reveals that the bias of the modified estimators does not depend on the number of instruments. Finally, we suggest a data-driven method for selecting the regularization parameter. Interestingly, our regularization techniques lead to a consistent nonparametric estimation of the optimal instrument.     

Partial parametric estimation for nonstationary nonlinear regressions

This paper proposes an estimation method for a partial parametric model with multiple integrated time series. Our estimation procedure is based on the decomposition of the nonparametric part of the regression function into homogeneous and integrable components. It consists of two steps: In the first step we parameterize and fit the homogeneous component of the nonparametric part by the nonlinear least squares with other parametric terms in the model, and use in the second step the standard kernel method to nonparametrically estimate the integrable component of the nonparametric part from the residuals in the first step. We establish consistency and obtain the asymptotic distribution of our estimator. A simulation shows that our estimator performs well in finite samples. For the empirical illustration, we estimate the money demand functions for the US and Japan using our model and methodology.     

Zero truncated Poisson integer-valued AR(1) model

In this paper, we introduce a new stationary integer-valued autoregressive process of the first order with zero truncated Poisson marginal distribution. We consider some properties of this process, such as autocorrelations, spectral density and multi-step ahead conditional expectation, variance and probability generating function. Stationary solution and its uniqueness are obtained with a discussion to strict stationarity and ergodicity of such process. We estimate the unknown parameters by using conditional least squares estimation, nonparametric estimation and maximum likelihood estimation. The asymptotic properties and asymptotic distributions of the conditional least squares estimators have been investigated. Some numerical results of the estimators are presented and some sample paths of the process are illustrated. Some possible applications of the introduced model are discussed.     

An integrated maximum score estimator for a generalized censored quantile regression model

Quantile regression techniques have been widely used in empirical economics. In this paper, we consider the estimation of a generalized quantile regression model when data are subject to fixed or random censoring. Through a discretization technique, we transform the censored regression model into a sequence of binary choice models and further propose an integrated smoothed maximum score estimator by combining individual binary choice models, following the insights of Horowitz (1992) and Manski (1985). Unlike the estimators of Horowitz (1992) and Manski (1985), our estimators converge at the usual parametric rate through an integration process. In the case of fixed censoring, our approach overcomes a major drawback of existing approaches associated with the curse-of-dimensionality problem. Our approach for the fixed censored case can be extended readily to the case with random censoring for which other existing approaches are no longer applicable. Both of our estimators are consistent and asymptotically normal. A simulation study demonstrates that our estimators perform well in finite samples.     

Nonparametric identification and estimation of sample selection models under symmetry

Under a conditional mean restriction Das et al. (2003) considered nonparametric estimation of sample selection models. However, their method can only identify the outcome regression function up to a constant. In this paper we strengthen the conditional mean restriction to a symmetry restriction under which selection biases due to selection on unobservables can be eliminated through proper matching of propensity scores; consequently we are able to identify and obtain consistent estimators for the average treatment effects and the structural regression functions. The results from a simulation study suggest that our estimators perform satisfactorily.     

Robust and consistent estimation of nonlinear errors-in-variables models

This paper considers the consistent estimation of nonlinear errors-in-variables models. It adopts the functional modeling approach by assuming that the true but unobserved regressors are random variables but making no parametric assumption on the distribution from which the latent variables are drawn. This paper shows how the information extracted from the replicate measurements can be used to identify and consistently estimate a general nonlinear errors-in-variables model. The identification is established through characteristic functions. The estimation procedure involves nonparametric estimation of the conditional density of the latent variables given the measurements using the identification results at the first stage, and at the second stage, a semiparametric nonlinear least-squares estimator is proposed. The consistency of the proposed estimator is also established. Finite sample performance of the estimator is investigated through a Monte Carlo study.     

Functional coefficient regression models with time trend

We consider the problem of estimating a varying coefficient regression model when regressors include a time trend. We show that the commonly used local constant kernel estimation method leads to an inconsistent estimation result, while a local polynomial estimator yields a consistent estimation result. We establish the asymptotic normality result for the proposed estimator. We also provide asymptotic analysis of the data-driven (least squares cross validation) method of selecting the smoothing parameters. In addition, we consider a partially linear time trend model and establish the asymptotic distribution of our proposed estimator. Two test statistics are proposed to test the null hypotheses of a linear and of a partially linear time trend models. Simulations are reported to examine the finite sample performances of the proposed estimators and the test statistics.     

Efficient estimation for error component seemingly unrelated nonparametric regression models

Multivariate panel data provides a unique opportunity in studying the joint evolution of multiple response variables over time. In this paper, we propose an error component seemingly unrelated nonparametric regression model to fit the multivariate panel data, which is more flexible than the traditional error component seemingly unrelated parametric regression. By applying the undersmoothing technique and taking both of the correlations within and among responses into account, we propose an efficient two-stage local polynomial estimation for the unknown functions. It is shown that the resulting estimators are asymptotically normal, and have the same biases as the standard local polynomial estimators, which are only based on the individual response, and smaller asymptotic variances. The performance of the proposed procedure is evaluated through a simulation study and a real data set.     

Large sample estimation and testing procedures for dynamic equation systems

Joint two-step estimation procedures which have the same asymptotic properties as the maximum likelihood (ML) estimator are developed for the final equation, transfer function and structural form of a multivariate dynamic model with normally distributed vector-moving average errors. The ML estimator under fixed and known initial values is obtained by iterating the procedure until convergence. The asymptotic distribution of the two-step estimators is used to construct large sample testing procedures for the different forms of the model.     

Semiparametric estimation of logistic regression model with missing covariates and outcome

We consider a semiparametric method to estimate logistic regression models with missing both covariates and an outcome variable, and propose two new estimators. The first, which is based solely on the validation set, is an extension of the validation likelihood estimator of Breslow and Cain (Biometrika 75:11–20, 1988). The second is a joint conditional likelihood estimator based on the validation and non-validation data sets. Both estimators are semiparametric as they do not require any model assumptions regarding the missing data mechanism nor the specification of the conditional distribution of the missing covariates given the observed covariates. The asymptotic distribution theory is developed under the assumption that all covariate variables are categorical. The finite-sample properties of the proposed estimators are investigated through simulation studies showing that the joint conditional likelihood estimator is the most efficient. A cable TV survey data set from Taiwan is used to illustrate the practical use of the proposed methodology.     

Nonparametric expected shortfall forecasting incorporating weighted quantiles

A new semi-parametric expected shortfall (ES) estimation and forecasting framework is proposed. The proposed approach is based on a two-step estimation procedure. The first step involves the estimation of value at risk (VaR) at different quantile levels through a set of quantile time series regressions. Then, the ES is computed as a weighted average of the estimated quantiles. The quantile weighting structure is parsimoniously parameterized by means of a beta weight function whose coefficients are optimized by minimizing a joint VaR and ES loss function of the Fissler–Ziegel class. The properties of the proposed approach are first evaluated with an extensive simulation study using two data generating processes. Two forecasting studies with different out-of-sample sizes are then conducted, one of which focuses on the 2008 Global Financial Crisis period. The proposed models are applied to seven stock market indices, and their forecasting performances are compared to those of a range of parametric, non-parametric, and semi-parametric models, including GARCH, conditional autoregressive expectile (CARE), joint VaR and ES quantile regression models, and a simple average of quantiles. The results of the forecasting experiments provide clear evidence in support of the proposed models.