Choosing instrumental variables in conditional moment restriction models

Properties of GMM estimators are sensitive to the choice of instrument. Using many instruments leads to high asymptotic asymptotic efficiency but can cause high bias and/or variance in small samples. In this paper we develop and implement asymptotic mean square error (MSE) based criteria for instrument selection in estimation of conditional moment restriction models. The models we consider include various nonlinear simultaneous equations models with unknown heteroskedasticity. We develop moment selection criteria for the familiar two-step optimal GMM estimator (GMM), a bias corrected version, and generalized empirical likelihood estimators (GEL), that include the continuous updating estimator (CUE) as a special case. We also find that the CUE has lower higher-order variance than the bias-corrected GMM estimator, and that the higher-order efficiency of other GEL estimators depends on conditional kurtosis of the moments.     

Local polynomial estimation of nonparametric simultaneous equations models

We define a new procedure for consistent estimation of nonparametric simultaneous equations models under the conditional mean independence restriction of Newey et al. [1999. Nonparametric estimation of triangular simultaneous equation models. Econometrica 67, 565–603]. It is based upon local polynomial regression and marginal integration techniques. We establish the asymptotic distribution of our estimator under weak data dependence conditions. Simulation evidence suggests that our estimator may significantly outperform the estimators of Pinkse [2000. Nonparametric two-step regression estimation when regressors and errors are dependent. Canadian Journal of Statistics 28, 289–300] and Newey and Powell [2003. Instrumental variable estimation of nonparametric models. Econometrica 71, 1565–1578].     

Distribution free estimation of heteroskedastic binary response models using Probit/Logit criterion functions

In this paper estimators for distribution free heteroskedastic binary response models are proposed. The estimation procedures are based on relationships between distribution free models with a conditional median restriction and parametric models (such as Probit/Logit) exhibiting (multiplicative) heteroskedasticity. The first proposed estimator is based on the observational equivalence between the two models, and is a semiparametric sieve estimator (see, e.g. Gallant and Nychka (1987), Ai and Chen (2003) and Chen et al. (2005)) for the regression coefficients, based on maximizing standard Logit/Probit criterion functions, such as NLLS and MLE. This procedure has the advantage that choice probabilities and regression coefficients are estimated simultaneously. The second proposed procedure is based on the equivalence between existing semiparametric estimators for the conditional median model (,  and ) and the standard parametric (Probit/Logit) NLLS estimator. This estimator has the advantage of being implementable with standard software packages such as Stata. Distribution theory is developed for both estimators and a Monte Carlo study indicates they both perform well in finite samples.     

Censored regression quantiles with endogenous regressors

This paper develops a semiparametric method for estimation of the censored regression model when some of the regressors are endogenous (and continuously distributed) and instrumental variables are available for them. A “distributional exclusion” restriction is imposed on the unobservable errors, whose conditional distribution is assumed to depend on the regressors and instruments only through a lower-dimensional “control variable,” here assumed to be the difference between the endogenous regressors and their conditional expectations given the instruments. This assumption, which implies a similar exclusion restriction for the conditional quantiles of the censored dependent variable, is used to motivate a two-stage estimator of the censored regression coefficients. In the first stage, the conditional quantile of the dependent variable given the instruments and the regressors is nonparametrically estimated, as are the first-stage reduced-form residuals to be used as control variables. The second-stage estimator is a weighted least squares regression of pairwise differences in the estimated quantiles on the corresponding differences in regressors, using only pairs of observations for which both estimated quantiles are positive (i.e., in the uncensored region) and the corresponding difference in estimated control variables is small. The paper gives the form of the asymptotic distribution for the proposed estimator, and discusses how it compares to similar estimators for alternative models.     

Set identification via quantile restrictions in short panels

This paper studies the identifying power of conditional quantile restrictions in short panels with fixed effects. In contrast to classical fixed effects models with conditional mean restrictions, conditional quantile restrictions are not preserved by taking differences in the regression equation over time. This paper shows however that a conditional quantile restriction, in conjunction with a weak conditional independence restriction, provides bounds on quantiles of differences in time-varying unobservables across periods. These bounds carry observable implications for model parameters which generally result in set identification. The analysis of these bounds includes conditions for point identification of the parameter vector, as well as weaker conditions that result in point identification of individual parameter components.     

Multiplicative-error models with sample selection

This paper presents a simple approach to deal with sample selection in models with multiplicative errors. Models for non-negative limited dependent variables such as counts fit this framework. The approach builds on a specification of the conditional mean of the outcome only and is, therefore, semiparametric in nature. GMM estimators are constructed for both cross-section data and for panel data. We derive distribution theory and present Monte Carlo evidence on the finite-sample performance of the estimators.     

Conditional empirical likelihood estimation and inference for quantile regression models

This paper considers two empirical likelihood-based estimation, inference, and specification testing methods for quantile regression models. First, we apply the method of conditional empirical likelihood (CEL) by Kitamura et al. [2004. Empirical likelihood-based inference in conditional moment restriction models. Econometrica 72, 1667–1714] and Zhang and Gijbels [2003. Sieve empirical likelihood and extensions of the generalized least squares. Scandinavian Journal of Statistics 30, 1–24] to quantile regression models. Second, to avoid practical problems of the CEL method induced by the discontinuity in parameters of CEL, we propose a smoothed counterpart of CEL, called smoothed conditional empirical likelihood (SCEL). We derive asymptotic properties of the CEL and SCEL estimators, parameter hypothesis tests, and model specification tests. Important features are (i) the CEL and SCEL estimators are asymptotically efficient and do not require preliminary weight estimation; (ii) by inverting the CEL and SCEL ratio parameter hypothesis tests, asymptotically valid confidence intervals can be obtained without estimating the asymptotic variances of the estimators; and (iii) in contrast to CEL, the SCEL method can be implemented by some standard Newton-type optimization. Simulation results demonstrate that the SCEL method in particular compares favorably with existing alternatives.     

A Test of the Conditional Independence Assumption in Sample Selection Models

Identification in most sample selection models depends on the independence of the regressors and the error terms conditional on the selection probability. All quantile and mean functions are parallel in these models; this implies that quantile estimators cannot reveal any—per assumption non‐existing—heterogeneity. Quantile estimators are nevertheless useful for testing the conditional independence assumption because they are consistent under the null hypothesis. We propose tests of the Kolmogorov–Smirnov type based on the conditional quantile regression process. Monte Carlo simulations show that their size is satisfactory and their power sufficient to detect deviations under plausible data‐generating processes. We apply our procedures to female wage data from the 2011 Current Population Survey and show that homogeneity is clearly rejected. Copyright © 2015 John Wiley & Sons, Ltd.     

Endogenous selection or treatment model estimation

In a sample selection or treatment effects model, common unobservables may affect both the outcome and the probability of selection in unknown ways. This paper shows that the distribution function of potential outcomes, conditional on covariates, can be identified given an observed variable V$V$ that affects the treatment or selection probability in certain ways and is conditionally independent of the error terms in a model of potential outcomes. Selection model estimators based on this identification are provided, which take the form of simple weighted averages, GMM, or two stage least squares. These estimators permit endogenous and mismeasured regressors. Empirical applications are provided to estimation of a firm investment model and a schooling effects on wages model.     

Generalized R-estimators under conditional heteroscedasticity

In this paper, we extend the classical idea of Rank estimation of parameters from homoscedastic problems to heteroscedastic problems. In particular, we define a class of rank estimators of the parameters associated with the conditional mean function of an autoregressive model through a three-steps procedure and then derive their asymptotic distributions. The class of models considered includes Engel's ARCH model and the threshold heteroscedastic model. The class of estimators includes an extension of Wilcoxon-type rank estimator. The derivation of the asymptotic distributions depends on the uniform approximation of a randomly weighted empirical process by a perturbed empirical process through a very general weight-dependent partitioning argument.     

Functional coefficient instrumental variables models

We consider estimation of nonparametric structural models under a functional coefficient representation for the regression function. Under this representation, models are linear in the endogenous components with coefficients given by unknown functions of the predetermined variables, a nonparametric generalization of random coefficient models. The functional coefficient restriction is an intermediate approach between fully nonparametric structural models that are ill posed when endogenous variables are continuously distributed, and partially linear models over which they have appreciable flexibility. We propose two-step estimators that use local linear approximations in both steps. The first step is to estimate a vector of reduced forms of regression models and the second step is local linear regression using the estimated reduced forms as regressors. Our large sample results include consistency and asymptotic normality of the proposed estimators. The high practical power of estimators is illustrated via both a Monte Carlo simulation study and an application to returns to education.     

Regularized conditional estimators of unit inefficiency in stochastic frontier analysis,with application to electricity distribution market

In stochastic frontier analysis, the conventional estimation of unit inefficiency is based on the mean/mode of the inefficiency, conditioned on the composite error. It is known that the conditional mean of inefficiency shrinks towards the mean rather than towards the unit inefficiency. In this paper, we analytically prove that the conditional mode cannot accurately estimate unit inefficiency, either. We propose regularized estimators of unit inefficiency that restrict the unit inefficiency estimators to satisfy some a priori assumptions, and derive the closed form regularized conditional mode estimators for the three most commonly used inefficiency densities. Extensive simulations show that, under common empirical situations, e.g., regarding sample size and signal-to-noise ratio, the regularized estimators outperform the conventional (unregularized) estimators when the inefficiency is greater than its mean/mode. Based on real data from the electricity distribution sector in Sweden, we demonstrate that the conventional conditional estimators and our regularized conditional estimators provide substantially different results for highly inefficient companies.

     

Detections of changes in return by a wavelet smoother with conditional heteroscedastic volatility

In this paper, we propose two estimators, an integral estimator and a discretized estimator, for the wavelet coefficient of regression functions in nonparametric regression models with heteroscedastic variance. These estimators can be used to test the jumps of the regression function. The model allows for lagged-dependent variables and other mixing regressors. The asymptotic distributions of the statistics are established, and the asymptotic critical values are analytically obtained from the asymptotic distribution. We also use the test to determine consistent estimators for the locations of change points. The jump sizes and locations of change points can be consistently estimated using wavelet coefficients, and the convergency rates of these estimators are derived. We perform some Monte Carlo simulations to check the powers and sizes of the test statistics. Finally, we give practical examples in finance and economics to detect changes in stock returns and short-term interest rates using the empirical wavelet method.     

Nonparametric estimation of conditional VaR and expected shortfall

This paper considers a new nonparametric estimation of conditional value-at-risk and expected shortfall functions. Conditional value-at-risk is estimated by inverting the weighted double kernel local linear estimate of the conditional distribution function. The nonparametric estimator of conditional expected shortfall is constructed by a plugging-in method. Both the asymptotic normality and consistency of the proposed nonparametric estimators are established at both boundary and interior points for time series data. We show that the weighted double kernel local linear conditional distribution estimator has the advantages of always being a distribution, continuous, and differentiable, besides the good properties from both the double kernel local linear and weighted Nadaraya–Watson estimators. Moreover, an ad hoc data-driven fashion bandwidth selection method is proposed, based on the nonparametric version of the Akaike information criterion. Finally, an empirical study is carried out to illustrate the finite sample performance of the proposed estimators.     

Quasi-maximum likelihood estimation for conditional quantiles

In this paper, we construct a new class of estimators for conditional quantiles in possibly misspecified nonlinear models with time series data. Proposed estimators belong to the family of quasi-maximum likelihood estimators (QMLEs) and are based on a new family of densities which we call ‘tick-exponential’. A well-known member of the tick-exponential family is the asymmetric Laplace density, and the corresponding QMLE reduces to the Koenker and Bassett's (Econometrica 46 (1978) 33) nonlinear quantile regression estimator. We derive primitive conditions under which the tick-exponential QMLEs are consistent and asymptotically normally distributed with an asymptotic covariance matrix that accounts for possible conditional quantile model misspecification and which can be consistently estimated by using the tick-exponential scores and Hessian matrix. Despite its non-differentiability, the tick-exponential quasi-likelihood is easy to maximize by using a ‘minimax’ representation not seen in the earlier work on conditional quantile estimation.     

A flexible parametric approach for estimating switching regime models and treatment effect parameters

In this paper, we propose a flexible, parametric class of switching regime models allowing for both skewed and fat-tailed outcome and selection errors. Specifically, we model the joint distribution of each outcome error and the selection error via a newly constructed class of multivariate distributions which we call generalized normal mean–variance mixture distributions. We extend Heckman’s two-step estimation procedure for the Gaussian switching regime model to the new class of models. When the distributions of the outcome errors are asymmetric, we show that an additional correction term accounting for skewness in the outcome error distribution (besides the analogue of the well known inverse mill’s ratio) needs to be included in the second step regression. We use the two-step estimators of parameters in the model to construct simple estimators of average treatment effects and establish their asymptotic properties. Simulation results confirm the importance of accounting for skewness in the outcome errors in estimating both model parameters and the average treatment effect and the treatment effect for the treated.     

Asymptotic properties of Monte Carlo estimators of diffusion processes

This paper studies the limit distributions of Monte Carlo estimators of diffusion processes. We examine two types of estimators based on the Euler scheme, one applied to the original processes, the other to a Doss transformation of the processes. We show that the transformation increases the speed of convergence of the Euler scheme. We also study estimators of conditional expectations of diffusions. After characterizing expected approximation errors, we construct second-order bias-corrected estimators. We also derive new convergence results for the Mihlstein scheme. Illustrations of the results are provided in the context of simulation-based estimation of diffusion processes.     

Semiparametric and nonparametric estimation of sample selection models under symmetry

This paper considers the semiparametric estimation of binary choice sample selection models under a joint symmetry assumption. Our approaches overcome various drawbacks associated with existing estimators. In particular, our method provides root-n$n$ consistent estimators for both the intercept and slope parameters of the outcome equation in a heteroscedastic framework, without the usual cross equation exclusion restriction or parametric specification for the error distribution and/or the form of heteroscedasticity. Our two-step estimators are shown to be consistent and asymptotically normal. A Monte Carlo simulation study indicates the usefulness of our approaches.     

Spurious Fixed Effects Regression*

This article shows that spurious regression results can occur for a fixed effects model with weak time series variation in the regressor and/or strong time series variation in the regression errors when the first‐differenced and Within‐OLS estimators are used. Asymptotic properties of these estimators and the related t‐tests and model selection criteria are studied by sending the number of cross‐sectional observations to infinity. This article shows that the first‐differenced and Within‐OLS estimators diverge in probability, that the related t‐tests are inconsistent, that R²s converge to zero in probability and that AIC and BIC diverge to ?∞ in probability. The results of the article warn that one should not jump to the use of fixed effects regressions without considering the degree of time series variations in the data.     

A consistent nonparametric test for nonlinear causality—Specification in time series regression

Since the pioneering work by Granger (1969), many authors have proposed tests of causality between economic time series. Most of them are concerned only with “linear causality in mean”, or if a series linearly affects the (conditional) mean of the other series. It is no doubt of primary interest, but dependence between series may be nonlinear, and/or not only through the conditional mean. Indeed conditional heteroskedastic models are widely studied recently. The purpose of this paper is to propose a nonparametric test for possibly nonlinear causality. Taking into account that dependence in higher order moments are becoming an important issue especially in financial time series, we also consider a test for causality up to the Kth conditional moment. Statistically, we can also view this test as a nonparametric omitted variable test in time series regression. A desirable property of the test is that it has nontrivial power against T^1/2-local alternatives, where T is the sample size. Also, we can form a test statistic accordingly if we have some knowledge on the alternative hypothesis. Furthermore, we show that the test statistic includes most of the omitted variable test statistics as special cases asymptotically. The null asymptotic distribution is not normal, but we can easily calculate the critical regions by simulation. Monte Carlo experiments show that the proposed test has good size and power properties.