Specification testing in nonparametric instrumental variable estimation

In nonparametric instrumental variable estimation, the function being estimated is the solution to an integral equation. A solution may not exist if, for example, the instrument is not valid. This paper discusses the problem of testing the null hypothesis that a solution exists against the alternative that there is no solution. We give necessary and sufficient conditions for existence of a solution and show that uniformly consistent testing of an unrestricted null hypothesis is not possible. Uniformly consistent testing is possible, however, if the null hypothesis is restricted by assuming that any solution to the integral equation is smooth. Many functions of interest in applied econometrics, including demand functions and Engel curves, are expected to be smooth. The paper presents a statistic for testing the null hypothesis that a smooth solution exists. The test is consistent uniformly over a large class of probability distributions of the observable random variables for which the integral equation has no smooth solution. The finite-sample performance of the test is illustrated through Monte Carlo experiments.     

Tikhonov regularization for nonparametric instrumental variable estimators

We study a Tikhonov Regularized (TiR) estimator of a functional parameter identified by conditional moment restrictions in a linear model with both exogenous and endogenous regressors. The nonparametric instrumental variable estimator is based on a minimum distance principle with penalization by the norms of the parameter and its derivatives. After showing its consistency in the Sobolev norm and uniform consistency under an embedding condition, we derive the expression of the asymptotic Mean Integrated Square Error and the rate of convergence. The optimal value of the regularization parameter is characterized in two examples. We illustrate our theoretical findings and the small sample properties with simulation results. Finally, we provide an empirical application to estimation of an Engel curve, and discuss a data driven selection procedure for the regularization parameter.     

Exactly distribution-free inference in instrumental variables regression with possibly weak instruments

This paper introduces a rank-based test for the instrumental variables regression model that dominates the Anderson–Rubin test in terms of finite sample size and asymptotic power in certain circumstances. The test has correct size for any distribution of the errors with weak or strong instruments. The test has noticeably higher power than the Anderson–Rubin test when the error distribution has thick tails and comparable power otherwise. Like the Anderson–Rubin test, the rank tests considered here perform best, relative to other available tests, in exactly identified models.     

A semi-parametric Bayesian approach to the instrumental variable problem

We develop a Bayesian semi-parametric approach to the instrumental variable problem. We assume linear structural and reduced form equations, but model the error distributions non-parametrically. A Dirichlet process prior is used for the joint distribution of structural and instrumental variable equations errors. Our implementation of the Dirichlet process prior uses a normal distribution as a base model. It can therefore be interpreted as modeling the unknown joint distribution with a mixture of normal distributions with a variable number of mixture components. We demonstrate that this procedure is both feasible and sensible using actual and simulated data. Sampling experiments compare inferences from the non-parametric Bayesian procedure with those based on procedures from the recent literature on weak instrument asymptotics. When errors are non-normal, our procedure is more efficient than standard Bayesian or classical methods.     

An instrumental variable approach for panel unit root tests under cross-sectional dependence

For dynamic panel models with cross-sectional dependence, several unit root tests are constructed using a Huber-type instrument, whose null asymptotics are standard Gaussian and do not depend on nuisance parameters. A Monte-Carlo simulation shows that the proposed tests have better sizes and comparable powers relative to other two existing tests developed for cross-sectionally dependent dynamic panel models.     

Likelihood inference in some finite mixture models

Parametric mixture models are commonly used in applied work, especially empirical economics, where these models are often employed to learn for example about the proportions of various types in a given population. This paper examines the inference question on the proportions (mixing probability) in a simple mixture model in the presence of nuisance parameters when sample size is large. It is well known that likelihood inference in mixture models is complicated due to (1) lack of point identification, and (2) parameters (for example, mixing probabilities) whose true value may lie on the boundary of the parameter space. These issues cause the profiled likelihood ratio (PLR) statistic to admit asymptotic limits that differ discontinuously depending on how the true density of the data approaches the regions of singularities where there is lack of point identification. This lack of uniformity in the asymptotic distribution suggests that confidence intervals based on pointwise asymptotic approximations might lead to faulty inferences. This paper examines this problem in details in a finite mixture model and provides possible fixes based on the parametric bootstrap. We examine the performance of this parametric bootstrap in Monte Carlo experiments and apply it to data from Beauty Contest experiments. We also examine small sample inferences and projection methods.     

Weak identification robust tests in an instrumental quantile model

We develop a testing procedure that is robust to identification quality in an instrumental quantile model. In order to reduce the computational burden, a multi-step approach is taken, and a two-step Anderson–Rubin (AR) statistic is considered. We then propose an orthogonal decomposition of the AR statistic, where the null distribution of each component does not depend on the assumption of a full rank of the Jacobian. Power experiments are conducted, and inferences on returns to schooling using the Angrist and Krueger data are considered as an empirical example.     

Estimation and inference in two-stage,semi-parametric models of production processes

Many papers have regressed non-parametric estimates of productive efficiency on environmental variables in two-stage procedures to account for exogenous factors that might affect firms’ performance. None of these have described a coherent data-generating process (DGP). Moreover, conventional approaches to inference employed in these papers are invalid due to complicated, unknown serial correlation among the estimated efficiencies. We first describe a sensible DGP for such models. We propose single and double bootstrap procedures; both permit valid inference, and the double bootstrap procedure improves statistical efficiency in the second-stage regression. We examine the statistical performance of our estimators using Monte Carlo experiments.     

Spectral density and spectral distribution inference for long memory time series via fixed-b asymptotics

This paper studies taper-based estimates of the spectral density utilizing a fixed bandwidth ratio asymptotic framework, and makes several theoretical contributions: (i) we treat multiple frequencies jointly, (ii) we allow for long-range dependence or anti-persistence at differing frequencies, (iii) we allow for tapers that are only piecewise smooth or discontinuous, including flat-top and truncation tapers, (iv) we study higher-order accuracy through the limit distribution’s Laplace Transform, (v) we develop a taper-based estimation theory for the spectral distribution, and show how confidence bands can be constructed. Simulation results produce quantiles and document the finite-sample size properties of the estimators, and a few empirical applications demonstrate the utility of the new methods.     

Nonparametric estimation of an instrumental regression: A quasi-Bayesian approach based on regularized posterior

We propose a quasi-Bayesian nonparametric approach to estimating the structural relationship φ$\phi$ among endogenous variables when instruments are available. We show that the posterior distribution of φ$\phi$ is inconsistent in the frequentist sense. We interpret this fact as the ill-posedness of the Bayesian inverse problem defined by the relation that characterizes the structural function φ$\phi$. To solve this problem, we construct a regularized posterior distribution, based on a Tikhonov regularization of the inverse of the marginal variance of the sample, which is justified by a penalized projection argument. This regularized posterior distribution is consistent in the frequentist sense and its mean can be interpreted as the mean of the exact posterior distribution resulting from a Gaussian prior distribution with a shrinking covariance operator.     

Short run and long run causality in time series: inference

We propose methods for testing hypothesis of non-causality at various horizons, as defined in Dufour and Renault (Econometrica 66, (1998) 1099–1125). We study in detail the case of VAR models and we propose linear methods based on running vector autoregressions at different horizons. While the hypotheses considered are nonlinear, the proposed methods only require linear regression techniques as well as standard Gaussian asymptotic distributional theory. Bootstrap procedures are also considered. For the case of integrated processes, we propose extended regression methods that avoid nonstandard asymptotics. The methods are applied to a VAR model of the US economy.     

Functional coefficient instrumental variables models

We consider estimation of nonparametric structural models under a functional coefficient representation for the regression function. Under this representation, models are linear in the endogenous components with coefficients given by unknown functions of the predetermined variables, a nonparametric generalization of random coefficient models. The functional coefficient restriction is an intermediate approach between fully nonparametric structural models that are ill posed when endogenous variables are continuously distributed, and partially linear models over which they have appreciable flexibility. We propose two-step estimators that use local linear approximations in both steps. The first step is to estimate a vector of reduced forms of regression models and the second step is local linear regression using the estimated reduced forms as regressors. Our large sample results include consistency and asymptotic normality of the proposed estimators. The high practical power of estimators is illustrated via both a Monte Carlo simulation study and an application to returns to education.     

Optimal inference for instrumental variables regression with non-Gaussian errors

This paper is concerned with inference on the coefficient on the endogenous regressor in a linear instrumental variables model with a single endogenous regressor, nonrandom exogenous regressors and instruments, and i.i.d. errors whose distribution is unknown. It is shown that under mild smoothness conditions on the error distribution it is possible to develop tests which are “nearly” efficient in the sense of Andrews et al. (2006) when identification is weak and consistent and asymptotically optimal when identification is strong. In addition, an estimator is presented which can be used in the usual way to construct valid (indeed, optimal) confidence intervals when identification is strong. The estimator is of the two stage least squares variety and is asymptotically efficient under strong identification whether or not the errors are normal.     

Indirect inference in structural econometric models

This paper considers parametric inference in a wide range of structural econometric models. It illustrates how the indirect inference principle can be used in the inference of these models. Specifically, we show that an ordinary least squares (OLS) estimation can be used as an auxiliary model, which leads to a method that is similar in spirit to a two-stage least squares (2SLS) estimator. Monte Carlo studies and an empirical analysis of timber sale auctions held in Oregon illustrate the usefulness and feasibility of our approach.     

On the shape of posterior densities and credible sets in instrumental variable regression models with reduced rank: An application of flexible sampling methods using neural networks

Likelihoods and posteriors of instrumental variable (IV) regression models with strong endogeneity and/or weak instruments may exhibit rather non-elliptical contours in the parameter space. This may seriously affect inference based on Bayesian credible sets. When approximating posterior probabilities and marginal densities using Monte Carlo integration methods like importance sampling or Markov chain Monte Carlo procedures the speed of the algorithm and the quality of the results greatly depend on the choice of the importance or candidate density. Such a density has to be ‘close’ to the target density in order to yield accurate results with numerically efficient sampling. For this purpose we introduce neural networks which seem to be natural importance or candidate densities, as they have a universal approximation property and are easy to sample from. A key step in the proposed class of methods is the construction of a neural network that approximates the target density. The methods are tested on a set of illustrative IV regression models. The results indicate the possible usefulness of the neural network approach.     

Semiparametric inference in a GARCH-in-mean model

A new semiparametric estimator for an empirical asset pricing model with general nonparametric risk-return tradeoff and GARCH-type underlying volatility is introduced. Based on the profile likelihood approach, it does not rely on any initial parametric estimator of the conditional mean function, and it is under stated conditions consistent, asymptotically normal, and efficient, i.e., it achieves the semiparametric lower bound. A sampling experiment provides finite sample comparisons with the parametric approach and the iterative semiparametric approach with parametric initial estimate of Conrad and Mammen (2008). An application to daily stock market returns suggests that the risk-return relation is indeed nonlinear.     

Short and long run causality measures: Theory and inference

The concept of causality introduced by Wiener [Wiener, N., 1956. The theory of prediction, In: E.F. Beckenback, ed., The Theory of Prediction, McGraw-Hill, New York (Chapter 8)] and Granger [Granger, C. W.J., 1969. Investigating causal relations by econometric models and cross-spectral methods, Econometrica 37, 424–459] is defined in terms of predictability one period ahead. This concept can be generalized by considering causality at any given horizon h$h$ as well as tests for the corresponding non-causality [Dufour, J.-M., Renault, E., 1998. Short-run and long-run causality in time series: Theory. Econometrica 66, 1099–1125; Dufour, J.-M., Pelletier, D., Renault, É., 2006. Short run and long run causality in time series: Inference, Journal of Econometrics 132 (2), 337–362]. Instead of tests for non-causality at a given horizon, we study the problem of measuring causality between two vector processes. Existing causality measures have been defined only for the horizon 1, and they fail to capture indirect causality. We propose generalizations to any horizon h$h$ of the measures introduced by Geweke [Geweke, J., 1982. Measurement of linear dependence and feedback between multiple time series. Journal of the American Statistical Association 77, 304–313]. Nonparametric and parametric measures of unidirectional causality and instantaneous effects are considered. On noting that the causality measures typically involve complex functions of model parameters in VAR and VARMA models, we propose a simple simulation-based method to evaluate these measures for any VARMA model. We also describe asymptotically valid nonparametric confidence intervals, based on a bootstrap technique. Finally, the proposed measures are applied to study causality relations at different horizons between macroeconomic, monetary and financial variables in the US.     

Semiparametric Bayesian inference in smooth coefficient models

We describe procedures for Bayesian estimation and testing in cross-sectional, panel data and nonlinear smooth coefficient models. The smooth coefficient model is a generalization of the partially linear or additive model wherein coefficients on linear explanatory variables are treated as unknown functions of an observable covariate. In the approach we describe, points on the regression lines are regarded as unknown parameters and priors are placed on differences between adjacent points to introduce the potential for smoothing the curves. The algorithms we describe are quite simple to implement—for example, estimation, testing and smoothing parameter selection can be carried out analytically in the cross-sectional smooth coefficient model.     

Likelihood estimation and inference in threshold regression

This paper studies likelihood-based estimation and inference in parametric discontinuous threshold regression models with i.i.d. data. The setup allows heteroskedasticity and threshold effects in both mean and variance. By interpreting the threshold point as a “middle” boundary of the threshold variable, we find that the Bayes estimator is asymptotically efficient among all estimators in the locally asymptotically minimax sense. In particular, the Bayes estimator of the threshold point is asymptotically strictly more efficient than the left-endpoint maximum likelihood estimator and the newly proposed middle-point maximum likelihood estimator. Algorithms are developed to calculate asymptotic distributions and risk for the estimators of the threshold point. The posterior interval is proved to be an asymptotically valid confidence interval and is attractive in both length and coverage in finite samples.     

Exploring the relationship between job satisfaction and organizational commitment: an instrumental variable approach

Abstract

The possible role of job satisfaction (JS) on organizational commitment (OC) has been a very important and hotly debated topic among experts. However, existing studies have yielded mixed results potentially due to utilization of small datasets, different methodological designs, estimation techniques that do not control for potential endogeneity between the variables, or a combination of these issues. Using a large matched employer-employee data-set from Britain (WERS2011), we find that increases in employees’ JS positively influence OC. We also show that this relationship holds when an instrumental variable framework (IV ordered probit/IV probit) is adopted to take into account the potential endogeneity of JS. However, throughout the analysis, the IV estimates are smaller in magnitude in comparison to where JS is considered as an exogenous variable. Moreover, utilising a two-stage probit least square (2SPLS) estimator, we support our previous findings i.e. increased JS is likely to lead to enhanced OC, but we also show that greater OC leads to higher levels of JS suggesting that JS and OC are likely to be reciprocally related. Overall, the IV estimates confirm the importance of addressing the endogeneity issue in the analysis of the relationship between JS and OC.