Performance of conditional Wald tests in IV regression with weak instruments

We compare the powers of five tests of the coefficient on a single endogenous regressor in instrumental variables regression. Following Moreira [2003, A conditional likelihood ratio test for structural models. Econometrica 71, 1027–1048], all tests are implemented using critical values that depend on a statistic which is sufficient under the null hypothesis for the (unknown) concentration parameter, so these conditional tests are asymptotically valid under weak instrument asymptotics. Four of the tests are based on k-class Wald statistics (two-stage least squares, LIML, Fuller's [Some properties of a modification of the limited information estimator. Econometrica 45, 939–953], and bias-adjusted TSLS); the fifth is Moreira's (2003) conditional likelihood ratio (CLR) test. The heretofore unstudied conditional Wald (CW) tests are found to perform poorly, compared to the CLR test: in many cases, the CW tests have almost no power against a wide range of alternatives. Our analysis is facilitated by a new algorithm, presented here, for the computation of the asymptotic conditional p-value of the CLR test.     

Testing with many weak instruments

This paper establishes the asymptotic distributions of the likelihood ratio (LR), Anderson–Rubin (AR), and Lagrange multiplier (LM) test statistics under “many weak IV asymptotics.” These asymptotics are relevant when the number of IVs is large and the coefficients on the IVs are relatively small. The asymptotic results hold under the null and under suitable alternatives. Hence, power comparisons can be made.     

Exactly distribution-free inference in instrumental variables regression with possibly weak instruments

This paper introduces a rank-based test for the instrumental variables regression model that dominates the Anderson–Rubin test in terms of finite sample size and asymptotic power in certain circumstances. The test has correct size for any distribution of the errors with weak or strong instruments. The test has noticeably higher power than the Anderson–Rubin test when the error distribution has thick tails and comparable power otherwise. Like the Anderson–Rubin test, the rank tests considered here perform best, relative to other available tests, in exactly identified models.     

CUE with many weak instruments and nearly singular design

This paper analyzes many weak moment asymptotics under the possibility of similar moments. The possibility of highly related moments arises when there are many of them. Knight and Fu (2000) designate the issue of similar regressors as the “nearly singular” design in the least squares case. In the nearly singular design, the sample variance converges to a singular limit term. However, Knight and Fu (2000) assume that on the nullspace of the limit term, the difference between the sample variance and the singular matrix converges in probability to a positive definite matrix when multiplied by an appropriate rate. We consider specifically Continuous Updating Estimator (CUE) with many weak moments under nearly singular design. We show that the nearly singular design affects the form of the limit of the many weak moment asymptotics that is introduced by Newey and Windmeijer (2009a). However, the estimator is still consistent and the Wald test has the standard χ²${\chi }^2$ limit.     

Generalizing weak instrument robust IV statistics towards multiple parameters,unrestricted covariance matrices and identification statistics

We generalize the weak instrument robust score or Lagrange multiplier and likelihood ratio instrumental variables (IV) statistics towards multiple parameters and a general covariance matrix so they can be used in the generalized method of moments (GMM). The GMM extension of Moreira's [2003. A conditional likelihood ratio test for structural models. Econometrica 71, 1027–1048] conditional likelihood ratio statistic towards GMM preserves its expression except that it becomes conditional on a statistic that tests the rank of a matrix. We analyze the spurious power decline of Kleibergen's [2002. Pivotal statistics for testing structural parameters in instrumental variables regression. Econometrica 70, 1781–1803, 2005. Testing parameters in GMM without assuming that they are identified. Econometrica 73, 1103–1124] score statistic and show that an independent misspecification pre-test overcomes it. We construct identification statistics that reflect if the confidence sets of the parameters are bounded. A power study and the possible shapes of confidence sets illustrate the analysis.     

Further results on projection-based inference in IV regressions with weak,collinear or missing instruments

We study a general family of Anderson–Rubin-type procedures, allowing for arbitrary collinearity among the instruments and endogenous variables. Using finite-sample distributional theory, we show that the proposed procedures, besides being robust to weak instruments, are also robust to the exclusion of relevant instruments and to the distribution of endogenous regressors. A solution to the problem of computing linear projections from general possibly singular quadric surfaces is derived and used to build finite-sample confidence sets for individual structural parameters. The importance of robustness to excluded instruments is studied by simulation. Applications to the trade-growth relationship and to education returns are presented.     

Specification tests in nonparametric regression

Consider the location-scale regression model Y=m(X)+σ(X)?$Y=m(X)+\sigma (X)?$, where the error ?$?$ is independent of the covariate X, and m   and σ$\sigma$ are smooth but unknown functions. We construct tests for the validity of this model and show that the asymptotic limits of the proposed test statistics are distribution free. We also investigate the finite sample properties of the tests through a simulation study, and we apply the tests in the analysis of data on food expenditures.     

Bootstrap validity for the score test when instruments may be weak

It is well-known that size adjustments based on bootstrapping the t$t$-statistic perform poorly when instruments are weakly correlated with the endogenous explanatory variable. In this paper, we provide a theoretical proof that guarantees the validity of the bootstrap for the score statistic. This theory does not follow from standard results, since the score statistic is not a smooth function of sample means and some parameters are not consistently estimable when the instruments are uncorrelated with the explanatory variable.     

Weak identification robust tests in an instrumental quantile model

We develop a testing procedure that is robust to identification quality in an instrumental quantile model. In order to reduce the computational burden, a multi-step approach is taken, and a two-step Anderson–Rubin (AR) statistic is considered. We then propose an orthogonal decomposition of the AR statistic, where the null distribution of each component does not depend on the assumption of a full rank of the Jacobian. Power experiments are conducted, and inferences on returns to schooling using the Angrist and Krueger data are considered as an empirical example.     

Goodness-of-fit tests based on series estimators in nonparametric instrumental regression

This paper proposes several tests of restricted specification in nonparametric instrumental regression. Based on series estimators, test statistics are established that allow for tests of the general model against a parametric or nonparametric specification as well as a test of exogeneity of the vector of regressors. The tests’ asymptotic distributions under correct specification are derived and their consistency against any alternative model is shown. Under a sequence of local alternative hypotheses, the asymptotic distributions of the tests are derived. Moreover, uniform consistency is established over a class of alternatives whose distance to the null hypothesis shrinks appropriately as the sample size increases. A Monte Carlo study examines finite sample performance of the test statistics.     

Exact permutation tests for non-nested non-linear regression models

This paper proposes exact distribution-free permutation tests for the specification of a non-linear regression model against one or more possibly non-nested alternatives. The new tests may be validly applied to a wide class of models, including models with endogenous regressors and lag structures. These tests build on the well-known J test developed by Davidson and MacKinnon [1981. Several tests for model specification in the presence of alternative hypotheses. Econometrica 49, 781–793] and their exactness holds under broader assumptions than those underlying the conventional J test. The J-type test statistics are used with a randomization or Monte Carlo resampling technique which yields an exact and computationally inexpensive inference procedure. A simulation experiment confirms the theoretical results and also shows the performance of the new procedure under violations of the maintained assumptions. The test procedure developed is illustrated by an application to inflation dynamics.     

Generalized reduced rank tests using the singular value decomposition

We propose a novel statistic to test the rank of a matrix. The rank statistic overcomes deficiencies of existing rank statistics, like: a Kronecker covariance matrix for the canonical correlation rank statistic of Anderson [Annals of Mathematical Statistics (1951), 22, 327–351] sensitivity to the ordering of the variables for the LDU rank statistic of Cragg and Donald [Journal of the American Statistical Association (1996), 91, 1301–1309] and Gill and Lewbel [Journal of the American Statistical Association (1992), 87, 766–776] a limiting distribution that is not a standard chi-squared distribution for the rank statistic of Robin and Smith [Econometric Theory (2000), 16, 151–175] usage of numerical optimization for the objective function statistic of Cragg and Donald [Journal of Econometrics (1997), 76, 223–250] and ignoring the non-negativity restriction on the singular values in Ratsimalahelo [2002, Rank test based on matrix perturbation theory. Unpublished working paper, U.F.R. Science Economique, University de Franche-Comté]. In the non-stationary cointegration case, the limiting distribution of the new rank statistic is identical to that of the Johansen trace statistic.     

Finite sample multivariate structural change tests with application to energy demand models

This paper considers finite sample motivated structural change tests in the multivariate linear regression model with application to energy demand models, in which case commonly used structural change tests remain asymptotic. As in Dufour and Kiviet [1996. Exact tests for structural change in first-order dynamic models. Journal of Econometrics 70, 39–68], we account for intervening nuisance parameters through a two-stage maximized Monte Carlo test procedure. Our contributions can be classified into five categories: (i) we extend tests for which a finite-sample theory has been supplied for Gaussian distributions to the non-Gaussian context; (ii) we show that Bai et al. [1998. Testing and dating common breaks in multi-variate time series. The Review of Economic Studies 65 (3), 395–432] test severely over-rejects and propose exact variants of this test; (iii) we consider predictive break test approaches which generalize tests in Dufour [1980. Dummy variables and predictive tests for structural change. Economics Letters 6, 241–247] and Dufour and Kiviet [1996. Exact tests for structural change in first-order dynamic models. Journal of Econometrics 70, 39–68]; (iv) we propose exact (non-Bonferonni based) extensions of the multivariate outliers test from Wilks [1963. Multivariate statistical outliers. Sankhya Series A 25, 407–426] to models with covariates; (v) we apply these tests to the energy demand system analyzed by Arsenault et al. [1995. A total energy demand model of Québec: forecasting properties. Energy Economics 17 (2), 163–171]. For two out of the six industrial sectors analyzed over the 1962–2000 period, break and further goodness-of-fit and diagnostic tests allow to identify (and correct) specification problems arising from historical regulatory changes or (possibly random) industry-specific effects. The procedures we propose have potential useful applications in statistics, econometrics and finance (e.g. event studies).     

Efficient information theoretic inference for conditional moment restrictions

The generalised method of moments estimator may be substantially biased in finite samples, especially so when there are large numbers of unconditional moment conditions. This paper develops a class of first-order equivalent semi-parametric efficient estimators and tests for conditional moment restrictions models based on a local or kernel-weighted version of the Cressie–Read power divergence family of discrepancies. This approach is similar in spirit to the empirical likelihood methods of Kitamura et al. [2004. Empirical likelihood-based inference in conditional moment restrictions models. Econometrica 72, 1667–1714] and Tripathi and Kitamura [2003. Testing conditional moment restrictions. Annals of Statistics 31, 2059–2095]. These efficient local methods avoid the necessity of explicit estimation of the conditional Jacobian and variance matrices of the conditional moment restrictions and provide empirical conditional probabilities for the observations.     

Inference in regression models with many regressors

We investigate the behavior of various standard and modified F$F$, likelihood ratio (LR$LR$), and Lagrange multiplier (LM$LM$) tests in linear homoskedastic regressions, adapting an alternative asymptotic framework in which the number of regressors and possibly restrictions grows proportionately to the sample size. When the restrictions are not numerous, the rescaled classical test statistics are asymptotically chi-squared, irrespective of whether there are many or few regressors. However, when the restrictions are numerous, standard asymptotic versions of classical tests are invalid. We propose and analyze asymptotically valid versions of the classical tests, including those that are robust to the numerosity of regressors and restrictions. The local power of all asymptotically valid tests under consideration turns out to be equal. The “exact” F$F$ test that appeals to critical values of the F$F$ distribution is also asymptotically valid and robust to the numerosity of regressors and restrictions.     

Efficient tests for the presence of a pair of complex conjugate unit roots in real time series

We introduce a framework which allows us to draw a clear parallel between the test for the presence of seasonal unit roots and that for unit root at frequency 0 (or π$\pi$). It relies on the properties of the complex conjugate integrated of order one processes which are implicitly at work in the real time series. In the same framework as that of Phillips and Perron (Biometrica 75 (1988) 335), we derive tests for the presence of a pair of conjugate complex unit roots. The asymptotic distribution we obtain are formally close to those derived by these authors but expressed with complex Wiener processes. We then introduce sequences of near-integrated processes which allow us to study the local-to-unity asymptotic of the above test statistics. We state a result on the weak convergence of the partial sum of complex near-random walks which leads to complex Orstein–Uhlenbeck processes. Drawing on Elliott et al. (Econometrica 64 (1996) 813) we then study the design of point-optimal invariant test procedures and compute their envelope employing local-to-unity asymptotic approximations. This leads us to introduce new feasible and near efficient seasonal unit root tests. Their finite sample properties are investigated and compared with the different test procedures already available (J. Econometrics 44 (1991) 215; 62 (1994) 415; 85 (1998) 269) and those introduced in the first part of the paper.     

GEL statistics under weak identification

The central concern of this paper is the provision in a time series moment condition framework of practical recommendations of confidence regions for parameters whose coverage probabilities are robust to the strength or weakness of identification. To this end we develop Pearson-type test statistics based on GEL implied probabilities formed from general kernel smoothed versions of the moment indicators. We also modify the statistics suggested in Guggenberger and Smith (2008) for a general kernel smoothing function. Importantly for our conclusions, we provide GEL time series counterparts to GMM and GEL conditional likelihood ratio statistics given in Kleibergen (2005) and Smith (2007). Our analysis not only demonstrates that these statistics are asymptotically (conditionally) pivotal under both classical asymptotic theory and weak instrument asymptotics of Stock and Wright (2000) but also provides asymptotic power results in the weakly identified time series context. Consequently, the empirical null rejection probabilities of the associated tests and, thereby, the coverage probabilities of the corresponding confidence regions, should not be affected greatly by the strength or otherwise of identification. A comprehensive Monte Carlo study indicates that a number of the tests proposed here represent very competitive choices in comparison with those suggested elsewhere in the literature.     

On the asymptotic optimality of the LIML estimator with possibly many instruments

We consider the estimation of the coefficients of a linear structural equation in a simultaneous equation system when there are many instrumental variables. We derive some asymptotic properties of the limited information maximum likelihood (LIML) estimator when the number of instruments is large; some of these results are new as well as old, and we relate them to results in some recent studies. We have found that the variance of the limiting distribution of the LIML estimator and its modifications often attain the asymptotic lower bound when the number of instruments is large and the disturbance terms are not necessarily normally distributed, that is, for the micro-econometric models of some cases recently called many instruments and many weak instruments.