Alternative approximations of the bias and MSE of the IV estimator under weak identification with an application to bias correction

We provide analytical formulae for the asymptotic bias (ABIAS) and mean-squared error (AMSE) of the IV estimator, and obtain approximations thereof based on an asymptotic scheme which essentially requires the expectation of the first stage F-statistic to converge to a finite (possibly small) positive limit as the number of instruments approaches infinity. Our analytical formulae can be viewed as generalizing the bias and MSE results of [Richardson and Wu 1971. A note on the comparison of ordinary and two-stage least squares estimators. Econometrica 39, 973–982] to the case with nonnormal errors and stochastic instruments. Our approximations are shown to compare favorably with approximations due to [Morimune 1983. Approximate distributions of k$k$-class estimators when the degree of overidentifiability is large compared with the sample size. Econometrica 51, 821–841] and [Donald and Newey 2001. Choosing the number of instruments. Econometrica 69, 1161–1191], particularly when the instruments are weak. We also construct consistent estimators for the ABIAS and AMSE, and we use these to further construct a number of bias corrected OLS and IV estimators, the properties of which are examined both analytically and via a series of Monte Carlo experiments.     

Kernel-weighted GMM estimators for linear time series models

This paper analyzes the higher-order asymptotic properties of generalized method of moments (GMM) estimators for linear time series models using many lags as instruments. A data-dependent moment selection method based on minimizing the approximate mean squared error is developed. In addition, a new version of the GMM estimator based on kernel-weighted moment conditions is proposed. It is shown that kernel-weighted GMM estimators can reduce the asymptotic bias compared to standard GMM estimators. Kernel weighting also helps to simplify the problem of selecting the optimal number of instruments. A feasible procedure similar to optimal bandwidth selection is proposed for the kernel-weighted GMM estimator.     

The behaviour of inconsistent instrumental variables estimators in dynamic systems with autocorrelated errors

To appropriately interpret time-series evidence when empirical relationships are incorrectly formulated, a general mis-specification framework is required. A linear, stationary, dynamic, simultaneous system with autoregressive errors is postulated to investigate instrumental variables ables estimators when the instruments are unknowingly correlated with the equation errors. The approach uses control variates (Hendry and Harrison, Journal of Econometrics, July 1974) to develop asymptotic distributions and exact moments for approximations to the econometric estimators. The accuracy of the asymptotic results for finite sample moments is corroborated by simulation. The analysis highlights the need for care in interpreting estimated equations and tests for predictive failure.     

Choosing instrumental variables in conditional moment restriction models

Properties of GMM estimators are sensitive to the choice of instrument. Using many instruments leads to high asymptotic asymptotic efficiency but can cause high bias and/or variance in small samples. In this paper we develop and implement asymptotic mean square error (MSE) based criteria for instrument selection in estimation of conditional moment restriction models. The models we consider include various nonlinear simultaneous equations models with unknown heteroskedasticity. We develop moment selection criteria for the familiar two-step optimal GMM estimator (GMM), a bias corrected version, and generalized empirical likelihood estimators (GEL), that include the continuous updating estimator (CUE) as a special case. We also find that the CUE has lower higher-order variance than the bias-corrected GMM estimator, and that the higher-order efficiency of other GEL estimators depends on conditional kurtosis of the moments.     

Response to the Letter to the Editor on ‘On Quantile-based Asymmetric Family of Distributions: Properties and Inference’

Rubio (2020) points out an identification problem for the four-parameter family of two-piece asymmetric densities introduced by Nassiri & Loris (2013). This implies that statistical inference for that family is problematic. Establishing probabilistic properties for this four-parameter family however still makes sense. For the three-parameter family, there is no identification problem. The main contribution in Gijbels et al. (2019a) is to provide asymptotic results for maximum likelihood and method-of-moments estimators for all members of the three-parameter quantile-based asymmetric family of distributions.     

Assessing misspecified asset pricing models with empirical likelihood estimators

Hansen and Jagannathan (1997) compare misspecified asset pricing models based on least-square projections on a family of admissible stochastic discount factors. We extend their fundamental contribution by considering Minimum Discrepancy projections where misspecification is measured by a family of convex functions that take into account higher moments of asset returns. The Minimum Discrepancy problems are solved on dual spaces producing a family of estimators that captures the least-square problem as a particular case. We derive the asymptotic distributions of the estimators for the Cressie–Read family of discrepancies, and illustrate their use with an assessment of the Consumption Asset Pricing Model.     

Estimation of spatial autoregressive panel data models with fixed effects

This paper establishes asymptotic properties of quasi-maximum likelihood estimators for SAR panel data models with fixed effects and SAR disturbances. A direct approach is to estimate all the parameters including the fixed effects. Because of the incidental parameter problem, some parameter estimators may be inconsistent or their distributions are not properly centered. We propose an alternative estimation method based on transformation which yields consistent estimators with properly centered distributions. For the model with individual effects only, the direct approach does not yield a consistent estimator of the variance parameter unless T is large, but the estimators for other common parameters are the same as those of the transformation approach. We also consider the estimation of the model with both individual and time effects.     

Testing for weak identification in possibly nonlinear models

In this paper we propose a chi-square test for identification. Our proposed test statistic is based on the distance between two shrinkage extremum estimators. The two estimators converge in probability to the same limit when identification is strong, and their asymptotic distributions are different when identification is weak. The proposed test is consistent not only for the alternative hypothesis of no identification but also for the alternative of weak identification, which is confirmed by our Monte Carlo results. We apply the proposed technique to test whether the structural parameters of a representative Taylor-rule monetary policy reaction function are identified.     

Statistical Inference in Nonparametric Frontier Models: The State of the Art

Efficiency scores of firms are measured by their distance to an estimated production frontier. The economic literature proposes several nonparametric frontier estimators based on the idea of enveloping the data (FDH and DEA-type estimators). Many have claimed that FDH and DEA techniques are non-statistical, as opposed to econometric approaches where particular parametric expressions are posited to model the frontier. We can now define a statistical model allowing determination of the statistical properties of the nonparametric estimators in the multi-output and multi-input case. New results provide the asymptotic sampling distribution of the FDH estimator in a multivariate setting and of the DEA estimator in the bivariate case. Sampling distributions may also be approximated by bootstrap distributions in very general situations. Consequently, statistical inference based on DEA/FDH-type estimators is now possible. These techniques allow correction for the bias of the efficiency estimators and estimation of confidence intervals for the efficiency measures. This paper summarizes the results which are now available, and provides a brief guide to the existing literature. Emphasizing the role of hypotheses and inference, we show how the results can be used or adapted for practical purposes.     

Instrumental variable estimation in the presence of many moment conditions

This paper develops shrinkage methods for addressing the “many instruments” problem in the context of instrumental variable estimation. It has been observed that instrumental variable estimators may behave poorly if the number of instruments is large. This problem can be addressed by shrinking the influence of a subset of instrumental variables. The procedure can be understood as a two-step process of shrinking some of the OLS coefficient estimates from the regression of the endogenous variables on the instruments, then using the predicted values of the endogenous variables (based on the shrunk coefficient estimates) as the instruments. The shrinkage parameter is chosen to minimize the asymptotic mean square error. The optimal shrinkage parameter has a closed form, which makes it easy to implement. A Monte Carlo study shows that the shrinkage method works well and performs better in many situations than do existing instrument selection procedures.     

Nonparametric dynamic panel data models: Kernel estimation and specification testing

Motivated by the first-differencing method for linear panel data models, we propose a class of iterative local polynomial estimators for nonparametric dynamic panel data models with or without exogenous regressors. The estimators utilize the additive structure of the first-differenced model—the fact that the two additive components have the same functional form, and the unknown function of interest is implicitly defined as a solution of a Fredholm integral equation of the second kind. We establish the uniform consistency and asymptotic normality of the estimators. We also propose a consistent test for the correct specification of linearity in typical dynamic panel data models based on the _L2$L_2$ distance of our nonparametric estimates and the parametric estimates under the linear restriction. We derive the asymptotic distributions of the test statistic under the null hypothesis and a sequence of Pitman local alternatives, and prove its consistency against global alternatives. Simulations suggest that the proposed estimators and tests perform well for finite samples. We apply our new method to study the relationships among economic growth, the initial economic condition and capital accumulation, and find a significant nonlinear relation between economic growth and the initial economic condition.     

Hybrid estimators for small diffusion processes based on reduced data

We deal with the Bayes type estimators and the maximum likelihood type estimators of both drift and volatility parameters for small diffusion processes defined by stochastic differential equations with small perturbations from high frequency data. From the viewpoint of numerical analysis, initial Bayes type estimators for both drift and volatility parameters based on reduced data are required, and adaptive maximum likelihood type estimators with the initial Bayes type estimators, which are called hybrid estimators, are proposed. The asymptotic properties of the initial Bayes type estimators based on reduced data are derived and it is shown that the hybrid estimators have asymptotic normality and convergence of moments. Furthermore, a concrete example and simulation results are given.     

Detections of changes in return by a wavelet smoother with conditional heteroscedastic volatility

In this paper, we propose two estimators, an integral estimator and a discretized estimator, for the wavelet coefficient of regression functions in nonparametric regression models with heteroscedastic variance. These estimators can be used to test the jumps of the regression function. The model allows for lagged-dependent variables and other mixing regressors. The asymptotic distributions of the statistics are established, and the asymptotic critical values are analytically obtained from the asymptotic distribution. We also use the test to determine consistent estimators for the locations of change points. The jump sizes and locations of change points can be consistently estimated using wavelet coefficients, and the convergency rates of these estimators are derived. We perform some Monte Carlo simulations to check the powers and sizes of the test statistics. Finally, we give practical examples in finance and economics to detect changes in stock returns and short-term interest rates using the empirical wavelet method.     

A family of empirical likelihood functions and estimators for the binary response model

The minimum discrimination information principle is used to identify an appropriate parametric family of probability distributions and the corresponding maximum likelihood estimators for binary response models. Estimators in the family subsume the conventional logit model and form the basis for a set of parametric estimation alternatives with the usual asymptotic properties. Sampling experiments are used to assess finite sample performance.     

Asymptotic distributions of impulse response functions in short panel vector autoregressions

This paper establishes the asymptotic distributions of the impulse response functions in panel vector autoregressions with a fixed time dimension. It also proves the asymptotic validity of a bootstrap approximation to their sampling distributions. The autoregressive parameters are estimated using the GMM estimators based on the first differenced equations and the error variance is estimated using an extended analysis-of-variance type estimator. Contrary to the time series setting, we find that the GMM estimator of the autoregressive coefficients is not asymptotically independent of the error variance estimator. The asymptotic dependence calls for variance correction for the orthogonalized impulse response functions. Simulation results show that the variance correction improves the coverage accuracy of both the asymptotic confidence band and the studentized bootstrap confidence band for the orthogonalized impulse response functions.     

Goodness-of-fit tests for long memory moving average marginal density

This paper addresses the problem of fitting a known density to the marginal error density of a stationary long memory moving average process when its mean is known and unknown. In the case of unknown mean, when mean is estimated by the sample mean, the first order difference between the residual empirical and null distribution functions is known to be asymptotically degenerate at zero, and hence can not be used to fit a distribution up to an unknown mean. In this paper we show that by using a suitable class of estimators of the mean, this first order degeneracy does not occur. We also investigate the large sample behavior of tests based on an integrated square difference between kernel type error density estimators and the expected value of the error density estimator based on errors. The asymptotic null distributions of suitably standardized test statistics are shown to be chi-square with one degree of freedom in both cases of the known and unknown mean. In addition, we discuss the consistency and asymptotic power against local alternatives of the density estimator based test in the case of known mean. A finite sample simulation study of the test based on residual empirical process is also included.     

Robust estimators for estimating discontinuous functions

We study the asymptotic behavior of a wide class of kernel estimators for estimating an unknown regression function. In particular we derive the asymptotic behavior at discontinuity points of the regression function. It turns out that some kernel estimators based on outlier robust estimators are consistent at jumps.     

MANY INSTRUMENTS AND/OR REGRESSORS: A FRIENDLY GUIDE

This paper surveys the state of the art in the econometrics of regression models with many instruments or many regressors based on alternative – namely, dimension – asymptotics. We list critical results of dimension asymptotics that lead to better approximations of properties of familiar and alternative estimators and tests when the instruments and/or regressors are numerous. Then, we consider the problem of estimation and inference in the basic linear instrumental variables regression setup with many strong instruments. We describe the failures of conventional estimation and inference, as well as alternative tools that restore consistency and validity. We then add various other features to the basic model such as heteroskedasticity, instrument weakness, etc., in each case providing a review of the existing tools for proper estimation and inference. Subsequently, we consider a related but different problem of estimation and testing in a linear mean regression with many regressors. We also describe various extensions and connections to other settings, such as panel data models, spatial models, time series models, and so on. Finally, we provide practical guidance regarding which tools are most suitable to use in various situations when many instruments and/or regressors turn out to be an issue.     

Estimation in generalized bivariate Birnbaum–Saunders models

In this paper, we propose two moment-type estimation methods for the parameters of the generalized bivariate Birnbaum–Saunders distribution by taking advantage of some properties of the distribution. The proposed moment-type estimators are easy to compute and always exist uniquely. We derive the asymptotic distributions of these estimators and carry out a simulation study to evaluate the performance of all these estimators. The probability coverages of confidence intervals are also discussed. Finally, two examples are used to illustrate the proposed methods.     

Approximate inference in multivariate nonlinear functional relationships

An estimation procedure based on estimating equations is presented for the parameters in a multivariate functional relationship model, where all observations are subject to error. The covariance matrix of the observational errors may be parametrized and is allowed to be different for different sets of observations. Estimators are defined for the unknown relation parameters and error parameters.
For linear models (i.e. where the model function is linear in the incidental parameters) the estimators are consistent and asymptotically normal. A consistent expression for the covariance matrix of the estimators is derived. The results are valid for general error distributions.
For nonlinear models the estimators are based on locally linear approximations to the model function. The afore mentioned properties of the estimators are now only approximately valid. The adequacy of the approximate inference, based on asymptotic theory for the linearized model, needs at least informal check. Some examples are given to illustrate the estimation procedure.