Finite sample evidence of IV estimators under weak instruments

We present finite sample evidence on different IV estimators available for linear models under weak instruments; explore the application of the bootstrap as a bias reduction technique to attenuate their finite sample bias; and employ three empirical applications to illustrate and provide insights into the relative performance of the estimators in practice. Our evidence indicates that the random‐effects quasi‐maximum likelihood estimator outperforms alternative estimators in terms of median point estimates and coverage rates, followed by the bootstrap bias‐corrected version of LIML and LIML. However, our results also confirm the difficulty of obtaining reliable point estimates in models with weak identification and moderate‐size samples. Copyright © 2007 John Wiley & Sons, Ltd.     

Statistical inference on restricted partial linear regression models with partial distortion measurement errors

We consider the estimation and hypothesis testing problems for the partial linear regression models when some variables are distorted with errors by some unknown functions of commonly observable confounding variable. The proposed estimation procedure is designed to accommodate undistorted as well as distorted variables. To test a hypothesis on the parametric components, a restricted least squares estimator is proposed under the null hypothesis. Asymptotic properties for the estimators are established. A test statistic based on the difference between the residual sums of squares under the null and alternative hypotheses is proposed, and we also obtain the asymptotic properties of the test statistic. A wild bootstrap procedure is proposed to calculate critical values. Simulation studies are conducted to demonstrate the performance of the proposed procedure, and a real example is analyzed for an illustration.     

Long difference instrumental variables estimation for dynamic panel models with fixed effects

This paper proposes a new instrumental variables estimator for a dynamic panel model with fixed effects with good bias and mean squared error properties even when identification of the model becomes weak near the unit circle. We adopt a weak instrument asymptotic approximation to study the behavior of various estimators near the unit circle. We show that an estimator based on long differencing the model is much less biased than conventional implementations of the GMM estimator for the dynamic panel model. We also show that under the weak instrument approximation conventional GMM estimators are dominated in terms of mean squared error by an estimator with far less moment conditions. The long difference (LD) estimator mimics the infeasible optimal procedure through its reliance on a small set of moment conditions.     

Simplified Implementation of the Heckman Estimator of the Dynamic Probit Model and a Comparison with Alternative Estimators*

This paper presents a convenient shortcut method for implementing the Heckman estimator of the dynamic random effects probit model and other dynamic nonlinear panel data models using standard software. It then compares the estimators proposed by Heckman, Orme and Wooldridge, based on three alternative approximations, first in an empirical model for the probability of unemployment and then in a set of simulation experiments. The results indicate that none of the three estimators dominates the other two in all cases. In most cases, all three estimators display satisfactory performance, except when the number of time periods is very small.     

Generalized empirical likelihood tests in time series models with potential identification failure

We introduce test statistics based on generalized empirical likelihood methods that can be used to test simple hypotheses involving the unknown parameter vector in moment condition time series models. The test statistics generalize those in Guggenberger and Smith [2005. Generalized empirical likelihood estimators and tests under partial, weak and strong identification. Econometric Theory 21 (4), 667–709] from the i.i.d. to the time series context and are alternatives to those in Kleibergen [2005a. Testing parameters in GMM without assuming that they are identified. Econometrica 73 (4), 1103–1123] and Otsu [2006. Generalized empirical likelihood inference for nonlinear and time series models under weak identification. Econometric Theory 22 (3), 513–527]. The main feature of these tests is that their empirical null rejection probabilities are not affected much by the strength or weakness of identification. More precisely, we show that the statistics are asymptotically distributed as chi-square under both classical asymptotic theory and weak instrument asymptotics of Stock and Wright [2000. GMM with weak identification. Econometrica 68 (5), 1055–1096]. We also introduce a modification to Otsu's (2006) statistic that is computationally more attractive. A Monte Carlo study reveals that the finite-sample performance of the suggested tests is very competitive.     

Improved instrumental variables estimation of simultaneous equations under conditionally heteroskedastic disturbances

In this paper we develop estimation techniques and a specification test for the validity of instrumental variables allowing for conditionally heteroskedastic disturbances. We propose modified two‐stage least squares (2SLS) and modified 3SLS procedures where the conditional heteroskedasticity is taken into account, which are natural extensions of the traditional 2SLS and 3SLS estimators and which achieve a lower variance. We recommend the use of these modified 2SLS and 3SLS procedures in practice instead of alternative estimators like limited‐information maximum likelihood/full‐information maximum likelihood, where the non‐existence of moments leads to extreme values, and also for ease of computation. It is shown theoretically and with simulation that in some cases 2SLS, 3SLS and our modified 2SLS and 3SLS procedures can have very severe biases (including the weak instruments case), and we present bias correction procedures to apply in practice along the lines of Flores‐Lagunes ( 2007 ). Our new estimation procedures can also be used to extend the test for weak instruments of Stock and Yogo ( 2005 ) and to allow for conditional heteroskedasticity. Finally, we show the usefulness of our estimation procedures with an application to the demand and supply of fish. Copyright © 2010 John Wiley & Sons, Ltd.     

Estimating dynamic models from repeated cross-sections

An important feature of panel data is that it allows the estimation of parameters characterizing dynamics from individual level data. Several authors argue that such parameters can also be identified from repeated cross-section data and present estimators to do so. This paper reviews the identification conditions underlying these estimators. As grouping data to obtain a pseudo-panel is an application of instrumental variables (IV), identification requires that standard IV conditions are met. This paper explicitly discusses the implications of these conditions for empirical analyses. We also propose a computationally attractive IV estimator that is consistent under essentially the same conditions as existing estimators. While a Monte Carlo study indicates that this estimator may work well under relatively weak conditions, these conditions are not trivially satisfied in applied work. Accordingly, a key conclusion of the paper is that these estimators cannot be implemented under general conditions.     

Mean square error estimation in multi-stage sampling

Summary: Suppose for a homogeneous linear unbiased function of the sampled first stage unit (fsu)-values taken as an estimator of a survey population total, the sampling variance is expressed as a homogeneous quadratic function of the fsu-values. When the fsu-values are not ascertainable but unbiased estimators for them are separately available through sampling in later stages and substituted into the estimator, Raj (1968) gave a simple variance estimator formula for this multi-stage estimator of the population total. He requires that the variances of the estimated fsu-values in sampling at later stages and their unbiased estimators are available in certain `simple forms'. For the same set-up Rao (1975) derived an alternative variance estimator when the later stage sampling variances have more ‘complex forms’. Here we pursue with Raj's (1968) simple forms to derive a few alternative variance and mean square error estimators when the condition of homogeneity or unbiasedness in the original estimator of the total is relaxed and the variance of the original estimator is not expressed as a quadratic form.  We illustrate a particular three-stage sampling strategy and present a simulation-based numerical exercise showing the relative efficacies of two alternative variance estimators. Received: 19 February 1999     

Optimal forecasting with heterogeneous panels: A Monte Carlo study

We contrast the forecasting performance of alternative panel estimators, divided into three main groups: homogeneous, heterogeneous and shrinkage/Bayesian. Via a series of Monte Carlo simulations, the comparison is performed using different levels of heterogeneity and cross sectional dependence, alternative panel structures in terms of T and N and the specification of the dynamics of the error term. To assess the predictive performance, we use traditional measures of forecast accuracy (Theil’s U statistics, RMSE and MAE), the Diebold–Mariano test, and Pesaran and Timmerman’s statistic on the capability of forecasting turning points. The main finding of our analysis is that when the level of heterogeneity is high, shrinkage/Bayesian estimators are preferred, whilst when there is low or mild heterogeneity, homogeneous estimators have the best forecast accuracy.     

Testing for time-invariant unobserved heterogeneity in generalized linear models for panel data

Recent literature on panel data emphasizes the importance of accounting for time-varying unobservable individual effects, which may stem from either omitted individual characteristics or macro-level shocks that affect each individual unit differently. In this paper, we propose a simple specification test of the null hypothesis that the individual effects are time-invariant against the alternative that they are time-varying. Our test is an application of Hausman (1978) testing procedure and can be used for any generalized linear model for panel data that admits a sufficient statistic for the individual effect. This is a wide class of models which includes the Gaussian linear model and a variety of nonlinear models typically employed for discrete or categorical outcomes. The basic idea of the test is to compare two alternative estimators of the model parameters based on two different formulations of the conditional maximum likelihood method. Our approach does not require assumptions on the distribution of unobserved heterogeneity, nor it requires the latter to be independent of the regressors in the model. We investigate the finite sample properties of the test through a set of Monte Carlo experiments. Our results show that the test performs well, with small size distortions and good power properties. We use a health economics example based on data from the Health and Retirement Study to illustrate the proposed test.     

Preliminary test Liu estimators based on the conflicting W,LR and LM tests in a regression model with multivariate Student-<Emphasis Type="Italic">t</Emphasis> error

In this paper, the problem of estimation of the regression coefficients in a multiple regression model with multivariate Student-t error is considered under the multicollinearity situation when it is suspected that the regression coefficients may be restricted to a linear manifold. The preliminary test Liu estimators (PTLE) based on the Wald, Likelihood ratio (LR) and Lagrangian multiplier (LM) tests are given. The bias and mean square error (MSE) of the proposed estimators are derived and conditions of superiority of these estimators are provided. In particular, we show that in the neighborhood of the null hypothesis, the PTLE based on the LM test has the best performance followed by the estimators based on LR and W tests, while the situation is reversed when the parameter moves away from the manifold of the restriction. Furthermore, the optimum choice of the level of significance is also discussed.     

Individual effects and dynamics in count data models

In this paper we examine the panel data estimation of dynamic models for count data that include correlated fixed effects and predetermined variables. Use of a linear feedback model is proposed. A quasi-differenced GMM estimator is consistent for the parameters in the dynamic model, but when series are highly persistent, there is a problem of weak instrument bias. An estimator is proposed that utilises pre-sample information of the dependent count variable, which is shown in Monte Carlo simulations to possess desirable small sample properties. The models and estimators are applied to data on US patents and R&D expenditure.     

Estimation of order-restricted means of two normal populations under the LINEX loss function

In this paper, the estimation of order-restricted means of two normal distributions is studied under the LINEX loss function, when the variances are unknown and possibly unequal. Under certain sufficient conditions to be described in this paper, the proposed plug-in estimators uniformly perform better than the existing unrestricted maximum likelihood estimators. Further, the restricted maximum likelihood estimators are compared with the unrestricted maximum likelihood estimators under the Pitman nearness criterion. A simulation study is conducted and it is shown that our proposed plug-in estimators perform better than the unrestricted maximum likelihood estimators. An illustrative example of real data analysis is also given to compare the estimators.     

GMM estimation of social interaction models with centrality

This paper considers the specification and estimation of social interaction models with network structures and the presence of endogenous, contextual, correlated, and group fixed effects. When the network structure in a group is captured by a graph in which the degrees of nodes are not all equal, the different positions of group members as measured by the Bonacich (1987) centrality provide additional information for identification and estimation. In this case, the Bonacich centrality measure for each group can be used as an instrument for the endogenous social effect, but the number of such instruments grows with the number of groups. We consider the 2SLS and GMM estimation for the model. The proposed estimators are asymptotically efficient, respectively, within the class of IV estimators and the class of GMM estimators based on linear and quadratic moments, when the sample size grows fast enough relative to the number of instruments.     

Spatial local M-estimation under association

We investigate the asymptotic behavior of a robust version of local linear regression estimators with variable bandwidth for spatial associated processes. The weak consistency of the proposed estimators is given under appropriate conditions. Furthermore, we establish the asymptotic normality of the estimators, from which expressions for the asymptotic bias and variance can be derived.     

Preliminary test ridge regression estimators with student’s <Emphasis Type="Italic">t</Emphasis> errors and conflicting test-statistics

The preliminary test ridge regression estimators (PTRRE) based on the Wald (W), Likelihood Ratio (LR) and Lagrangian Multiplier (LM) tests for estimating the regression parameters has been considered in this paper. Here we consider the multiple regression model with student t error distribution. The bias and the mean square errors (MSE) of the proposed estimators are derived under both null and alternative hypothesis. By studying the MSE criterion, the regions of optimality of the estimators are determined. Under the null hypothesis, the PTRRE based on LM test has the smallest risk followed by the estimators based on LR and W tests. However, the PTRRE based on W test performs the best followed by the LR and LM based estimators when the parameter moves away from the subspace of the restrictions. The conditions of superiority of the proposed estimators for both shrinkage parameter, k and the departure parameter, are provided. Some tables for the maximum and minimum guaranteed efficiency of the proposed estimators have been given, which allows us to determine the optimum level of significance corresponding to the optimum estimator. Finally, we conclude that the estimator based on Wald test dominates the other two estimators in the sense of having highest minimum guaranteed efficiency.     

Threshold estimation of Markov models with jumps and interest rate modeling

We reconstruct the level-dependent diffusion coefficient of a univariate semimartingale with jumps which is observed discretely. The consistency and asymptotic normality of our estimator are provided in the presence of both finite and infinite activity (finite variation) jumps. Our results rely on kernel estimation, using the properties of the local time of the data generating process, and the fact that it is possible to disentangle the discontinuous part of the state variable through those squared increments between observations not exceeding a suitable threshold function. We also reconstruct the drift and the jump intensity coefficients when they are level-dependent and jumps have finite activity, through consistent and asymptotically normal estimators. Simulated experiments show that the newly proposed estimators perform better in finite samples than alternative estimators, and this allows us to reexamine the estimation of a univariate model for the short term interest rate, for which we find fewer jumps and more variance due to the diffusion part than previous studies.     

A new class of limited-information estimators for simultaneous equations systems

The TSLS and LIML estimators are evaluated by means of a new class of limited-information estimators, the so-called Ω-class estimators. Under certain assumptions the Ω-class estimator is a maximun-likelihood estimator. These assumptions are superfluous, however, if we view the Ω-class as a class of minimun-distance estimators; all the members are shown to be consistent under general conditions. Besides the TSLS and the LIML estimators some other interesting members are introduced, and it is shown that, under certain conditions, the Ω-class estimators are weighted averages of different TSLS estimators. The use of TSLS in small samples is criticized; an alternative estimator is proposed.     

A minimum chi-squared method for indirect parameter estimation from Poisson data

In this paper, we introduce a new algorithm for estimating non-negative parameters from Poisson observations of a linear transformation of the parameters. The proposed objective function fits both a weighted least squares (WLS) and a minimum χ² estimation framework, and results in a convex optimization problem. Unlike conventional WLS methods, the weights do not need to be estimated from the datas, but are incorporated in the objective function. The iterative algorithm is derived from an alternating projection procedure in which "distance" is determined by the chi-squared test statistic, which is interpreted as a measure of the discrepancy between two distributions. This may be viewed as an alternative to the Kullback-Leibler divergence which corresponds to the maximum likelihood (ML) estimation. The algorithm is similar in form to, and shares many properties with, the expectation maximization algorithm for ML estimation. In particular, we show that every limit point of the algorithm is an estimator, and the sequence of projected (by the linear transformation into the data space) means converge. Despite the similarities, we show that the new estimators are quite distinct from ML estimators, and obtain conditions under which they are identical.     

Optimal Design Approach to GMM Estimation of Parameters Based on Empirical Transforms

Parameter estimation based on the generalized method of moments (GMM) is proposed. The proposed method employs a distance between an empirical and the corresponding theoretical transform. Estimation by the empirical characteristic function (CF) is a typical example, but alternative empirical transforms are also employed, such as the empirical Laplace transform when dealing with non‐negative random variables. D‐optimal designs are discussed, whereby the arguments of the empirical transform are chosen by maximizing the determinant of the asymptotic Fisher information matrix for the resulting estimators. The methods are applied to some parametric models for which classical inference is complicated.