The graph of the k-class estimator: An algebraic and statistical interpretation

This paper presents an algebraic analysis of the graphs of the k-class estimator, its asymptotic standard error and asymptotic t-ratio as functions of k for a single structural equation containing one or more endogenous explanatory variables. These results are illustrated by the corresponding graphs of the second and fifth equations of the Girshick-Haavelmo (1947) Demand for Food Model.Tests of the rank condition for identification are also developed. They are found to involve the values of k which explode the k-class estimator.     

A note on moments of k-class estimators for negative k

The validity of expressions for the exact moments of k-class estimator with 0≦1E;k<1 is established for negative values of k in the interval (–1,0). For other negative values (–∞<k≦1E;–1) the derivation of expressions for moments is outlined.     

Improved Stein-rule estimator for regression problems

This note extends the asymptotic expansion of the risk of the double k-class estimator of Ullah and Ullah (1978, 1981) and discusses the k₁ and k₂ values which minimize it. An error in Vinod (1980) is also corrected.     

Some large-concentration-parameter asymptotics for the k-class estimators

A sufficient condition is derived in this paper for the consistency and asymptotic normality of the k-class estimators (k-stochastic or nonstochastic) as the concentration parameter increases indefinitely, with the sample size either staying fixed or also increasing. It is further shown that the limited-information maximum likelihood estimator satisfies this condition. Since large sample size implies a large concentration parameter, but not vice versa, the usual conditions for consistency and asymptotic normality of the k-class estimators as the sample size increases can be inferred from the results given in this paper. But more importantly, the results in this paper shed further light on the small-sample properties of the stochastic k-class estimators and can serve as a starting point for the derivation of asymptotic approximations for these estimators as the concentration parameter goes to infinity, while the sample size either stays fixed or also goes to infinity.     

K-matrix-class estimators and the full-information maximum-likelihood estimator as a special case

This article presents a unified treatment of simultaneous system estimation. A general class of full-information estimators is proposed, called K-matrix-class (KMC). It is shown that the K-matrix-class includes both full-information maximum-likelihood and three-stage least- squares estimators as special cases and that the k-class can be regarded as a subclass of the K-matrix-class. Conditions under which KMC estimators are consistent (similar to those of the k-class estimators) are given. Furthermore, as a full information-generalization of the double k-class estimators, the double K-matrix-class estimators (DKMC) are proposed.     

Improved stein-rule estimator for regression problems

Stein-Rule estimator for regression problems has been studied by several authors including Sclove (1968) and others listed in Vinod's (1978) survey. Ullah and Ullah (1978) provide the expressions for the mean squared error (MSE) of a double k-class (KK) estimator with parameters k₁ and k₂. When k₂=1 the Stein-Rule estimator becomes a special case of KK and an optimal choice of k₁ is known. This paper explores optimal theoretical choice of k₁ and k₂. We note that negative choices of k₂ are permissible, and that thereis a large range of choices for K₁ and k₂ where the MSE of the Stein-Rule estimator can be reduced for regression problems based on multicollinear data. A simulation experiment is included.     

Performance of conditional Wald tests in IV regression with weak instruments

We compare the powers of five tests of the coefficient on a single endogenous regressor in instrumental variables regression. Following Moreira [2003, A conditional likelihood ratio test for structural models. Econometrica 71, 1027–1048], all tests are implemented using critical values that depend on a statistic which is sufficient under the null hypothesis for the (unknown) concentration parameter, so these conditional tests are asymptotically valid under weak instrument asymptotics. Four of the tests are based on k-class Wald statistics (two-stage least squares, LIML, Fuller's [Some properties of a modification of the limited information estimator. Econometrica 45, 939–953], and bias-adjusted TSLS); the fifth is Moreira's (2003) conditional likelihood ratio (CLR) test. The heretofore unstudied conditional Wald (CW) tests are found to perform poorly, compared to the CLR test: in many cases, the CW tests have almost no power against a wide range of alternatives. Our analysis is facilitated by a new algorithm, presented here, for the computation of the asymptotic conditional p-value of the CLR test.     

Another look at the naive estimator in a regression model

We consider the linear regression model where only a particular linear function of the dependent variables is observed, Stahlecker and Schmidt (1987) proposed a naive least squares (LS) estimator for regression coefficients in such a case. In this note we represent their estimator as a general ridge estimator. This observation leads to a view different from the previous work and provides an easy way of obtaining many important properties of the naive LS estimator. Our approach also gives some insight into the relationship between the naive LS estimator and the generalized least squares estimator.     

Information and computation in simultaneous equations estimation

The complexity and size of simultaneous equations systems necessitates great care with computations for parameter estimation. In three-stage least-squares (3SLS) large matrix inversions are required, and because of the sensitivity of many economic systems to key parameters, accuracy in estimation is important. There are many numerical techniques available which yield accurate solutions to systems of equations. We make use of Householder transformations and recursive triangulation solutions in presenting numerical algorithms for the computation of 3SLS and k-class estimates. Another numerical technique, the singular value decomposition is valuable in providing additional information in k-class estimation. The values of k for which this estimator does not exist are accurately derived, their use being demonstrated by an example.     

A new class of limited-information estimators for simultaneous equations systems

The TSLS and LIML estimators are evaluated by means of a new class of limited-information estimators, the so-called Ω-class estimators. Under certain assumptions the Ω-class estimator is a maximun-likelihood estimator. These assumptions are superfluous, however, if we view the Ω-class as a class of minimun-distance estimators; all the members are shown to be consistent under general conditions. Besides the TSLS and the LIML estimators some other interesting members are introduced, and it is shown that, under certain conditions, the Ω-class estimators are weighted averages of different TSLS estimators. The use of TSLS in small samples is criticized; an alternative estimator is proposed.     

On the existence of moments of partially restricted reduced form coefficients

In this paper ridgelike Bayesian estimators of structural coefficients have been used to form the partially restricted reduced form estimators. These partially restricted reduced form estimators are simple in form and possess finite sampling moments and risk in contrast to other restricted reduced form estimators that possess no finite moments and have infinite risk relative to quadratic loss functions. The usual k-class implied partially restricted reduced form estimators with 0≦k≦1 do not posses finite moments unless the degree of overidentification (or the excess of sample size over the number of coefficients) of the structural equation being estimated is suitably restricted.     

Estimation of possibly misspecified semiparametric conditional moment restriction models with different conditioning variables

Newey and Powell [2003. Instrumental variable estimation of nonparametric models. Econometrica 71, 1565–1578] and Ai and Chen [2003. Efficient estimation of conditional moment restrictions models containing unknown functions. Econometrica 71, 1795–1843] propose sieve minimum distance (SMD) estimation of both finite dimensional parameter (θ)$(\theta )$ and infinite dimensional parameter (h) that are identified through a conditional moment restriction model, in which h could depend on endogenous variables. This paper modifies their SMD procedure to allow for different conditioning variables to be used in different equations, and derives the asymptotic properties when the model may be misspecified  . Under low-level sufficient conditions, we show that: (i) the modified SMD estimators of both θ$\theta$ and h   converge to some pseudo-true values in probability; (ii) the SMD estimators of smooth functionals, including the θ$\theta$ estimator and the average derivative estimator, are asymptotically normally distributed; and (iii) the estimators for the asymptotic covariances of the SMD estimators of smooth functionals are consistent and easy to compute. These results allow for asymptotically valid tests of various hypotheses on the smooth functionals regardless of whether the semiparametric model is correctly specified or not.     

Partially varying coefficient instrumental variables models

In this article, we study a new class of semiparametric instrumental variables models, in which the structural function has a partially varying coefficient functional form. Under this specification, the model is linear in the endogenous/exogenous components with unknown constant or functional coefficients. As a result, the ill‐posed inverse problem in a general non‐parametric model with continuous endogenous variables can be avoided. We propose a three‐step estimation procedure for estimating both constant and functional coefficients and establish their asymptotic properties such as consistency and asymptotic normality. We develop consistent estimators for their error variances. We demonstrate that the constant coefficient estimators achieve the optimal ‐convergence rate, and the functional coefficient estimators are oracle. In addition, efficiency issue of the parameter estimation is discussed and a simple efficient estimator is proposed. The proposed procedure is illustrated via a Monte Carlo simulation and an application to returns to education.     

The exact distribution of exogenous variable coefficient estimators

This paper derives the exact probability density function of the instrumental variable (IV) estimator of the exogenous variable coefficient vector in a structural equation containing n + 1 endogenous variables and N degrees of overidentification. The derivations make use of an operator calculus which simplifies the algebra of invariant polynomials with multiple matrix arguments. A leading case of the general distribution that is more amenable to analysis and computation is also presented. Conventional classical assumptions of normally distributed errors and non-random exogenous variables are employed.     

The coefficient of determination and simultaneous equation systems

In this paper we show that the Carter-Nagar (1977) R²'s for single structural equations and systems are in fact R² for the reduced form where the partially restricted reduced form estimation method is employed. We also show that the results of McElroy (1977) may be used to derive the Carter-Nagar system measure. If the reduced form equations are estimated by Kakwani's (1975) k-class reduced form estimator a new R² may be defined which is shown to be asymptotically equivalent to the Carter-Nagar measure.     

Alternative approximations of the bias and MSE of the IV estimator under weak identification with an application to bias correction

We provide analytical formulae for the asymptotic bias (ABIAS) and mean-squared error (AMSE) of the IV estimator, and obtain approximations thereof based on an asymptotic scheme which essentially requires the expectation of the first stage F-statistic to converge to a finite (possibly small) positive limit as the number of instruments approaches infinity. Our analytical formulae can be viewed as generalizing the bias and MSE results of [Richardson and Wu 1971. A note on the comparison of ordinary and two-stage least squares estimators. Econometrica 39, 973–982] to the case with nonnormal errors and stochastic instruments. Our approximations are shown to compare favorably with approximations due to [Morimune 1983. Approximate distributions of k$k$-class estimators when the degree of overidentifiability is large compared with the sample size. Econometrica 51, 821–841] and [Donald and Newey 2001. Choosing the number of instruments. Econometrica 69, 1161–1191], particularly when the instruments are weak. We also construct consistent estimators for the ABIAS and AMSE, and we use these to further construct a number of bias corrected OLS and IV estimators, the properties of which are examined both analytically and via a series of Monte Carlo experiments.     

On the asymptotic optimality of the LIML estimator with possibly many instruments

We consider the estimation of the coefficients of a linear structural equation in a simultaneous equation system when there are many instrumental variables. We derive some asymptotic properties of the limited information maximum likelihood (LIML) estimator when the number of instruments is large; some of these results are new as well as old, and we relate them to results in some recent studies. We have found that the variance of the limiting distribution of the LIML estimator and its modifications often attain the asymptotic lower bound when the number of instruments is large and the disturbance terms are not necessarily normally distributed, that is, for the micro-econometric models of some cases recently called many instruments and many weak instruments.     

A simple estimator for nonlinear error in variable models

We propose a simple estimator for nonlinear method of moment models with measurement error of the classical type when no additional data, such as validation data or double measurements, are available. We assume that the marginal distributions of the measurement errors are Laplace (double exponential) with zero means and unknown variances and the measurement errors are independent of the latent variables and are independent of each other. Under these assumptions, we derive simple revised moment conditions in terms of the observed variables. They are used to make inference about the model parameters and the variance of the measurement error. The results of this paper show that the distributional assumption on the measurement errors can be used to point identify the parameters of interest. Our estimator is a parametric method of moments estimator that uses the revised moment conditions and hence is simple to compute. Our estimation method is particularly useful in situations where no additional data are available, which is the case in many economic data sets. Simulation study demonstrates good finite sample properties of our proposed estimator. We also examine the performance of the estimator in the case where the error distribution is misspecified.