Some large-concentration-parameter asymptotics for the k-class estimators

A sufficient condition is derived in this paper for the consistency and asymptotic normality of the k-class estimators (k-stochastic or nonstochastic) as the concentration parameter increases indefinitely, with the sample size either staying fixed or also increasing. It is further shown that the limited-information maximum likelihood estimator satisfies this condition. Since large sample size implies a large concentration parameter, but not vice versa, the usual conditions for consistency and asymptotic normality of the k-class estimators as the sample size increases can be inferred from the results given in this paper. But more importantly, the results in this paper shed further light on the small-sample properties of the stochastic k-class estimators and can serve as a starting point for the derivation of asymptotic approximations for these estimators as the concentration parameter goes to infinity, while the sample size either stays fixed or also goes to infinity.     

Improved Stein-rule estimator for regression problems

This note extends the asymptotic expansion of the risk of the double k-class estimator of Ullah and Ullah (1978, 1981) and discusses the k₁ and k₂ values which minimize it. An error in Vinod (1980) is also corrected.     

Exact finite sample properties of double k-class estimators in simultaneous equations

In our earlier paper [Srivastava, Agnihotri and Dwivedi (1980)] the dominance of double k-class over k-class with respect to exact mean squared error matrix criteria is established. It is observed that given a member of k-class, one can pick up a member of double k-class that will provide an improved estimator of the coefficients. This result prompted us to study the exact finite sample properties of the double k-class estimator. For this, we have considered a structural equation containing two endogenous variables and have investigated the properties of double k-class estimators of the coefficients of explanatory endogenous variables assuming characterizing scalars to be non-stochastic.     

A note on moments of k-class estimators for negative k

The validity of expressions for the exact moments of k-class estimator with 0≦1E;k<1 is established for negative values of k in the interval (–1,0). For other negative values (–∞<k≦1E;–1) the derivation of expressions for moments is outlined.     

Information and computation in simultaneous equations estimation

The complexity and size of simultaneous equations systems necessitates great care with computations for parameter estimation. In three-stage least-squares (3SLS) large matrix inversions are required, and because of the sensitivity of many economic systems to key parameters, accuracy in estimation is important. There are many numerical techniques available which yield accurate solutions to systems of equations. We make use of Householder transformations and recursive triangulation solutions in presenting numerical algorithms for the computation of 3SLS and k-class estimates. Another numerical technique, the singular value decomposition is valuable in providing additional information in k-class estimation. The values of k for which this estimator does not exist are accurately derived, their use being demonstrated by an example.     

Improved stein-rule estimator for regression problems

Stein-Rule estimator for regression problems has been studied by several authors including Sclove (1968) and others listed in Vinod's (1978) survey. Ullah and Ullah (1978) provide the expressions for the mean squared error (MSE) of a double k-class (KK) estimator with parameters k₁ and k₂. When k₂=1 the Stein-Rule estimator becomes a special case of KK and an optimal choice of k₁ is known. This paper explores optimal theoretical choice of k₁ and k₂. We note that negative choices of k₂ are permissible, and that thereis a large range of choices for K₁ and k₂ where the MSE of the Stein-Rule estimator can be reduced for regression problems based on multicollinear data. A simulation experiment is included.     

A new class of limited-information estimators for simultaneous equations systems

The TSLS and LIML estimators are evaluated by means of a new class of limited-information estimators, the so-called Ω-class estimators. Under certain assumptions the Ω-class estimator is a maximun-likelihood estimator. These assumptions are superfluous, however, if we view the Ω-class as a class of minimun-distance estimators; all the members are shown to be consistent under general conditions. Besides the TSLS and the LIML estimators some other interesting members are introduced, and it is shown that, under certain conditions, the Ω-class estimators are weighted averages of different TSLS estimators. The use of TSLS in small samples is criticized; an alternative estimator is proposed.     

K-matrix-class estimators and the full-information maximum-likelihood estimator as a special case

This article presents a unified treatment of simultaneous system estimation. A general class of full-information estimators is proposed, called K-matrix-class (KMC). It is shown that the K-matrix-class includes both full-information maximum-likelihood and three-stage least- squares estimators as special cases and that the k-class can be regarded as a subclass of the K-matrix-class. Conditions under which KMC estimators are consistent (similar to those of the k-class estimators) are given. Furthermore, as a full information-generalization of the double k-class estimators, the double K-matrix-class estimators (DKMC) are proposed.     

Performance of conditional Wald tests in IV regression with weak instruments

We compare the powers of five tests of the coefficient on a single endogenous regressor in instrumental variables regression. Following Moreira [2003, A conditional likelihood ratio test for structural models. Econometrica 71, 1027–1048], all tests are implemented using critical values that depend on a statistic which is sufficient under the null hypothesis for the (unknown) concentration parameter, so these conditional tests are asymptotically valid under weak instrument asymptotics. Four of the tests are based on k-class Wald statistics (two-stage least squares, LIML, Fuller's [Some properties of a modification of the limited information estimator. Econometrica 45, 939–953], and bias-adjusted TSLS); the fifth is Moreira's (2003) conditional likelihood ratio (CLR) test. The heretofore unstudied conditional Wald (CW) tests are found to perform poorly, compared to the CLR test: in many cases, the CW tests have almost no power against a wide range of alternatives. Our analysis is facilitated by a new algorithm, presented here, for the computation of the asymptotic conditional p-value of the CLR test.     

The coefficient of determination and simultaneous equation systems

In this paper we show that the Carter-Nagar (1977) R²'s for single structural equations and systems are in fact R² for the reduced form where the partially restricted reduced form estimation method is employed. We also show that the results of McElroy (1977) may be used to derive the Carter-Nagar system measure. If the reduced form equations are estimated by Kakwani's (1975) k-class reduced form estimator a new R² may be defined which is shown to be asymptotically equivalent to the Carter-Nagar measure.     

Alternative approximations of the bias and MSE of the IV estimator under weak identification with an application to bias correction

We provide analytical formulae for the asymptotic bias (ABIAS) and mean-squared error (AMSE) of the IV estimator, and obtain approximations thereof based on an asymptotic scheme which essentially requires the expectation of the first stage F-statistic to converge to a finite (possibly small) positive limit as the number of instruments approaches infinity. Our analytical formulae can be viewed as generalizing the bias and MSE results of [Richardson and Wu 1971. A note on the comparison of ordinary and two-stage least squares estimators. Econometrica 39, 973–982] to the case with nonnormal errors and stochastic instruments. Our approximations are shown to compare favorably with approximations due to [Morimune 1983. Approximate distributions of k$k$-class estimators when the degree of overidentifiability is large compared with the sample size. Econometrica 51, 821–841] and [Donald and Newey 2001. Choosing the number of instruments. Econometrica 69, 1161–1191], particularly when the instruments are weak. We also construct consistent estimators for the ABIAS and AMSE, and we use these to further construct a number of bias corrected OLS and IV estimators, the properties of which are examined both analytically and via a series of Monte Carlo experiments.     

Optimal instruments when the disturbances are small

Single-equation instrumental variable estimators (e.g., the k-class) are frequently employed to estimate econometric equations. This paper employs Kadane's (1971) small-σ method and a squared-error matrix loss function to characterize a single-equation class of optimal instruments, $\text{A}$. $\text{A}$ is optimal (asymptotically for a small scalar multiple, σ, of the model's disturbance) in that all of its members are preferred to all non-members. From this characterization it is shown all k-class estimators and certain iterative estimators belong to $\text{A}$. However, non-iterative principal component estimators [e.g., Kloek and Mennes (1960)] are unlikely to belong to $\text{A}$. These latter instrumental variable estimators have been advocated [see Amemiya (1966) and Kloek and Mennes (1960)] for estimating ‘large’ econometric models.     

The existence of moments of some simple Bayes estimators of coefficients in a simultaneous equation model

In this paper a simple modification of the usual k-class estimators has been suggested so that for 0 ≦ k ≦ 1 the problem of the non-existence of moments disappears. These modified estimators can be interpreted either as Bayes estimators or as constrained estimators subject to the restriction that the squared length of the coefficient vector is less than or equal to a given number.     

k‐Nearest neighbors local linear regression for functional and missing data at random

We combine the k‐Nearest Neighbors (kNN) method to the local linear estimation (LLE) approach to construct a new estimator (LLE‐kNN) of the regression operator when the regressor is of functional type and the response variable is a scalar but observed with some missing at random (MAR) observations. The resulting estimator inherits many of the advantages of both approaches (kNN and LLE methods). This is confirmed by the established asymptotic results, in terms of the pointwise and uniform almost complete consistencies, and the precise convergence rates. In addition, a numerical study (i) on simulated data, then (ii) on a real dataset concerning the sugar quality using fluorescence data, were conducted. This practical study clearly shows the feasibility and the superiority of the LLE‐kNN estimator compared to competitive estimators.     

Estimation in the first-order moving average model through the finite autoregressive approximation: Some asymptotic results

To estimate α in the model y_t = u_t+αu_t?1, we consider a proposal by Durbin (Biometrika, 1969). It consists in fitting an autoregression of order k to the data, and deriving from there an estimate α^. The probability limit and the variance of the limiting normal distribution of α^ are presented and discussed in detail, when the sample size T → ∞, but k remains fixed. The differences between the resulting values and those corresponding to the maximum likelihood estimator are exponentially decreasing functions of k. Several modifications of the estimator are discussed and found consistent, but asymptotically inefficient.     

Complete sufficiency and maximum likelihood estimation for the two-parameter negative binomial distribution

The difficult estimation problem associated with the two-parameter negative binomial distribution is discussed. The order statistic is shown to be minimal sufficient but not complete. It is proven that there is at least one maximum likelihood estimator of the parameterk when the second sample moment is greater than the sample mean. Contours and three-dimensional graphs of the natural logarithm of the likelihood function provide further insight into the estimation problem.     

On the asymptotic optimality of the LIML estimator with possibly many instruments

We consider the estimation of the coefficients of a linear structural equation in a simultaneous equation system when there are many instrumental variables. We derive some asymptotic properties of the limited information maximum likelihood (LIML) estimator when the number of instruments is large; some of these results are new as well as old, and we relate them to results in some recent studies. We have found that the variance of the limiting distribution of the LIML estimator and its modifications often attain the asymptotic lower bound when the number of instruments is large and the disturbance terms are not necessarily normally distributed, that is, for the micro-econometric models of some cases recently called many instruments and many weak instruments.     

On the existence of moments of partially restricted reduced form coefficients

In this paper ridgelike Bayesian estimators of structural coefficients have been used to form the partially restricted reduced form estimators. These partially restricted reduced form estimators are simple in form and possess finite sampling moments and risk in contrast to other restricted reduced form estimators that possess no finite moments and have infinite risk relative to quadratic loss functions. The usual k-class implied partially restricted reduced form estimators with 0≦k≦1 do not posses finite moments unless the degree of overidentification (or the excess of sample size over the number of coefficients) of the structural equation being estimated is suitably restricted.     

Separating Information Maximum Likelihood estimation of the integrated volatility and covariance with micro-market noise

For estimating the integrated volatility and covariance by using high frequency financial data, we propose the Separating Information Maximum Likelihood (SIML) method when there are possibly micro-market noises. The resulting estimator, which is represented as a specific quadratic form of returns, is simple and their properties have been investigated by [Kunitomo and Sato, 2008a], [Kunitomo and Sato, 2008b], [Kunitomo and Sato, 2010], [Kunitomo and Sato, 2011]. We show that the SIML estimator has reasonable asymptotic properties; it is consistent and it has the asymptotic normality when the sample size is large and the integrated volatility is deterministic under general conditions including some non-Gaussian and volatility models. Based on simulations, we find that the SIML estimator has reasonable finite sample properties and it would be useful for practice. The SIML estimator has the asymptotic robustness properties in the sense it is consistent when the noise terms are weakly dependent and they are endogenously correlated with the efficient market price process. We illustrate the use of SIML by analyzing Nikkei-225 futures, which are the derivatives of the major stock index in Japan.     

Sequential estimation of a linear function of normal means under asymmetric loss function

The problem of estimating a linear function of k normal means with unknown variances is considered under an asymmetric loss function such that the associated risk is bounded from above by a known quantity. In the absence of a fixed sample size rule, sequential stopping rules satisfying a general set of assumptions are considered. Two estimators are proposed and second-order asymptotic expansions of their risk functions are derived. It is shown that the usual estimator, namely the linear function of the sample means, is asymptotically inadmissible, being dominated by a shrinkage-type estimator. An example illustrates the use of different multistage sampling schemes and provides asymptotic expansions of the risk functions. Received: August 1999