Large-sample estimation strategies for eigenvalues of a Wishart matrix

The problem of simultaneous asymptotic estimation of eigenvalues of covariance matrix of Wishart matrix is considered under a weighted quadratic loss function. James-Stein type of estimators are obtained which dominate the sample eigenvalues. The relative merits of the proposed estimators are compared to the sample eigenvalues using asymptotic quadratic distributional risk under loal alternatives. It is shown that the proposed estimators are asymptotically superior to the sample eigenvalues. Further, it is demonstrated that the James-Stein type estimator is dominated by its truncated part.     

A bayesian analysis of a random coefficient model in a simple keynesian system

The marginal propensity to consume in a simple Keynesian model is treated as a random coefficient. This gives rise to the problem of quotient of random variables, i.e., the Fieller-Creasy problem. The Bayesian and maximum likelihood estimators are compared in sampling experiments. The Bayesian estimators have smaller mean squared errors than the maximum likelihood estimators. Marginal posterior probability density functions for a given sample are also presented.     

Proofs for large sample properties of generalized method of moments estimators

I present proofs for the consistency of generalized method of moments (GMM) estimators presented in Hansen (1982). Some basic approximation results provide the groundwork for the analysis of a class of such estimators. Using these results, I establish the large sample convergence of GMM estimators under alternative restrictions on the estimation problem.     

Relative efficiencies of some simple Bayes estimators of coefficients in a dynamic equation with serially correlated errors - II

Generalized least squares estimators, with estimated variance-covariance matrices, and maximum likelihood estimators have been proposed in the literature to deal with the problem of estimating autoregressive models with autocorrelated disturbances. In this paper we compare the small sample efficiencies of these estimators with those of some approximate Bayes estimators. The comparison is done with the help of a sampling experiment applied to a model specification. Though these Bayes estimators utilize very weak prior information, they out-perform the sampling theory estimators in every case we consider.     

Robust studentization of location estimates

Summary The robustness of power and of level of various estimators for the one sample location problem is compared by Monte Carlo methods; an estimate that studentizes particularly well is singled out. Generalizations to more complicated models are discussed.     

Multivariate Hill Estimators

We propose two classes of semi‐parametric estimators for the tail index of a regular varying elliptical random vector. The first one is based on the distance between a tail probability contour and the observations outside this contour. We denote it as the class of separating estimators. The second one is based on the norm of an arbitrary order. We denote it as the class of angular estimators. We show the asymptotic properties and the finite sample performances of both classes. We also illustrate the separating estimators with an empirical application to 21 worldwide financial market indexes.     

Functional coefficient instrumental variables models

We consider estimation of nonparametric structural models under a functional coefficient representation for the regression function. Under this representation, models are linear in the endogenous components with coefficients given by unknown functions of the predetermined variables, a nonparametric generalization of random coefficient models. The functional coefficient restriction is an intermediate approach between fully nonparametric structural models that are ill posed when endogenous variables are continuously distributed, and partially linear models over which they have appreciable flexibility. We propose two-step estimators that use local linear approximations in both steps. The first step is to estimate a vector of reduced forms of regression models and the second step is local linear regression using the estimated reduced forms as regressors. Our large sample results include consistency and asymptotic normality of the proposed estimators. The high practical power of estimators is illustrated via both a Monte Carlo simulation study and an application to returns to education.     

On the estimation of location parameters in the multivariate one sample and two sample problems

Summary In this paper we consider the problem of estimating the vectors of location parameters in the multivariate one sample and two sample problems. These estimators are obtained through the use of the multivariate rank order statistics such as theWilcoxon or the normal scores statistic considered by the authors inPuri, Sen [1966] andSen, Puri [1967] for the corresponding testing problems. The distribution of these estimators is shown to be symmetric with respect to the parameters being estimated. These estimators are translation invariant, robust and asymptotically normal. Their asymptotic relative efficiencies with respect to the estimators based on the vector of means and medians are discussed by applying the criterion ofWilks generalized variance [Anderson, p. 166]. In particular, it is shown that the estimators based on the multivariate normal scores statistics are asymptotically as efficient as the ones based on the method of least squares when the parent distributions are normal. Research sponsored by National Science Foundation Grant No. GP-12462, and by Research Grant, GM-12868 from the N.I.H., Public Health Service.     

Sequential estimation of normal mean under asymmetric loss function with a shrinkage stopping rule

The problem of estimating a normal mean with unknown variance is considered under an asymmetric loss function such that the associated risk is bounded from above by a known quantity. In the absence of a fixed sample size rule, a sequential stopping rule and two sequential estimators of the mean are proposed and second-order asymptotic expansions of their risk functions are derived. It is demonstrated that the sample mean becomes asymptotically inadmissible, being dominated by a shrinkage-type estimator. Also a shrinkage factor is incorporated in the stopping rule and similar inadmissibility results are established. Received September 1997     

Instrumental variables estimators of nonparametric models with discrete endogenous regressors

This paper discusses estimation of nonparametric models whose regressor vectors consist of a vector of exogenous variables and a univariate discrete endogenous regressor with finite support. Both identification and estimators are derived from a transform of the model that evaluates the nonparametric structural function via indicator functions in the support of the discrete regressor. A two-step estimator is proposed where the first step constitutes nonparametric estimation of the instrument and the second step is a nonparametric version of two-stage least squares. Linear functionals of the model are shown to be asymptotically normal, and a consistent estimator of the asymptotic covariance matrix is described. For the binary endogenous regressor case, it is shown that one functional of the model is a conditional (on covariates) local average treatment effect, that permits both unobservable and observable heterogeneity in treatments. Finite sample properties of the estimators from a Monte Carlo simulation study illustrate the practicability of the proposed estimators.     

Mixing of direct, ratio, and product method estimators

In a paper by S rivenkataramana T racy [4], four methods of estimating a population total Y with the use of an auxiliary variable were introduced, given a random sample without replacement from that population. These methods were "built around the idea that estimating the population total is essentially equivalent to estimating the total corresponding to the non-sample units, since that corresponding to the sample units is known once the sample is drawn and measurements are made on it."
However, in the case of small sampling fractions the nonsample units constitute most of the population and no great improvement over the traditional estimators is to be expected. Therefore the methods are compared with the existing estimators and it turns out that they are special cases of the "mixing estimators", introduced in this paper. The latter estimators can be made asymptotically equivalent to the regression estimator and are therefore asymptotically superior to all other estimators. An exact comparison is carried out on the artificial example given in [4]. The statement in this paper that "the proposed estimators are to be preferred to the regression estimator for., superiority of performance in the case of small samples" is evidently misleading. Finally a comparison is made with other "mixing-type" estimators, that can prove very useful in practice.     

A theory of robust long-run variance estimation

Long-run variance estimation can typically be viewed as the problem of estimating the scale of a limiting continuous time Gaussian process on the unit interval. A natural benchmark model is given by a sample that consists of equally spaced observations of this limiting process. The paper analyzes the asymptotic robustness of long-run variance estimators to contaminations of this benchmark model. It is shown that any equivariant long-run variance estimator that is consistent in the benchmark model is highly fragile: there always exists a sequence of contaminated models with the same limiting behavior as the benchmark model for which the estimator converges in probability to an arbitrary positive value. A class of robust inconsistent long-run variance estimators is derived that optimally trades off asymptotic variance in the benchmark model against the largest asymptotic bias in a specific set of contaminated models.     

Goodness-of-fit tests for long memory moving average marginal density

This paper addresses the problem of fitting a known density to the marginal error density of a stationary long memory moving average process when its mean is known and unknown. In the case of unknown mean, when mean is estimated by the sample mean, the first order difference between the residual empirical and null distribution functions is known to be asymptotically degenerate at zero, and hence can not be used to fit a distribution up to an unknown mean. In this paper we show that by using a suitable class of estimators of the mean, this first order degeneracy does not occur. We also investigate the large sample behavior of tests based on an integrated square difference between kernel type error density estimators and the expected value of the error density estimator based on errors. The asymptotic null distributions of suitably standardized test statistics are shown to be chi-square with one degree of freedom in both cases of the known and unknown mean. In addition, we discuss the consistency and asymptotic power against local alternatives of the density estimator based test in the case of known mean. A finite sample simulation study of the test based on residual empirical process is also included.     

Regression analysis with dichotomous regressors and misclassification

We discuss a regression model in which the regressors are dummy variables. The basic idea is that the observation units can be assigned to some well-defined combination of treatments, corresponding to the dummy variables. This assignment can not be done without some error, i.e. misclassification can play a role. This situation is analogous to regression with errors in variables. It is well-known that in these situations identification of the parameters is a prominent problem. We will first show that, in our case, the parameters are not identified by the first two moments but can be identified by the likelihood. Then we analyze two estimators. The first is a moment estimator involving moments up to the third order, and the second is a maximum likelihood estimator calculated with the help of the EM algorithm. Both estimators are evaluated on the basis of a small Monte Carlo experiment.     

Fixed effects estimation of structural parameters and marginal effects in panel probit models

Fixed effects estimators of nonlinear panel models can be severely biased due to the incidental parameters problem. In this paper, I characterize the leading term of a large-T expansion of the bias of the MLE and estimators of average marginal effects in parametric fixed effects panel binary choice models. For probit index coefficients, the former term is proportional to the true value of the coefficients being estimated. This result allows me to derive a lower bound for the bias of the MLE. I then show that the resulting fixed effects estimates of ratios of coefficients and average marginal effects exhibit no bias in the absence of heterogeneity and negligible bias for a wide variety of distributions of regressors and individual effects in the presence of heterogeneity. I subsequently propose new bias-corrected estimators of index coefficients and marginal effects with improved finite sample properties for linear and nonlinear models with predetermined regressors.     

Residual‐based IV estimation of dynamic panel data models with fixed effects

In dynamic panel regression, when the variance ratio of individual effects to disturbance is large, the system‐GMM estimator will have large asymptotic variance and poor finite sample performance. To deal with this variance ratio problem, we propose a residual‐based instrumental variables (RIV) estimator, which uses the residual from regressing Δy_i,t?1 on as the instrument for the level equation. The RIV estimator proposed is consistent and asymptotically normal under general assumptions. More importantly, its asymptotic variance is almost unaffected by the variance ratio of individual effects to disturbance. Monte Carlo simulations show that the RIV estimator has better finite sample performance compared to alternative estimators. The RIV estimator generates less finite sample bias than difference‐GMM, system‐GMM, collapsing‐GMM and Level‐IV estimators in most cases. Under RIV estimation, the variance ratio problem is well controlled, and the empirical distribution of its t‐statistic is similar to the standard normal distribution for moderate sample sizes.     

Sequential estimation of a linear function of normal means under asymmetric loss function

The problem of estimating a linear function of k normal means with unknown variances is considered under an asymmetric loss function such that the associated risk is bounded from above by a known quantity. In the absence of a fixed sample size rule, sequential stopping rules satisfying a general set of assumptions are considered. Two estimators are proposed and second-order asymptotic expansions of their risk functions are derived. It is shown that the usual estimator, namely the linear function of the sample means, is asymptotically inadmissible, being dominated by a shrinkage-type estimator. An example illustrates the use of different multistage sampling schemes and provides asymptotic expansions of the risk functions. Received: August 1999     

Estimation of the order restricted scale parameters for two populations from the Lomax distribution

The usual methods of estimating the unknown parameters of a distribution, use only the information given from the sample data. In many cases, there is, also, another important information for estimating the unknown parameters of our model, such as the order of these parameters, and this last information improves the quality of estimation. In this paper, we deal with the problem of estimating the ordered scale parameters from two populations of the multivariate Lomax distribution, with unknown location parameters. It is proved that the best equivariant estimators of the scale parameters (in the unrestricted case) are not admissible and we construct estimators that improve upon the usual ones (when these parameters are known to be ordered).     

Selection of the best population: an information theoretic approach

This paper is devoted to the statistical problem of ranking and selection populations by using the subset selection formulation. The interest is focused (i) on the selection of the best population among k independent populations and (ii) on the selection of the best population, which is closest to an additional standard or control population. With respect to the first problem the populations are ranked in terms of entropies of their distributions and the population whose distribution has maximum entropy is selected. For the second problem the populations are ranked in terms of divergences between their distributions and the distribution of the standard or control population and the population with the minimum divergence is selected. In each case the populations are assumed to have general parametric densities satisfying the classical regularity conditions of asymptotic statistic. Large sample properties of the estimators of entropies and divergences of the populations will be studied and used in order to determine the probabilities of correct selection of the proposed asymptotic selection rules. Illustrative examples, including a numerical example using real medical data appeared in the literature, will be given for multivariate homoscedastic normal populations and populations described by the regular exponential family of distributions. Received December 2001     

An application of approximate finite sample results to parameter estimation in a linear errors-in-variables model

In the simple errors-in-variables model the least squares estimator of the slope coefficient is known to be biased towards zero for finite sample size as well as asymptotically. In this paper we suggest a new corrected least squares estimator, where the bias correction is based on approximating the finite sample bias by a lower bound. This estimator is computationally very simple. It is compared with previously proposed corrected least squares estimators, where the correction aims at removing the asymptotic bias or the exact finite sample bias. For each type of corrected least squares estimators we consider the theoretical form, which depends on an unknown parameter, as well as various feasible forms. An analytical comparison of the theoretical estimators is complemented by a Monte Carlo study evaluating the performance of the feasible estimators. The new estimator proposed in this paper proves to be superior with respect to the mean squared error.