Large-sample estimation strategies for eigenvalues of a Wishart matrix

The problem of simultaneous asymptotic estimation of eigenvalues of covariance matrix of Wishart matrix is considered under a weighted quadratic loss function. James-Stein type of estimators are obtained which dominate the sample eigenvalues. The relative merits of the proposed estimators are compared to the sample eigenvalues using asymptotic quadratic distributional risk under loal alternatives. It is shown that the proposed estimators are asymptotically superior to the sample eigenvalues. Further, it is demonstrated that the James-Stein type estimator is dominated by its truncated part.     

Smooth estimators for estimating order restricted scale parameters of two gamma distributions

We consider the problem of component-wise estimation of ordered scale parameters of two gamma populations, when it is known apriori which population corresponds to each ordered parameter. Under the scale equivariant squared error loss function, smooth estimators that improve upon the best scale equivariant estimators are derived. These smooth estimators are shown to be generalized Bayes with respect to a non-informative prior. Finally, using Monte Carlo simulations, these improved smooth estimators are compared with the best scale equivariant estimators, their non-smooth improvements obtained in Vijayasree, Misra & Singh (1995), and the restricted maximum likelihood estimators. Acknowledgments. Authors are thankful to a referee for suggestions leading to improved presentation.     

Optimal Design Approach to GMM Estimation of Parameters Based on Empirical Transforms

Parameter estimation based on the generalized method of moments (GMM) is proposed. The proposed method employs a distance between an empirical and the corresponding theoretical transform. Estimation by the empirical characteristic function (CF) is a typical example, but alternative empirical transforms are also employed, such as the empirical Laplace transform when dealing with non‐negative random variables. D‐optimal designs are discussed, whereby the arguments of the empirical transform are chosen by maximizing the determinant of the asymptotic Fisher information matrix for the resulting estimators. The methods are applied to some parametric models for which classical inference is complicated.     

On estimating the mean of the selected normal population under the LINEX loss function

Following Parsian and Farsipour (1999), we consider the problem of estimating the mean of the selected normal population, from two normal populations with unknown means and common known variance, under the LINEX loss function. Some admissibility results for a subclass of equivariant estimators are derived and a sufficient condition for the inadmissibility of an arbitrary equivariant estimator is provided. As a consequence, several of the estimators proposed by Parsian and Farsipour (1999) are shown to be inadmissible and better estimators are obtained. Received January 2001/Revised May 2002     

An information theoretic argument for the validity of the exponential model

Based on the Cramér-Rao inequality (in the multiparameter case) the lower bound of Fisher information matrix is achieved if and only if the underlying distribution is ther-parameter exponential family. This family and the lower bound of Fisher information matrix are characterized when some constraints in the form of expected values of some statistics are available. If we combine the previous results we can find the class of parametric functions and the corresponding UMVU estimators via Cramér-Rao inequality.     

Least squares, preliminary test and Stein-type estimation in general vector AR(p) models

In the general vector autoregressive process AR ( p ), multivariate least square estimation (LSE)/maximum likelihood estimation (MLE) of a subset of the parameters is considered when the complementary subset is suspected to be redundant. This may be viewed as a special case of linear constraints of autoregressive parameters. We incorporate this nonsample information in the estimation process and propose preliminary test and Stein-type estimators for the target subset of parameters. Under local alternatives their asymptotic properties are investigated and compared with those of unrestricted and restricted LSE. The dominance picture of the estimators is presented.     

A new look at variance estimation based on low,high and closing prices taking into account the drift

The joint distribution of low, high and closing prices of the arithmetic Brownian motion is used to evaluate the properties of the most popular estimators of the variance constructed on the basis of high, low and closing prices. The expected values and mean square errors of the Parkinson, Garman–Klass and Rogers–Satchell estimators for the process with a zero drift and a non‐zero drift are derived. Moreover, new volatility estimators, more efficient in the majority of financial applications than the Rogers–Satchell estimator, are proposed. The considered estimators are applied to the estimation of the volatility of the Polish stock index WIG20.     

Detecting Outliers in Frontier Models: A Simple Approach

In frontier analysis, most of the nonparametric approaches (DEA, FDH) are based on envelopment ideas which suppose that with probability one, all the observed units belong to the attainable set. In these deterministic frontier models, statistical theory is now mostly available (Simar and Wilson, 2000a). In the presence of super-efficient outliers, envelopment estimators could behave dramatically since they are very sensitive to extreme observations. Some recent results from Cazals et al. (2002) on robust nonparametric frontier estimators may be used in order to detect outliers by defining a new DEA/FDH deterministic type estimator which does not envelop all the data points and so is more robust to extreme data points. In this paper, we summarize the main results of Cazals et al. (2002) and we show how this tool can be used for detecting outliers when using the classical DEA/FDH estimators or any parametric techniques. We propose a methodology implementing the tool and we illustrate through some numerical examples with simulated and real data. The method should be used in a first step, as an exploratory data analysis, before using any frontier estimation.     

Estimators for the common principal components model based on reweighting: influence functions and Monte Carlo study

The common principal components model for several groups of multivariate observations is a useful parsimonious model for the scatter structure which assumes equal principal axes but different variances along those axes for each group. Due to the lack of resistance of the classical maximum likelihood estimators for the parameters of this model, several robust estimators have been proposed in the literature: plug-in estimators and projection-pursuit (PP) type estimators. In this paper, we show that it is possible to improve the low efficiency of the projection-pursuit estimators by applying a reweighting step. More precisely, we consider plug-in estimators obtained by plugging a reweighted estimator of the scatter matrices into the maximum likelihood equations defining the principal axes. The weights considered penalize observations with large values of the influence measures defined by Boente et al. (2002). The new estimators are studied in terms of theoretical properties (influence functions and asymptotic variances) and are compared with other existing estimators in a simulation study.     

Restricted maximum likelihood estimation under Eisenhart model Ill

For a balanced two-way mixed model, the maximum likelihood (ML) and restricted ML (REML) estimators of the variance components were obtained and compared under the non-negativity requirements of the variance components by L ee and K apadia (1984). In this note, for a mixed (random blocks) incomplete block model, explicit forms for the REML estimators of variance components are obtained. They are always non-negative and have smaller mean squared error (MSE) than the analysis of variance (AOV) estimators. The asymptotic sampling variances of the maximum likelihood (ML) estimators and the REML estimators are compared and the balanced incomplete block design (BIBD) is considered as a special case. The ML estimators are shown to have smaller asymptotic variances than the REML estimators, but a numerical result in the randomized complete block design (RCBD) demonstrated that the performances of the REML and ML estimators are not much different in the MSE sense.     

Natural estimation of variances in a general finite discrete spectrum linear regression model

The method of “natural” estimation of variances in a general (orthogonal or nonorthogonal) finite discrete spectrum linear regression model of time series is suggested. Using geometrical language of the theory of projectors a form and properties of the estimators are investigated. Obtained results show that in describing the first and second moment properties of the new estimators the central role plays a matrix known in linear algebra as the Schur complement. Illustrative examples with particular regressors demonstrate direct applications of the results.     

On equalities of estimations of parametric functions under a general linear model and its restricted models

Estimations of parametric functions under a general linear model and its restricted models involve some complicated operations of matrices and their generalized inverses. In the past several years, a powerful tool—the matrix rank method was utilized to manipulate various complicated matrix expressions that involve generalized inverses of matrices. In this paper, we use this method to derive necessary and sufficient conditions for six equalities of the ordinary least-squares estimators and the best linear unbiased estimators of parametric functions to equal under a general linear model and its corresponding restricted model.     

On the existence of locally mvu estimators

It is proved that there exists an unbiased estimator for some real parameter of a class of distributions, which has minimal variance for some fixed distribution among all corresponding unbiased estimators, if and. only if the corresponding minimal variances for all related unbiased estimation problems concerning finite subsets of the underlying family of distributions are bounded. As an application it is shown that there does not exist some unbiased estimator for θ^k+c(ε≥0) with minimal variance for θ =0 among all corresponding unbiased estimators on the base of k i.i.d. random variables with a Cauchy-distribution, where θ denotes some location parameter.     

Partial maximum likelihood estimation of spatial probit models

This paper analyzes spatial Probit models for cross sectional dependent data in a binary choice context. Observations are divided by pairwise groups and bivariate normal distributions are specified within each group. Partial maximum likelihood estimators are introduced and they are shown to be consistent and asymptotically normal under some regularity conditions. Consistent covariance matrix estimators are also provided. Estimates of average partial effects can also be obtained once we characterize the conditional distribution of the latent error. Finally, a simulation study shows the advantages of our new estimation procedure in this setting. Our proposed partial maximum likelihood estimators are shown to be more efficient than the generalized method of moments counterparts.     

An Example of Data Technology Product: A Control Chart for Weibull Processes

This work proposes a new Shewhart-type control chart of the Weibull percentile (i.e. the reliable life) as a practical example of a product attained following the Data Technology (DT) approach. DT is briefly introduced as a new discipline defined apart from Information Technology (IT). Following this approach, some specific Bayes estimators are selected from literature and then used to build the above new chart. These estimators allow to improve the control making use of any available kind of data (statistical and non-statistical). The operative steps of DT approach are fully explained. The results are illustrated by means of a real applicative example.     

On the relative efficiency of estimators which include the initial observations in the estimation of seemingly unrelated regressions with first-order autoregressive disturbances

The generalized least squares estimator for a seemingly unrelated regressions model with first-order vector autoregressive disturbances is outlined, and its efficiency is compared with that of an approximate generalized least squares estimator which ignores the first observation. A scalar index for the loss of efficiency is developed and applied to a special case where the matrix of autoregressive parameters is diagonal and the regressors are smooth. Also, for a more general model, a Monte Carlo study is used to investigate the relative efficiencies of various estimators. The results suggest that Maeshiro (1980) has overstated the case for the exact generalized least squares estimator, because, in many circumstances, it is only marginally better than the approximate generalized least squares estimator.     

Shrinkage estimators of time series seasonal factors and their effect on forecasting accuracy

This paper shows that forecasting accuracy can be improved through better estimation of seasonal factors under conditions for which relatively simple methods are preferred, such as relatively few historical data, noisy data, and/or a large number of series to be forecasted. In such situations, the preferred method of seasonal adjustment is often ratio-to-moving-averages (classical) decomposition. This paper proposes two shrinkage estimators to improve the accuracy of classical decomposition seasonal factors. In a simulation study, both of the proposed estimators provided consistently greater accuracy than classical decomposition, with the improvement sometimes being dramatic. The performances of the two estimators depended on characteristics of the series, and guidelines were developed for choosing one of them under a given set of conditions. For a set of monthly, M-competition series, greater forecasting accuracy was achieved when either of the proposed methods was used for seasonal adjustment rather than classical decomposition, and the greatest accuracy was achieved by following the guidelines for choosing a method.     

A new class of asymptotically efficient estimators for moment condition models

In this paper, we propose a new class of asymptotically efficient estimators for moment condition models. These estimators share the same higher order bias properties as the generalized empirical likelihood estimators and once bias corrected, have the same higher order efficiency properties as the bias corrected generalized empirical likelihood estimators. Unlike the generalized empirical likelihood estimators, our new estimators are much easier to compute. A simulation study finds that our estimators have better finite sample performance than the two-step GMM, and compare well to several potential alternatives in terms of both computational stability and overall performance.     

A Comparative Analysis of Different IV and GMM Estimators of Dynamic Panel Data Models

It is well known that the usual procedures for estimating panel data models are inconsistent in the dynamic setting. A large number of consistent estimators however, have been proposed in the literature. This paper provides a survey of the majority of mainstream estimators, which tend to consist of IV and GMM ones. It also considers a newly proposed extension to the promising Wansbeek–Bekker estimator (Harris & Mátyás, 2000). To provide guidance to the applied researcher working on micro-datasets, the small sample performance of these estimators is evaluated using a set of Monte Carlo experiments.     

Panel data models with spatially correlated error components

In this paper we consider a panel data model with error components that are both spatially and time-wise correlated. The model blends specifications typically considered in the spatial literature with those considered in the error components literature. We introduce generalizations of the generalized moments estimators suggested in Kelejian and Prucha (1999. A generalized moments estimator for the autoregressive parameter in a spatial model. International Economic Review 40, 509–533) for estimating the spatial autoregressive parameter and the variance components of the disturbance process. We then use those estimators to define a feasible generalized least squares procedure for the regression parameters. We give formal large sample results for the proposed estimators. We emphasize that our estimators remain computationally feasible even in large samples.