On the optimum number of levels in the one-way model with random effects

The optimal number of levels is studied for the one-way random model with normally distributed effects. The optimum criteria used are based on the variances of the traditional analysis of variance estimators of the variance components. Exact solutions are compared to earlier results based on lower bounds of the sampling variances. Comparisons are also made to the large-sample variances of the estimates based on restricted maximum likelihood. Received February 2002     

Restricted maximum likelihood estimation under Eisenhart model Ill

For a balanced two-way mixed model, the maximum likelihood (ML) and restricted ML (REML) estimators of the variance components were obtained and compared under the non-negativity requirements of the variance components by L ee and K apadia (1984). In this note, for a mixed (random blocks) incomplete block model, explicit forms for the REML estimators of variance components are obtained. They are always non-negative and have smaller mean squared error (MSE) than the analysis of variance (AOV) estimators. The asymptotic sampling variances of the maximum likelihood (ML) estimators and the REML estimators are compared and the balanced incomplete block design (BIBD) is considered as a special case. The ML estimators are shown to have smaller asymptotic variances than the REML estimators, but a numerical result in the randomized complete block design (RCBD) demonstrated that the performances of the REML and ML estimators are not much different in the MSE sense.     

Likelihood estimation and inference in threshold regression

This paper studies likelihood-based estimation and inference in parametric discontinuous threshold regression models with i.i.d. data. The setup allows heteroskedasticity and threshold effects in both mean and variance. By interpreting the threshold point as a “middle” boundary of the threshold variable, we find that the Bayes estimator is asymptotically efficient among all estimators in the locally asymptotically minimax sense. In particular, the Bayes estimator of the threshold point is asymptotically strictly more efficient than the left-endpoint maximum likelihood estimator and the newly proposed middle-point maximum likelihood estimator. Algorithms are developed to calculate asymptotic distributions and risk for the estimators of the threshold point. The posterior interval is proved to be an asymptotically valid confidence interval and is attractive in both length and coverage in finite samples.     

Limited deviation estimators of the Poisson parameter

Estimators for the Poisson parameter are proposed which perform well with respect to both a weighted, i.e. Bayes, and unweighted risk criterion. The estimators follow the Bayes rule (with respect to a conjugate gamma prior) as closely as possible subject to a restraint imposed on the allowable deviation from the minimax estimate. The resulting class of rules maintains good performance with respect to the Bayes criterion while at the same time possessing bounded risk functions. The excess Bayes risk incurred is compared to a lower bound on the optimal restricted Bayes risk.     

Small‐scale Inference: Empirical Bayes and Confidence Methods for as Few as a Single Comparison

Empirical Bayes methods of estimating the local false discovery rate (LFDR) by maximum likelihood estimation (MLE), originally developed for large numbers of comparisons, are applied to a single comparison. Specifically, when assuming a lower bound on the mixing proportion of true null hypotheses, the LFDR MLE can yield reliable hypothesis tests and confidence intervals given as few as one comparison. Simulations indicate that constrained LFDR MLEs perform markedly better than conventional methods, both in testing and in confidence intervals, for high values of the mixing proportion, but not for low values. (A decision‐theoretic interpretation of the confidence distribution made those comparisons possible.) In conclusion, the constrained LFDR estimators and the resulting effect‐size interval estimates are not only effective multiple comparison procedures but also they might replace p‐values and confidence intervals more generally. The new methodology is illustrated with the analysis of proteomics data.     

Estimation of multiple poisson means: A compromise between maximum likelihood and empirical bayes estimators

For estimatingp(⩾ 2) independent Poisson means, the paper considers a compromise between maximum likelihood and empirical Bayes estimators. Such compromise estimators enjoy both good componentwise as well as ensemble properties. Research supported by the NSF Grant Number MCS-8218091.     

Maximum likelihood and restricted maximum likelihood estimation for a class of Gaussian Markov random fields

This work describes a Gaussian Markov random field model that includes several previously proposed models, and studies properties of its maximum likelihood (ML) and restricted maximum likelihood (REML) estimators in a special case. Specifically, for models where a particular relation holds between the regression and precision matrices of the model, we provide sufficient conditions for existence and uniqueness of ML and REML estimators of the covariance parameters, and provide a straightforward way to compute them. It is found that the ML estimator always exists while the REML estimator may not exist with positive probability. A numerical comparison suggests that for this model ML estimators of covariance parameters have, overall, better frequentist properties than REML estimators.     

Bayesian point estimation of the cointegration space

A neglected aspect of the otherwise fairly well developed Bayesian analysis of cointegration is point estimation of the cointegration space. It is pointed out here that, due to the well known non-identification of the cointegration vectors, the parameter space is not Euclidean and the loss functions underlying the conventional Bayes estimators are therefore questionable. We present a Bayes estimator of the cointegration space which takes the curved geometry of the parameter space into account. This estimate has the interpretation of being the posterior mean cointegration space and is invariant to the order of the time series, a property not shared with many of the Bayes estimators in the cointegration literature. An overall measure of cointegration space uncertainty is also proposed. Australian interest rate data are used for illustration. A small simulation study shows that the new Bayes estimator compares favorably to the maximum likelihood estimator.     

Smooth estimators for estimating order restricted scale parameters of two gamma distributions

We consider the problem of component-wise estimation of ordered scale parameters of two gamma populations, when it is known apriori which population corresponds to each ordered parameter. Under the scale equivariant squared error loss function, smooth estimators that improve upon the best scale equivariant estimators are derived. These smooth estimators are shown to be generalized Bayes with respect to a non-informative prior. Finally, using Monte Carlo simulations, these improved smooth estimators are compared with the best scale equivariant estimators, their non-smooth improvements obtained in Vijayasree, Misra & Singh (1995), and the restricted maximum likelihood estimators. Acknowledgments. Authors are thankful to a referee for suggestions leading to improved presentation.     

Modelling of repairable systems with various degrees of repair

The availability of a stochastic repairable system depends on the failure behaviour and on repair strategies. In this paper, we deal with a general repair model for a system using auxiliary counting processes and corresponding intensities which include various degrees of repair (between minimal repair and perfect repair). For determining the model parameters we need estimators depending on failure times and repair times: maximum likelihood (ML) estimator and Bayes estimators are considered. Special results are obtained by the use of Weibull-type intensities and random observation times.     

Monotone empirical Bayes estimators for the continuous one-parameter exponential family

Abstract  A class of empirical Bayes estimators (EBE's) is proposed for estimating the natural parameter of a one-parameter exponential family. In contrast to related EBE's proposed and investigated until now, the EBE's presented in this paper possess the nice property of being monotone by construction. Based on an arbitrary reasonable estimator of the underlying marginal density, a simple algorithm is given to construct a monotone EBE. Two representations of these EBE's are given, one of which serves as a tool in establishing asymptotic results, while the other one, related with isotonic regression, proves useful in the actual computation.     

Estimates of relative risk

Summary For the two-sample problem with proportional hazard functions, we consider estimation of the constant of proportionality, known as relative risk, using complete uncensored data. For this very special case of Cox’s (1972) regression model for survival data, we find a two-step estimate which is asymptotically equivalent to Cox’s partial likelihood estimate, and we show that both estimates are asymptotically optimal (in the sense of minimum asymptotic variance) among all regular rank estimates of relative risk. Supported by NSF grant 81-00748.     

Some model-restricted shrinkage estimators for contingency tables with missing data

For contingency tables with extensive missing data, the unrestricted MLE under the saturated model, computed by the EM algorithm, is generally unsatisfactory. In this case, it may be better to fit a simpler model by imposing some restrictions on the parameter space. Perlman and Wu (1999) propose lattice conditional independence (LCI) models for contingency tables with arbitrary missing data patterns. When this LCI model fits well, the restricted MLE under the LCI model is more accurate than the unrestricted MLE under the saturated model, but not in general. Here we propose certain empirical Bayes (EB) estimators that adaptively combine the best features of the restricted and unrestricted MLEs. These EB estimators appear to be especially useful when the observed data is sparse, even in cases where the suitability of the LCI model is uncertain. We also study a restricted EM algorithm (called the ER algorithm) with similar desirable features. Received: July 1999     

Efficient parameter estimation for independent and INAR(1) negative binomial samples

We consider moment based estimation methods for estimating parameters of the negative binomial distribution that are almost as efficient as maximum likelihood estimation and far superior to the celebrated zero term method and the standard method of moments estimator. Maximum likelihood estimators are difficult to compute for dependent samples such as samples generated from the negative binomial first-order autoregressive integer-valued processes. The power method of estimation is suggested as an alternative to maximum likelihood estimation for such samples and a comparison is made of the asymptotic normalized variance between the power method, method of moments and zero term method estimators.     

Choosing instrumental variables in conditional moment restriction models

Properties of GMM estimators are sensitive to the choice of instrument. Using many instruments leads to high asymptotic asymptotic efficiency but can cause high bias and/or variance in small samples. In this paper we develop and implement asymptotic mean square error (MSE) based criteria for instrument selection in estimation of conditional moment restriction models. The models we consider include various nonlinear simultaneous equations models with unknown heteroskedasticity. We develop moment selection criteria for the familiar two-step optimal GMM estimator (GMM), a bias corrected version, and generalized empirical likelihood estimators (GEL), that include the continuous updating estimator (CUE) as a special case. We also find that the CUE has lower higher-order variance than the bias-corrected GMM estimator, and that the higher-order efficiency of other GEL estimators depends on conditional kurtosis of the moments.     

Bias in estimating multivariate and univariate diffusions

Multivariate continuous time models are now widely used in economics and finance. Empirical applications typically rely on some process of discretization so that the system may be estimated with discrete data. This paper introduces a framework for discretizing linear multivariate continuous time systems that includes the commonly used Euler and trapezoidal approximations as special cases and leads to a general class of estimators for the mean reversion matrix. Asymptotic distributions and bias formulae are obtained for estimates of the mean reversion parameter. Explicit expressions are given for the discretization bias and its relationship to estimation bias in both multivariate and in univariate settings. In the univariate context, we compare the performance of the two approximation methods relative to exact maximum likelihood (ML) in terms of bias and variance for the Vasicek process. The bias and the variance of the Euler method are found to be smaller than the trapezoidal method, which are in turn smaller than those of exact ML. Simulations suggest that when the mean reversion is slow, the approximation methods work better than ML, the bias formulae are accurate, and for scalar models the estimates obtained from the two approximate methods have smaller bias and variance than exact ML. For the square root process, the Euler method outperforms the Nowman method in terms of both bias and variance. Simulation evidence indicates that the Euler method has smaller bias and variance than exact ML, Nowman’s method and the Milstein method.     

On Maximum Likelihood Estimation of Dynamic Panel Data Models

We analyse the finite sample properties of maximum likelihood estimators for dynamic panel data models. In particular, we consider transformed maximum likelihood (TML) and random effects maximum likelihood (RML) estimation. We show that TML and RML estimators are solutions to a cubic first‐order condition in the autoregressive parameter. Furthermore, in finite samples both likelihood estimators might lead to a negative estimate of the variance of the individual‐specific effects. We consider different approaches taking into account the non‐negativity restriction for the variance. We show that these approaches may lead to a solution different from the unique global unconstrained maximum. In an extensive Monte Carlo study we find that this issue is non‐negligible for small values of T and that different approaches might lead to different finite sample properties. Furthermore, we find that the Likelihood Ratio statistic provides size control in small samples, albeit with low power due to the flatness of the log‐likelihood function. We illustrate these issues modelling US state level unemployment dynamics.     

Robust linear static panel data models using ε-contamination

The paper develops a general Bayesian framework for robust linear static panel data models using$\epsilon$-contamination. A two-step approach is employed to derive the conditional type-II maximum likelihood (ML-II) posterior distribution of the coefficients and individual effects. The ML-II posterior means are weighted averages of the Bayes estimator under a base prior and the data-dependent empirical Bayes estimator. Two-stage and three stage hierarchy estimators are developed and their finite sample performance is investigated through a series of Monte Carlo experiments. These include standard random effects as well as Mundlak-type, Chamberlain-type and Hausman–Taylor-type models. The simulation results underscore the relatively good performance of the three-stage hierarchy estimator. Within a single theoretical framework, our Bayesian approach encompasses a variety of specifications while conventional methods require separate estimators for each case.     

Consistent inference in fixed-effects stochastic frontier models

The classical stochastic frontier panel data models provide no mechanism to disentangle individual time invariant unobserved heterogeneity from inefficiency. Greene (2005a, b) proposed the so-called “true” fixed-effects specification that distinguishes these two latent components. However, due to the incidental parameters problem, his maximum likelihood estimator may lead to biased variance estimates. We propose two alternative estimators that achieve consistency for $n\to \infty$ with fixed $T$. Furthermore, we extend the Chen et al. (2014) results providing a feasible estimator when the inefficiency is heteroskedastic and follows a first-order autoregressive process. We investigate the behavior of the proposed estimators through Monte Carlo simulations showing good finite sample properties, especially in small samples. An application to hospitals’ technical efficiency illustrates the usefulness of the new approach.