Robust linear static panel data models using ε-contamination

The paper develops a general Bayesian framework for robust linear static panel data models using$\epsilon$-contamination. A two-step approach is employed to derive the conditional type-II maximum likelihood (ML-II) posterior distribution of the coefficients and individual effects. The ML-II posterior means are weighted averages of the Bayes estimator under a base prior and the data-dependent empirical Bayes estimator. Two-stage and three stage hierarchy estimators are developed and their finite sample performance is investigated through a series of Monte Carlo experiments. These include standard random effects as well as Mundlak-type, Chamberlain-type and Hausman–Taylor-type models. The simulation results underscore the relatively good performance of the three-stage hierarchy estimator. Within a single theoretical framework, our Bayesian approach encompasses a variety of specifications while conventional methods require separate estimators for each case.     

Simultaneous estimation of hazard rates of several exponential populations

Suppose independent random samples are drawn from k (2) populations with a common location parameter and unequal scale parameters. We consider the problem of estimating simultaneously the hazard rates of these populations. The analogues of the maximum likelihood (ML), uniformly minimum variance unbiased (UMVU) and the best scale equivariant (BSE) estimators for the one population case are improved using Rao‐Blackwellization. The improved version of the BSE estimator is shown to be the best among these estimators. Finally, a class of estimators that dominates this improved estimator is obtained using the differential inequality approach.     

Maximum likelihood and restricted maximum likelihood estimation for a class of Gaussian Markov random fields

This work describes a Gaussian Markov random field model that includes several previously proposed models, and studies properties of its maximum likelihood (ML) and restricted maximum likelihood (REML) estimators in a special case. Specifically, for models where a particular relation holds between the regression and precision matrices of the model, we provide sufficient conditions for existence and uniqueness of ML and REML estimators of the covariance parameters, and provide a straightforward way to compute them. It is found that the ML estimator always exists while the REML estimator may not exist with positive probability. A numerical comparison suggests that for this model ML estimators of covariance parameters have, overall, better frequentist properties than REML estimators.     

Restricted maximum likelihood estimation under Eisenhart model Ill

For a balanced two-way mixed model, the maximum likelihood (ML) and restricted ML (REML) estimators of the variance components were obtained and compared under the non-negativity requirements of the variance components by L ee and K apadia (1984). In this note, for a mixed (random blocks) incomplete block model, explicit forms for the REML estimators of variance components are obtained. They are always non-negative and have smaller mean squared error (MSE) than the analysis of variance (AOV) estimators. The asymptotic sampling variances of the maximum likelihood (ML) estimators and the REML estimators are compared and the balanced incomplete block design (BIBD) is considered as a special case. The ML estimators are shown to have smaller asymptotic variances than the REML estimators, but a numerical result in the randomized complete block design (RCBD) demonstrated that the performances of the REML and ML estimators are not much different in the MSE sense.     

Optimal estimation under nonstandard conditions

We analyze optimality properties of maximum likelihood (ML) and other estimators when the problem does not necessarily fall within the locally asymptotically normal (LAN) class, therefore covering cases that are excluded from conventional LAN theory such as unit root nonstationary time series. The classical Hájek–Le Cam optimality theory is adapted to cover this situation. We show that the expectation of certain monotone “bowl-shaped” functions of the squared estimation error are minimized by the ML estimator in locally asymptotically quadratic situations, which often occur in nonstationary time series analysis when the LAN property fails. Moreover, we demonstrate a direct connection between the (Bayesian property of) asymptotic normality of the posterior and the classical optimality properties of ML estimators.     

On Maximum Likelihood Estimation of Dynamic Panel Data Models

We analyse the finite sample properties of maximum likelihood estimators for dynamic panel data models. In particular, we consider transformed maximum likelihood (TML) and random effects maximum likelihood (RML) estimation. We show that TML and RML estimators are solutions to a cubic first‐order condition in the autoregressive parameter. Furthermore, in finite samples both likelihood estimators might lead to a negative estimate of the variance of the individual‐specific effects. We consider different approaches taking into account the non‐negativity restriction for the variance. We show that these approaches may lead to a solution different from the unique global unconstrained maximum. In an extensive Monte Carlo study we find that this issue is non‐negligible for small values of T and that different approaches might lead to different finite sample properties. Furthermore, we find that the Likelihood Ratio statistic provides size control in small samples, albeit with low power due to the flatness of the log‐likelihood function. We illustrate these issues modelling US state level unemployment dynamics.     

Relative efficiencies of some simple Bayes estimators of coefficients in a dynamic equation with serially correlated errors - II

Generalized least squares estimators, with estimated variance-covariance matrices, and maximum likelihood estimators have been proposed in the literature to deal with the problem of estimating autoregressive models with autocorrelated disturbances. In this paper we compare the small sample efficiencies of these estimators with those of some approximate Bayes estimators. The comparison is done with the help of a sampling experiment applied to a model specification. Though these Bayes estimators utilize very weak prior information, they out-perform the sampling theory estimators in every case we consider.     

Properties of h-Likelihood Estimators in Clustered Data

We study properties of the maximum h-likelihood estimators for random effects in clustered data. To define optimality in random effects predictions, several foundational concepts of statistics such as likelihood, unbiasedness, consistency, confidence distribution and the Cramer–Rao lower bound are extended. Exact probability statements about interval estimators for random effects can be made asymptotically without a prior assumption. Using the binary-matched pair example, we illustrated that the use of random effects recover information, leading to the boon on estimating treatment effects.     

Optimal allocation of measurements in a linear calibration process

A problem of allocation of measurements for a linear calibration process is considered in this article. It is assumed that a total of N measurements are made some of which may be measurements on two distinct standards, while the remaining measurements are on m different unknown specimens. We discuss allocation of the N measurements for the two standards and m unknown specimens based on A-optimality criterion, which is applied to asymptotic variances of maximum likelihood estimators for the true values of unknown specimens. It can be shown that the optimal allocation depends on the true values of unknown specimens. Hence, the user may resort to locally or Bayesian A-optimal measurement designs. Some practical solution is presented. Furthermore, the impact of prior on the allocation is also discussed.     

Assessing the robustness of estimators when fitting Poisson inverse Gaussian models

The generalized linear mixed model (GLMM) extends classical regression analysis to non-normal, correlated response data. Because inference for GLMMs can be computationally difficult, simplifying distributional assumptions are often made. We focus on the robustness of estimators when a main component of the model, the random effects distribution, is misspecified. Results for the maximum likelihood estimators of the Poisson inverse Gaussian model are presented.     

Maximum score estimation of the stochastic utility model of choice

This paper introduces a class of robust estimators of the parameters of a stochastic utility function. Existing maximum likelihood and regression estimation methods require the assumption of a particular distributional family for the random component of utility. In contrast, estimators of the ‘maximum score’ class require only weak distributional assumptions for consistency. Following presentation and proof of the basic consistency theorem, additional results are given. An algorithm for achieving maximum score estimates and some small sample Monte Carlo tests are also described.     

On the efficiency of least squares estimators in non-linear models

Summary  The identity of least squares estimators å and maximum likelihood estimators â is studied in non-linear models of the type z = g ( a ), where z are observable quantities with a probability density function pr ( z ). This identity was proved for independent random variables z and for distributions pr ( z ), of which the arithmetic sample mean is an optimal estimate.     

Best unbiased estimators for the parameters of a two-parameter Pareto distribution

Summary For a two-parameter Pareto distributionMalik [1970] has shown that the maximum likelihood estimators of the parameters are jointly sufficient. In this article the maximum likelihood estimators are shown to be jointly complete. Furthermore, unbiased estimators for the two parameters are obtained and are shown to be functions of the jointly complete sufficient statistics, thereby establishing them as the best unblased estimators of the two parameters.This research is a part of the first author's Ph.D. dissertation. The authors wish to thank Dr. Kenny S. Crump, for many helpful suggestions and a referee for improvements in the proofs.     

Estimation of order-restricted means of two normal populations under the LINEX loss function

In this paper, the estimation of order-restricted means of two normal distributions is studied under the LINEX loss function, when the variances are unknown and possibly unequal. Under certain sufficient conditions to be described in this paper, the proposed plug-in estimators uniformly perform better than the existing unrestricted maximum likelihood estimators. Further, the restricted maximum likelihood estimators are compared with the unrestricted maximum likelihood estimators under the Pitman nearness criterion. A simulation study is conducted and it is shown that our proposed plug-in estimators perform better than the unrestricted maximum likelihood estimators. An illustrative example of real data analysis is also given to compare the estimators.     

On the Practice of Rescaling Covariates

Whether doing parametric or nonparametric regression with shrinkage, thresholding, penalized likelihood, Bayesian posterior estimators (e.g., ridge regression, lasso, principal component regression, waveshrink or Markov random field ), it is common practice to rescale covariates by dividing by their respective standard errors ρ. The stated goal of this operation is to provide unitless covariates to compare like with like, especially when penalized likelihood or prior distributions are used. We contend that this vision is too simplistic. Instead, we propose to take into account a more essential component of the structure of the regression matrix by rescaling the covariates based on the diagonal elements of the covariance matrix Σ of the maximum-likelihood estimator. We illustrate the differences between the standard ρ- and proposed Σ-rescalings with various estimators and data sets.     

ESTIMATION OF CENSORED PANEL‐DATA MODELS WITH SLOPE HETEROGENEITY

This paper considers estimation of censored panel‐data models with individual‐specific slope heterogeneity. The slope heterogeneity may be random (random slopes model) or related to covariates (correlated random slopes model). Maximum likelihood and censored least‐absolute deviations estimators are proposed for both models. The estimators are simple to implement and, in the case of maximum likelihood, lead to straightforward estimation of partial effects. The rescaled bootstrap suggested by Andrews (Econometrica 2000; 68 : 399–405) is used to deal with the possibility of variance parameters being equal to zero. The methodology is applied to an empirical study of Dutch household portfolio choice, where the outcome variable (portfolio share in safe assets) has corner solutions at zero and one. As predicted by economic theory, there is strong evidence of correlated random slopes for the age profiles, indicating a heterogeneous age profile of portfolio adjustment that varies significantly with other household characteristics. Copyright © 2013 John Wiley & Sons, Ltd.     

Some properties of the LIML estimator in a dynamic panel structural equation

We investigate the finite sample and asymptotic properties of the within-groups (WG), the random-effects quasi-maximum likelihood (RQML), the generalized method of moment (GMM) and the limited information maximum likelihood (LIML) estimators for a panel autoregressive structural equation model with random effects when both T (time-dimension) and N (cross-section dimension) are large. When we use the forward-filtering due to Alvarez and Arellano (2003), the WG, the RQML and GMM estimators are significantly biased when both T and N are large while T/N is different from zero. The LIML estimator gives desirable asymptotic properties when T/N converges to a constant.     

Modelling of repairable systems with various degrees of repair

The availability of a stochastic repairable system depends on the failure behaviour and on repair strategies. In this paper, we deal with a general repair model for a system using auxiliary counting processes and corresponding intensities which include various degrees of repair (between minimal repair and perfect repair). For determining the model parameters we need estimators depending on failure times and repair times: maximum likelihood (ML) estimator and Bayes estimators are considered. Special results are obtained by the use of Weibull-type intensities and random observation times.     

Nonparametric maximum likelihood estimation in a non locally compact setting

Maximum likelihood estimation is considered in the context of infinite dimensional parameter spaces. It is shown that in some locally convex parameter spaces sequential compactness of the bounded sets ensures the existence of minimizers of objective functions and the consistency of maximum likelihood estimators in an appropriate topology. The theory is applied to revisit some classical problems of nonparametric maximum likelihood estimation, to study location parameters in Banach spaces, and finally to obtain Varadarajan’s theorem on the convergence of empirical measures in the form of a consistency result for a sequence of maximum likelihood estimators. Several parameter spaces sharing the crucial compactness property are identified. This research was supported by grants from the National Sciences and Engineering Research Council of Canada and the Fonds FCAR de la Province de Québec.     

Performance of empirical Bayes estimators of random coefficients in multilevel analysis: Some results for the random intercept-only model

For a multilevel model with two levels and only a random intercept, the quality of different estimators of the random intercept is examined. Analytical results are given for the marginal model interpretation where negative estimates of the variance components are allowed for. Except for four or five level-2 units, the Empirical Bayes Estimator (EBE) has a lower average Bayes risk than the Ordinary Least Squares Estimator (OLSE). The EBEs based on restricted maximum likelihood (REML) estimators of the variance components have a lower Bayes risk than the EBEs based on maximum likelihood (ML) estimators. For the hierarchical model interpretation, where estimates of the variance components are restricted being positive, Monte Carlo simulations were done. In this case the EBE has a lower average Bayes risk than the OLSE, also for four or five level-2 units. For large numbers of level-1 (30) or level-2 units (100), the performances of REML-based and ML-based EBEs are comparable. For small numbers of level-1 (10) and level-2 units (25), the REML-based EBEs have a lower Bayes risk than ML-based EBEs only for high intraclass correlations (0.5).