Jackknife estimators of a relative risk in 2×2 and 2×2×K contingency tables

Several jackknife estimators of a relative risk in a single 2×2 contingency table and of a common relative risk in a 2×2× K contingency table are presented. The estimators are based on the maximum likelihood estimator in a single table and on an estimator proposed by Tarone (1981) for stratified samples, respectively. For the stratified case, a sampling scheme is assumed where the number of observations within each table tends to infinity but the number of tables remains fixed. The asymptotic properties of the above estimators are derived. Especially, we present two general results which under certain regularity conditions yield consistency and asymptotic normality of every jackknife estimator of a bunch of functions of binomial probabilities.     

Combining kernel estimators in the uniform deconvolution problem

We construct a density estimator and an estimator of the distribution function in the uniform deconvolution model. The estimators are based on inversion formulas and kernel estimators of the density of the observations and its derivative. Initially the inversions yield two different estimators of the density and two estimators of the distribution function. We construct asymptotically optimal convex combinations of these two estimators. We also derive pointwise asymptotic normality of the resulting estimators, the pointwise asymptotic biases and an expansion of the mean integrated squared error of the density estimator. It turns out that the pointwise limit distribution of the density estimator is the same as the pointwise limit distribution of the density estimator introduced by Groeneboom and Jongbloed (Neerlandica, 57, 2003, 136), a kernel smoothed nonparametric maximum likelihood estimator of the distribution function.     

Consistency and asymptotic normality of maximum likelihood estimation for Gaussian Markov processes from discrete observations

In this paper we prove the weak consistency and the asymptotic normality of the maximum likelihood estimation based on discrete observations ofn independent Gaussian Markov processes. The Ornstein Uhlenbeck process is a special Gaussian Markov process. We derive asymptotic simultaneous confidence regions for the parameters of the Ornstein Uhlenbeck process as an application.     

Asymptotic properties of the maximum likelihood estimator in dichotomous logit models

The existence and strong consistency of the maximum likelihood estimator are analyzed in the context of dichotomous logit models. Sufficient conditions are given for the asymptotic normality of this estimator.     

Asymptotic normality of the NPMLE of linear functionals for interval censored data, case 1

We give a new proof of the asymptotic normality of a class of linear functionals of the nonparametric maximum likelihood estimator (NPMLE) of a distribution function with "case 1" interval censored data. In particular our proof simplifies the proof of asymptotic normality of the mean given in Groeneboom and Wellner (1992). The proof relies strongly on a rate of convergence result due to van de Geer (1993), and methods from empirical process theory.     

Parameter estimation for the drift of a time inhomogeneous jump diffusion process

This work deals with parameter estimation for the drift of jump diffusion processes which are driven by a Lévy process and whose drift term is linear in the parameter. In contrast to the commonly used maximum likelihood estimator, our proposed estimator has the practical advantage that its calculation does not require the evaluation of the continuous part of the sample path. In the important case of an Ornstein‐Uhlenbeck‐type jump diffusion, which is a widely used model, we prove consistency and asymptotic normality.     

Extracting a common stochastic trend: Theory with some applications

This paper investigates the statistical properties of estimators of the parameters and unobserved series for state space models with integrated time series. In particular, we derive the full asymptotic results for maximum likelihood estimation using the Kalman filter for a prototypical class of such models—those with a single latent common stochastic trend. Indeed, we establish the consistency and asymptotic mixed normality of the maximum likelihood estimator and show that the conventional method of inference is valid for this class of models. The models we explicitly consider comprise a special–yet useful–class of models that may be employed to extract the common stochastic trend from multiple integrated time series. Such models can be very useful to obtain indices that represent fluctuations of various markets or common latent factors that affect a set of economic and financial variables simultaneously. Moreover, our derivation of the asymptotics of this class makes it clear that the asymptotic Gaussianity and the validity of the conventional inference for the maximum likelihood procedure extends to a larger class of more general state space models involving integrated time series. Finally, we demonstrate the utility of this class of models extracting a common stochastic trend from three sets of time series involving short- and long-term interest rates, stock return volatility and trading volume, and Dow Jones stock prices.     

Strong Consistency of the Maximum Likelihood Estimator in Generalized Linear and Nonlinear Mixed-Effects Models

Generalized linear and nonlinear mixed-effects models are used extensively in biomedical, social, and agricultural sciences. The statistical analysis of these models is based on the asymptotic properties of the maximum likelihood estimator. However, it is usually assumed that the maximum likelihood estimator is consistent, without providing a proof. A rigorous proof of the consistency by verifying conditions from existing results can be very difficult due to the integrated likelihood. In this paper, we present some easily verifiable conditions for the strong consistency of the maximum likelihood estimator in generalized linear and nonlinear mixed-effects models. Based on this result, we prove that the maximum likelihood estimator is consistent for some frequently used models such as mixed-effects logistic regression models and growth curve models.     

Some large-concentration-parameter asymptotics for the k-class estimators

A sufficient condition is derived in this paper for the consistency and asymptotic normality of the k-class estimators (k-stochastic or nonstochastic) as the concentration parameter increases indefinitely, with the sample size either staying fixed or also increasing. It is further shown that the limited-information maximum likelihood estimator satisfies this condition. Since large sample size implies a large concentration parameter, but not vice versa, the usual conditions for consistency and asymptotic normality of the k-class estimators as the sample size increases can be inferred from the results given in this paper. But more importantly, the results in this paper shed further light on the small-sample properties of the stochastic k-class estimators and can serve as a starting point for the derivation of asymptotic approximations for these estimators as the concentration parameter goes to infinity, while the sample size either stays fixed or also goes to infinity.     

Testing the assumptions behind importance sampling

Importance sampling is used in many areas of modern econometrics to approximate unsolvable integrals. Its reliable use requires the sampler to possess a variance, for this guarantees a square root speed of convergence and asymptotic normality of the estimator of the integral. However, this assumption is seldom checked. In this paper we use extreme value theory to empirically assess the appropriateness of this assumption. Our main application is the stochastic volatility model, where importance sampling is commonly used for maximum likelihood estimation of the parameters of the model.     

Some identification and estimation results for regression models with stochastically varying coefficients

Although various theoretical and applied papers have appeared in recent years concerned with the estimation and use of regression models with stochastically varying coefficients, little is available in the literature on the properties of the proposed estimators or the identifiability of the parameters of such models. The present paper derives sufficient conditions under which the maximum likelihood estimator is consistent and asymptotically normal and also provides sufficient conditions for the estimation of regression models with stationary stochastically varying coefficients. In many instances these requirements are found to have simple, intuitively appealing interpretations. Consistency and asymptotic normality is also proven for a two-step estimator and a method suggested by Rosenberg for generating initial estimates.     

Beta spatial linear mixed model with variable dispersion using Monte Carlo maximum likelihood

We propose a beta spatial linear mixed model with variable dispersion using Monte Carlo maximum likelihood. The proposed method is useful for those situations where the response variable is a rate or a proportion. An approach to the spatial generalized linear mixed models using the Box–Cox transformation in the precision model is presented. Thus, the parameter optimization process is developed for both the spatial mean model and the spatial variable dispersion model. All the parameters are estimated using Markov chain Monte Carlo maximum likelihood. Statistical inference over the parameters is performed using approximations obtained from the asymptotic normality of the maximum likelihood estimator. Diagnosis and prediction of a new observation are also developed. The method is illustrated with the analysis of one simulated case and two studies: clay and magnesium contents. In the clay study, 147 soil profile observations were taken from the research area of the Tropenbos Cameroon Programme, with explanatory variables: elevation in metres above sea level, agro‐ecological zone, reference soil group and land cover type. In the magnesium content, the soil samples were taken from 0‐ to 20‐cm‐depth layer at each of the 178 locations, and the response variable is related to the spatial locations, altitude and sub‐region.     

A comparison of the Box-Cox maximum likelihood estimator and the non-linear two-stage least squares estimator

This paper investigates the limiting behaviour of the ‘maximum likelihood estimator’(MLE) based on normality, as well as the nonlinear two-stage least squares estimator (NL2S), for the i.i.d. and regression models in which the Box-Cox transformation is applied to the dependent variable. Since the transformed variable cannot in general be normally distributed, the untransformed variable is assumed to have a two-parameter gamma distribution. Tables of probability limits and asymptotic variance demonstrate that, in this case, the inconsistency of the ‘normal MLE’ is often quite pronounced, while the NL2S is consistent and typically well behaved.     

Estimation of P[Y < X] for generalized exponential distribution

This paper deals with the estimation of P[Y < X] when X and Y are two independent generalized exponential distributions with different shape parameters but having the same scale parameters. The maximum likelihood estimator and its asymptotic distribution is obtained. The asymptotic distribution is used to construct an asymptotic confidence interval of P[Y < X]. Assuming that the common scale parameter is known, the maximum likelihood estimator, uniformly minimum variance unbiased estimator and Bayes estimator of P[Y < X] are obtained. Different confidence intervals are proposed. Monte Carlo simulations are performed to compare the different proposed methods. Analysis of a simulated data set has also been presented for illustrative purposes.Part of the work was supported by a grant from the Natural Sciences and Engineering Research Council     

Estimators for the common principal components model based on reweighting: influence functions and Monte Carlo study

The common principal components model for several groups of multivariate observations is a useful parsimonious model for the scatter structure which assumes equal principal axes but different variances along those axes for each group. Due to the lack of resistance of the classical maximum likelihood estimators for the parameters of this model, several robust estimators have been proposed in the literature: plug-in estimators and projection-pursuit (PP) type estimators. In this paper, we show that it is possible to improve the low efficiency of the projection-pursuit estimators by applying a reweighting step. More precisely, we consider plug-in estimators obtained by plugging a reweighted estimator of the scatter matrices into the maximum likelihood equations defining the principal axes. The weights considered penalize observations with large values of the influence measures defined by Boente et al. (2002). The new estimators are studied in terms of theoretical properties (influence functions and asymptotic variances) and are compared with other existing estimators in a simulation study.     

Relevance weighted likelihood for dependent data

The relevance-weighted likelihood function weights individual contributions to the likelihood according to their relevance for the inferential problem of interest. Consistency and asymptotic normality of the weighted maximum likelihood estimator were previously proved for independent sequences of random variables. We extend these results to apply to dependent sequences, and, in so doing, provide a unified approach to a number of diverse problems in dependent data. In particular, we provide a heretofore unknown approach for dealing with heterogeneity in adaptive designs, and unify the smoothing approach that appears in many foundational papers for independent data. Applications are given in clinical trials, psychophysics experiments, time series models, transition models, and nonparametric regression. Received: April 2000     

Almost unbiased estimation in multiplicative models

In the lognormal linear models the estimation of constant term presents problems. In this paper we use weighted jackknife procedure (suggested by Hinkley 1977) for reducing the bias of the maximum likelihood estimator. The resulting estimator is unbiased upto order (1/T),T being the number of observations, and has the same MSE as that of the MLE to the same order of approximation; moreover, being the jackknife estimator it enjoys all the desirable large sample properties like any other jackknife estimator. The research of this author is partially supported through a research grant from NSERC of Canada.     

Asymptotic normality for estimator of conditional mode under left-truncated and dependent observations

In this paper, we establish asymptotic normality of a new kernel estimator of the conditional mode function introduced by Ould-Saïd and Tatachak (C R Acad Sci Paris Ser I 344:651–656, 2007) for the left-truncation model when the data exhibit some kind of dependence. It is assumed that the lifetime observations with multivariate covariates form a stationary α-mixing sequence.     

Estimating dynamic panel data discrete choice models with fixed effects

This paper considers the estimation of dynamic binary choice panel data models with fixed effects. It is shown that the modified maximum likelihood estimator (MMLE) used in this paper reduces the order of the bias in the maximum likelihood estimator from O(T^-1) to O(T^-2), without increasing the asymptotic variance. No orthogonal reparametrization is needed. Monte Carlo simulations are used to evaluate its performance in finite samples where T is not large. In probit and logit models containing lags of the endogenous variable and exogenous variables, the estimator is found to have a small bias in a panel with eight periods. A distinctive advantage of the MMLE is its general applicability. Estimation and relevance of different policy parameters of interest in this kind of models are also addressed.     

Optimal estimation under nonstandard conditions

We analyze optimality properties of maximum likelihood (ML) and other estimators when the problem does not necessarily fall within the locally asymptotically normal (LAN) class, therefore covering cases that are excluded from conventional LAN theory such as unit root nonstationary time series. The classical Hájek–Le Cam optimality theory is adapted to cover this situation. We show that the expectation of certain monotone “bowl-shaped” functions of the squared estimation error are minimized by the ML estimator in locally asymptotically quadratic situations, which often occur in nonstationary time series analysis when the LAN property fails. Moreover, we demonstrate a direct connection between the (Bayesian property of) asymptotic normality of the posterior and the classical optimality properties of ML estimators.