Approximate maximum likelihood estimation with data sets that exceed computer limits

A large number of observations is a delight for theoretical econometricians and statisticians. In practice, numerous observations can be a headache when the number exceeds computer limits. This paper provides a practical method of using all the observations regardless of computer core constraints. And, turning necessity to benefit, shows how the method can be used to determine the reliability of the norm approximation to the distribution of the estimator.     

On maximum likelihood estimation of stochastic frontier production models

The iterative algorithm suggested by Greene (1982) for the estimation of stochastic frontier production models does not necessarily solve the likelihood equations. Corrected iterative algorithms which generalize Fair's method (1977) and solve the likelihood equations are derived. These algorithms are compared with the Newton method in an empirical case. The Newton method is more time saving than these algorithms.     

Maximum likelihood and restricted maximum likelihood estimation for a class of Gaussian Markov random fields

This work describes a Gaussian Markov random field model that includes several previously proposed models, and studies properties of its maximum likelihood (ML) and restricted maximum likelihood (REML) estimators in a special case. Specifically, for models where a particular relation holds between the regression and precision matrices of the model, we provide sufficient conditions for existence and uniqueness of ML and REML estimators of the covariance parameters, and provide a straightforward way to compute them. It is found that the ML estimator always exists while the REML estimator may not exist with positive probability. A numerical comparison suggests that for this model ML estimators of covariance parameters have, overall, better frequentist properties than REML estimators.     

Maximum likelihood estimation of random effects models

Iterated GLS has a remarkable property when applied to the random effects model in its usual parameterization. The values for the parameter that measures relative variance, obtained through successive iterations, form a monotonic sequence. This property provides convenient checks for multiple maxima of the likelihood function and for existence of a local maximum that satisfies the non-negativity condition.     

On the existence of maximum likelihood estimates in random effects models for clustered multivariate binary data

We consider a class of random effects models for clustered multivariate binary data based on the threshold crossing technique of a latent random vector. Components of this latent vector are assumed to have a Laird–Ware structure. However, in place of their Gaussian assumptions, any specified class of multivariate distribution is allowed for the random effects, and the error vector is allowed to have any strictly positive pdf. A well known member of this class of models is the multivariate probit model with random effects. We investigate sufficient and necessary conditions for the existence of maximum likelihood estimates for the location and the association parameters. Implications of our results are illustrated through some hypothetical examples.     

Maximum likelihood estimation of limited and discrete dependent variable models with nested random effects

Gauss–Hermite quadrature is often used to evaluate and maximize the likelihood for random component probit models. Unfortunately, the estimates are biased for large cluster sizes and/or intraclass correlations. We show that adaptive quadrature largely overcomes these problems. We then extend the adaptive quadrature approach to general random coefficient models with limited and discrete dependent variables. The models can include several nested random effects (intercepts and coefficients) representing unobserved heterogeneity at different levels of a hierarchical dataset. The required multivariate integrals are evaluated efficiently using spherical quadrature rules. Simulations show that adaptive quadrature performs well in a wide range of situations.     

First difference maximum likelihood and dynamic panel estimation

First difference maximum likelihood (FDML) seems an attractive estimation methodology in dynamic panel data modeling because differencing eliminates fixed effects and, in the case of a unit root, differencing transforms the data to stationarity, thereby addressing both incidental parameter problems and the possible effects of nonstationarity. This paper draws attention to certain pathologies that arise in the use of FDML that have gone unnoticed in the literature and that affect both finite sample performance and asymptotics. FDML uses the Gaussian likelihood function for first differenced data and parameter estimation is based on the whole domain over which the log-likelihood is defined. However, extending the domain of the likelihood beyond the stationary region has certain consequences that have a major effect on finite sample and asymptotic performance. First, the extended likelihood is not the true likelihood even in the Gaussian case and it has a finite upper bound of definition. Second, it is often bimodal, and one of its peaks can be so peculiar that numerical maximization of the extended likelihood frequently fails to locate the global maximum. As a result of these pathologies, the FDML estimator is a restricted estimator, numerical implementation is not straightforward and asymptotics are hard to derive in cases where the peculiarity occurs with non-negligible probabilities. The peculiarities in the likelihood are found to be particularly marked in time series with a unit root. In this case, the asymptotic distribution of the FDMLE has bounded support and its density is infinite at the upper bound when the time series sample size T→∞$T\to \infty$. As the panel width n→∞$n\to \infty$ the pathology is removed and the limit theory is normal. This result applies even for T$T$ fixed and we present an expression for the asymptotic distribution which does not depend on the time dimension. We also show how this limit theory depends on the form of the extended likelihood.     

Complete sufficiency and maximum likelihood estimation for the two-parameter negative binomial distribution

The difficult estimation problem associated with the two-parameter negative binomial distribution is discussed. The order statistic is shown to be minimal sufficient but not complete. It is proven that there is at least one maximum likelihood estimator of the parameterk when the second sample moment is greater than the sample mean. Contours and three-dimensional graphs of the natural logarithm of the likelihood function provide further insight into the estimation problem.     

Pseudo maximum likelihood estimation of spatial autoregressive models with increasing dimension

Pseudo maximum likelihood estimates are developed for higher-order spatial autoregressive models with increasingly many parameters, including models with spatial lags in the dependent variables both with and without a linear or nonlinear regression component, and regression models with spatial autoregressive disturbances. Consistency and asymptotic normality of the estimates are established. Monte Carlo experiments examine finite-sample behaviour.     

On generalized maximum likelihood estimation in the proportional hazards model with partially informative censoring

The generalized maximum likelihood estimator (GMLE) is derived and some of its variants are compared with the partial Abdushukurov-Cheng-Lin (PACL) and Kaplan-Meier (KM) estimators under the proportional hazards model with partially informative censoring. A comparison of small sample properties is conducted based on a simulation study. The results show that the GMLEs perform competitively with the PACL estimator.Acknowledgements.The authors are very much thankful to the referee for perceptive and illuminating comments. A substantial credit goes to the referee for an overall improvement of the paper.     

Nonparametric maximum likelihood estimation in a non locally compact setting

Maximum likelihood estimation is considered in the context of infinite dimensional parameter spaces. It is shown that in some locally convex parameter spaces sequential compactness of the bounded sets ensures the existence of minimizers of objective functions and the consistency of maximum likelihood estimators in an appropriate topology. The theory is applied to revisit some classical problems of nonparametric maximum likelihood estimation, to study location parameters in Banach spaces, and finally to obtain Varadarajan’s theorem on the convergence of empirical measures in the form of a consistency result for a sequence of maximum likelihood estimators. Several parameter spaces sharing the crucial compactness property are identified. This research was supported by grants from the National Sciences and Engineering Research Council of Canada and the Fonds FCAR de la Province de Québec.     

Parameter estimation for the drift of a time inhomogeneous jump diffusion process

This work deals with parameter estimation for the drift of jump diffusion processes which are driven by a Lévy process and whose drift term is linear in the parameter. In contrast to the commonly used maximum likelihood estimator, our proposed estimator has the practical advantage that its calculation does not require the evaluation of the continuous part of the sample path. In the important case of an Ornstein‐Uhlenbeck‐type jump diffusion, which is a widely used model, we prove consistency and asymptotic normality.     

Semiparametric maximum likelihood estimation in Cox proportional hazards model with covariate measurement errors

This paper studies semiparametric maximum likelihood estimators in the Cox proportional hazards model with covariate error, assuming that the conditional distribution of the true covariate given the surrogate is known. We show that the estimator of the regression coefficient is asymptotically normal and efficient, its covariance matrix can be estimated consistently by differentiation of the profile likelihood, and the likelihood ratio test is asymptotically chi-squared. We also provide efficient algorithms for the computations of the semiparametric maximum likelihood estimate and the profile likelihood. The performance of this method is successfully demonstrated in simulation studies.     

Maximum likelihood estimation of stochastic frontier models by the Fourier transform

The paper is concerned with several kinds of stochastic frontier models whose likelihood function is not available in closed form. First, with output-oriented stochastic frontier models whose one-sided errors have a distribution other than the standard ones (exponential or half-normal). The gamma and beta distributions are leading examples. Second, with input-oriented stochastic frontier models which are common in theoretical discussions but not in econometric applications. Third, with two-tiered stochastic frontier models when the one-sided error components follow gamma distributions. Fourth, with latent class models with gamma distributed one-sided error terms. Fifth, with models whose two-sided error component is distributed as stable Paretian and the one-sided error is gamma. The principal aim is to propose approximations to the density of the composed error based on the inversion of the characteristic function (which turns out to be manageable) using the Fourier transform. Procedures that are based on the asymptotic normal form of the log-likelihood function and have arbitrary degrees of asymptotic efficiency are also proposed, implemented and evaluated in connection with output-oriented stochastic frontiers. The new methods are illustrated using data for US commercial banks, electric utilities, and a sample from the National Youth Longitudinal Survey.     

Pseudo conditional maximum likelihood estimation of the dynamic logit model for binary panel data

We show how the dynamic logit model for binary panel data may be approximated by a quadratic exponential model. Under the approximating model, simple sufficient statistics exist for the subject-specific parameters introduced to capture the unobserved heterogeneity between subjects. The latter must be distinguished from the state dependence which is accounted for by including the lagged response variable among the regressors. By conditioning on the sufficient statistics, we derive a pseudo conditional likelihood estimator of the structural parameters of the dynamic logit model, which is simple to compute. Asymptotic properties of this estimator are studied in detail. Simulation results show that the estimator is competitive in terms of efficiency with estimators recently proposed in the econometric literature.     

Pseudo-maximum likelihood estimation in two classes of semiparametric diffusion models

Two classes of semiparametric diffusion models are considered, where either the drift or the diffusion term is parameterized, while the other term is left unspecified. We propose a pseudo-maximum likelihood estimator (PMLE) of the parametric component that maximizes the likelihood with a preliminary estimator of the unspecified term plugged in. It is demonstrated how models and estimators can be used in a two-step specification testing strategy of semiparametric and fully parametric models, and shown that approximate/simulated versions of the PMLE inherit the properties of the actual but infeasible estimator. A simulation study investigates the finite sample performance of the PMLE.     

A note on multinomial maximum likelihood estimation under ordered restrictions and the EM algorithm

A frequently occurring problem is to find the maximum likelihood estimation (MLE) of p subject to p∈C (C⊂ P the probability vectors in R ^k ). The problem has been discussed by many authors and they mainly focused when p is restricted by linear constraints or log-linear constraints. In this paper, we construct the relationship between the the maximum likelihood estimation of p restricted by p∈C and EM algorithm and demonstrate that the maximum likelihood estimator can be computed through the EM algorithm (Dempster et al. in J R Stat Soc Ser B 39:1–38, 1997). Several examples are analyzed by the proposed method.     

Consistency and asymptotic normality of maximum likelihood estimation for Gaussian Markov processes from discrete observations

In this paper we prove the weak consistency and the asymptotic normality of the maximum likelihood estimation based on discrete observations ofn independent Gaussian Markov processes. The Ornstein Uhlenbeck process is a special Gaussian Markov process. We derive asymptotic simultaneous confidence regions for the parameters of the Ornstein Uhlenbeck process as an application.     

A stationary point for the stochastic frontier likelihood

The likelihood function for the stochastic frontier model is shown to possess an unusual stationary point which may or may not be a maximum. A condition is given to determine if the point is a maximum, and the result is interpreted in the context of specification and estimation.     

Approximate analytic solution for Asian options with stochastic volatility

The valuation of Asian options is complicated because the arithmetic average of lognormal random variables is no longer lognormal. Furthermore, the stochastic volatility inherent in financial asset prices is easily observed. However, few academic studies consider the pricing and hedging of Asian options with stochastic volatility, despite the popularity of such options. This study extends the work of Hull and White (1987) and integrates the Taylor series expansion technique to derive an approximate analytic solution for Asian options with stochastic volatility. Numerical experiments show that the proposed approximate analytic solution performs favorably and is computationally efficient compared with large-sample simulations. The approximate analytic solution provides a practical approach for pricing and hedging Asian options with stochastic volatility and is both easy to implement and desirable in terms of computing speed.