Asymptotic distribution of the cointegrating vector estimator in error correction models with conditional heteroskedasticity

This paper explores the asymptotic distribution of the cointegrating vector estimator in error correction models with conditionally heteroskedastic errors. Asymptotic properties of the maximum likelihood estimator (MLE) of the cointegrating vector, which estimates the cointegrating vector and the multivariate GARCH process jointly, are provided. The MLE of the cointegrating vector follows mixture normal, and its asymptotic distribution depends on the conditional heteroskedasticity and the kurtosis of standardized innovations. The reduced rank regression (RRR) estimator and the regression-based cointegrating vector estimators do not consider conditional heteroskedasticity, and thus the efficiency gain of the MLE emerges as the magnitude of conditional heteroskedasticity increases. The simulation results indicate that the relative power of the t-statistics based on the MLE improves significantly as the GARCH effect increases.     

A general asymptotic theory for time-series models

This paper develops a general asymptotic theory for the estimation of strictly stationary and ergodic time–series models. Under simple conditions that are straightforward to check, we establish the strong consistency, the rate of strong convergence and the asymptotic normality of a general class of estimators that includes LSE, MLE and some M-type estimators. As an application, we verify the assumptions for the long-memory fractional ARIMA model. Other examples include the GARCH(1,1) model, random coefficient AR(1) model and the threshold MA(1) model.     

Exact inference for progressively Type-I censored exponential failure data

For reasons of time constraint and cost reduction, censoring is commonly employed in practice, especially in reliability engineering. Among various censoring schemes, progressive Type-I right censoring provides not only the practical advantage of known termination time but also greater flexibility to the experimenter in the design stage by allowing for the removal of test units at non-terminal time points. In this article, we consider a progressively Type-I censored life-test under the assumption that the lifetime of each test unit is exponentially distributed. For small to moderate sample sizes, a practical modification is proposed to the censoring scheme in order to guarantee a feasible life-test under progressive Type-I censoring. Under this setup, we obtain the maximum likelihood estimator (MLE) of the unknown mean parameter and derive the exact sampling distribution of the MLE under the condition that its existence is ensured. Using the exact distribution of the MLE as well as its asymptotic distribution and the parametric bootstrap method, we then discuss the construction of confidence intervals for the mean parameter and their performance is assessed through Monte Carlo simulations. Finally, an example is presented in order to illustrate all the methods of inference discussed here.     

Spatial correlation robust inference with errors in location or distance

This paper presents results from a Monte Carlo study concerning inference with spatially dependent data. We investigate the impact of location/distance measurement errors upon the accuracy of parametric and nonparametric estimators of asymptotic variances. Nonparametric estimators are quite robust to such errors, method of moments estimators perform surprisingly well, and MLE estimators are very poor. We also present and evaluate a specification test based on a parametric bootstrap that has good power properties for the types of measurement error we consider.     

Estimation of nonlinear models with mismeasured regressors using marginal information

We consider the estimation of nonlinear models with mismeasured explanatory variables, when information on the marginal distribution of the true values of these variables is available. We derive a semi‐parametric MLE that is shown to be $\sqrt{n}$ consistent and asymptotically normally distributed. In a simulation experiment we find that the finite sample distribution of the estimator is close to the asymptotic approximation. The semi‐parametric MLE is applied to a duration model for AFDC welfare spells with misreported welfare benefits. The marginal distribution of the correctly measured welfare benefits is obtained from an administrative source. Copyright © 2010 John Wiley & Sons, Ltd.     

Closed-form likelihood approximation and estimation of jump-diffusions with an application to the realignment risk of the Chinese Yuan

This paper provides closed-form likelihood approximations for multivariate jump-diffusion processes widely used in finance. For a fixed order of approximation, the maximum-likelihood estimator (MLE) computed from this approximate likelihood achieves the asymptotic efficiency of the true yet uncomputable MLE as the sampling interval shrinks. This method is used to uncover the realignment probability of the Chinese Yuan. Since February 2002, the market-implied realignment intensity has increased fivefold. The term structure of the forward realignment rate, which completely characterizes future realignment probabilities, is hump-shaped and peaks at mid-2004. The realignment probability responds quickly to economic news releases and government interventions.     

A comparison of the Box-Cox maximum likelihood estimator and the non-linear two-stage least squares estimator

This paper investigates the limiting behaviour of the ‘maximum likelihood estimator’(MLE) based on normality, as well as the nonlinear two-stage least squares estimator (NL2S), for the i.i.d. and regression models in which the Box-Cox transformation is applied to the dependent variable. Since the transformed variable cannot in general be normally distributed, the untransformed variable is assumed to have a two-parameter gamma distribution. Tables of probability limits and asymptotic variance demonstrate that, in this case, the inconsistency of the ‘normal MLE’ is often quite pronounced, while the NL2S is consistent and typically well behaved.     

Specification testing when score test statistics are identically zero

We investigate the problem of specification testing when the score vector evaluated at the restricted MLE is identically zero. Several econometric examples are provided. A general test procedure which generalizes the geometric principle of the score test is proposed. The Wald and the likelihood ratio tests are also analyzed. Even under such irregularities, the usual asymptotic distribution of the likelihood ratio statistics is still valid. However, the Wald-type statistics need to be modified. The generalized score, the likelihood ratio and the modified Wald tests are shown to be asymptotically equivalent. The asymptotic efficiency of the tests is derived.     

Uncertainty Estimation for Pseudo‐Bayesian Inference Under Complex Sampling

Social and economic studies are often implemented as complex survey designs. For example, multistage, unequal probability sampling designs utilised by federal statistical agencies are typically constructed to maximise the efficiency of the target domain level estimator (e.g. indexed by geographic area) within cost constraints for survey administration. Such designs may induce dependence between the sampled units; for example, with employment of a sampling step that selects geographically indexed clusters of units. A sampling‐weighted pseudo‐posterior distribution may be used to estimate the population model on the observed sample. The dependence induced between coclustered units inflates the scale of the resulting pseudo‐posterior covariance matrix that has been shown to induce under coverage of the credibility sets. By bridging results across Bayesian model misspecification and survey sampling, we demonstrate that the scale and shape of the asymptotic distributions are different between each of the pseudo‐maximum likelihood estimate (MLE), the pseudo‐posterior and the MLE under simple random sampling. Through insights from survey‐sampling variance estimation and recent advances in computational methods, we devise a correction applied as a simple and fast postprocessing step to Markov chain Monte Carlo draws of the pseudo‐posterior distribution. This adjustment projects the pseudo‐posterior covariance matrix such that the nominal coverage is approximately achieved. We make an application to the National Survey on Drug Use and Health as a motivating example and we demonstrate the efficacy of our scale and shape projection procedure on synthetic data on several common archetypes of survey designs.     

Least squares, preliminary test and Stein-type estimation in general vector AR(p) models

In the general vector autoregressive process AR ( p ), multivariate least square estimation (LSE)/maximum likelihood estimation (MLE) of a subset of the parameters is considered when the complementary subset is suspected to be redundant. This may be viewed as a special case of linear constraints of autoregressive parameters. We incorporate this nonsample information in the estimation process and propose preliminary test and Stein-type estimators for the target subset of parameters. Under local alternatives their asymptotic properties are investigated and compared with those of unrestricted and restricted LSE. The dominance picture of the estimators is presented.     

A Monte Carlo Study on the Finite Sample Properties of the Gibbs Sampling Method for a Stochastic Frontier Model

In this paper we use Monte Carlo study to investigate the finite sample properties of the Bayesian estimator obtained by the Gibbs sampler and its classical counterpart (i.e. the MLE) for a stochastic frontier model. Our Monte Carlo results show that the MSE performance of the estimates of Gibbs sampling are substantially better than that of the MLE.     

Likelihood Inference for Gibbs Processes in the Analysis of Spatial Point Patterns*

Several authors have proposed stochastic and non‐stochastic approximations to the maximum likelihood estimate (MLE) for Gibbs point processes in modelling spatial point patterns with pairwise interactions. The approximations are necessary because of the difficulty of evaluating the normalizing constant. In this paper, we first provide a review of methods which yield crude approximations to the MLE. We also review methods based on Markov chain Monte Carlo techniques for which exact MLE has become feasible. We then present a comparative simulation study of the performance of such methods of estimation based on two simulation techniques, the Gibbs sampler and the Metropolis‐Hastings algorithm, carried out for the Strauss model.     

A Bayesian-like estimator of the process capability index Cpmk

Pearn et al. (1992) proposed the capability index C_pmk, and investigated the statistical properties of its natural estimator for stable normal processes with constant mean μ. Chen and Hsu (1995) showed that under general conditions the asymptotic distribution of is normal if μ≠m, and is a linear combination of the normal and the folded-normal distributions if μ=m, where m is the mid-point between the upper and the lower specification limits. In this paper, we consider a new estimator for stable processes under a different (more realistic) condition on process mean, namely, P (μ≥m)=p, 0≤p≤1. We obtain the exact distribution, the expected value, and the variance of under normality assumption. We show that for P (μ≥m)=0, or 1, the new estimator is the MLE of C_pmk, which is asymptotically efficient. In addition, we show that under general conditions is consistent and is asymptotically unbiased. We also show that the asymptotic distribution of is a mixture of two normal distributions. RID="*" ID="*"  The research was partially supported by National Science Council of the Republic of China (NSC-89-2213-E-346-003).     

MCMC maximum likelihood for latent state models

This paper develops a pure simulation-based approach for computing maximum likelihood estimates in latent state variable models using Markov Chain Monte Carlo methods (MCMC). Our MCMC algorithm simultaneously evaluates and optimizes the likelihood function without resorting to gradient methods. The approach relies on data augmentation, with insights similar to simulated annealing and evolutionary Monte Carlo algorithms. We prove a limit theorem in the degree of data augmentation and use this to provide standard errors and convergence diagnostics. The resulting estimator inherits the sampling asymptotic properties of maximum likelihood. We demonstrate the approach on two latent state models central to financial econometrics: a stochastic volatility and a multivariate jump-diffusion models. We find that convergence to the MLE is fast, requiring only a small degree of augmentation.     

Some model-restricted shrinkage estimators for contingency tables with missing data

For contingency tables with extensive missing data, the unrestricted MLE under the saturated model, computed by the EM algorithm, is generally unsatisfactory. In this case, it may be better to fit a simpler model by imposing some restrictions on the parameter space. Perlman and Wu (1999) propose lattice conditional independence (LCI) models for contingency tables with arbitrary missing data patterns. When this LCI model fits well, the restricted MLE under the LCI model is more accurate than the unrestricted MLE under the saturated model, but not in general. Here we propose certain empirical Bayes (EB) estimators that adaptively combine the best features of the restricted and unrestricted MLEs. These EB estimators appear to be especially useful when the observed data is sparse, even in cases where the suitability of the LCI model is uncertain. We also study a restricted EM algorithm (called the ER algorithm) with similar desirable features. Received: July 1999     

Consistent likelihood-based estimation of a star-shaped distribution

We consider the classical problem of nonparametrically estimating a star-shaped distribution, i.e., a distribution function F on [0,∞) with the property that F(u)/u is nondecreasing on the set {u : F(u) < 1}. This problem is intriguing because of the fact that a well defined maximum likelihood estimator (MLE) exists, but this MLE is inconsistent. In this paper, we argue that the likelihood that is commonly used in this context is somewhat unnatural and propose another, so called ‘smoothed likelihood’. However, also the resulting MLE turns out to be inconsistent. We show that more serious smoothing of the likelihood yields consistent estimators in this model.     

Estimation and forecasting in vector autoregressive moving average models for rich datasets

We address the issue of modelling and forecasting macroeconomic variables using rich datasets by adopting the class of Vector Autoregressive Moving Average (VARMA) models. We overcome the estimation issue that arises with this class of models by implementing an iterative ordinary least squares (IOLS) estimator. We establish the consistency and asymptotic distribution of the estimator for weak and strong VARMA(p,q) models. Monte Carlo results show that IOLS is consistent and feasible for large systems, outperforming the MLE and other linear regression based efficient estimators under alternative scenarios. Our empirical application shows that VARMA models are feasible alternatives when forecasting with many predictors. We show that VARMA models outperform the AR(1), ARMA(1,1), Bayesian VAR, and factor models, considering different model dimensions.     

Likelihood-based estimation in a panel setting: Robustness,redundancy and validity of copulas

This paper considers the estimation of likelihood-based models in a panel setting. That is, we have panel data, and for each time period separately we have a correctly specified model that could be estimated by MLE. We want to allow non-independence over time. This paper shows how to improve on the QMLE. It then considers MLE based on joint distributions constructed using copulas. It discusses the efficiency gain from using the true copula, and shows that knowledge of the true copula is redundant only if the variance matrix of the relevant set of moment conditions is singular. It also discusses the question of robustness against misspecification of the copula, and proposes a test of the validity of the copula. GMM methods are argued to be useful analytically, and also for reasons of efficiency if the copula is robust but not correct.     

Asymptotic properties of MLE and UMVUE in one-parameter truncated distributions

Consider one-parameter families of continuous distributions whose range depend on an unknown parameter. In case a single sufficient and complete statistic exists, we obtain the limiting distributions of MLE and UMVUE. Both distributions are different transformations of a standard exponential variable.