Estimation procedures for a family of density functions representing various life-testing models

A family of density functions is considered which contains several life-testing models as specific cases. Uniformly minimum variance unbiased estimators are obtained for the positive and negative powers of the parameter, moments and reliability function. These general results provide the estimators for the specific models.     

Estimation of spatial autoregressive panel data models with fixed effects

This paper establishes asymptotic properties of quasi-maximum likelihood estimators for SAR panel data models with fixed effects and SAR disturbances. A direct approach is to estimate all the parameters including the fixed effects. Because of the incidental parameter problem, some parameter estimators may be inconsistent or their distributions are not properly centered. We propose an alternative estimation method based on transformation which yields consistent estimators with properly centered distributions. For the model with individual effects only, the direct approach does not yield a consistent estimator of the variance parameter unless T is large, but the estimators for other common parameters are the same as those of the transformation approach. We also consider the estimation of the model with both individual and time effects.     

Estimation strategies for the regression coefficient parameter matrix in multivariate multiple regression

We consider improved estimation strategies for the parameter matrix in multivariate multiple regression under a general and natural linear constraint. In the context of two competing models where one model includes all predictors and the other restricts variable coefficients to a candidate linear subspace based on prior information, there is a need of combining two estimation techniques in an optimal way. In this scenario, we suggest some shrinkage estimators for the targeted parameter matrix. Also, we examine the relative performances of the suggested estimators in the direction of the subspace and candidate subspace restricted type estimators. We develop a large sample theory for the estimators including derivation of asymptotic bias and asymptotic distributional risk of the suggested estimators. Furthermore, we conduct Monte Carlo simulation studies to appraise the relative performance of the suggested estimators with the classical estimators. The methods are also applied on a real data set for illustrative purposes.     

Semiparametric regression models and sensitivity analysis of longitudinal data with nonrandom dropouts

We propose a family of regression models to adjust for nonrandom dropouts in the analysis of longitudinal outcomes with fully observed covariates. The approach conceptually focuses on generalized linear models with random effects. A novel formulation of a shared random effects model is presented and shown to provide a dropout selection parameter with a meaningful interpretation. The proposed semiparametric and parametric models are made part of a sensitivity analysis to delineate the range of inferences consistent with observed data. Concerns about model identifiability are addressed by fixing some model parameters to construct functional estimators that are used as the basis of a global sensitivity test for parameter contrasts. Our simulation studies demonstrate a large reduction of bias for the semiparametric model relatively to the parametric model at times where the dropout rate is high or the dropout model is misspecified. The methodology's practical utility is illustrated in a data analysis.     

Estimation of copula-based semiparametric time series models

This paper studies the estimation of a class of copula-based semiparametric stationary Markov models. These models are characterized by nonparametric marginal distributions and parametric copula functions, while the copulas capture all the scale-free temporal dependence of the processes. Simple estimators of the marginal distribution and the copula parameter are provided, and their asymptotic properties are established under easily verifiable conditions. These results are used to obtain root-n consistent and asymptotically normal estimators of important features of the transition distribution such as the (nonlinear) conditional moments and conditional quantiles. The semiparametric conditional quantile estimators are automatically monotonic across quantiles, which is attractive for portfolio conditional value-at-risk calculations.     

Estimation of linear models with nequal restrictions

Inequality constrained regression involves the notion of a truncated parameter space, which was studied extensively by Moors (1985). His general results are extended here and applied to linear models. Using the invariance principle, for every observation x a set V_x is defined with the property that estimators taking values in V_x (with positive probability) are inadmissible. One of the main conclusions is that the usual estimators in inequality constrained regression are inadmissible; a method to obtain better estimators is indicated.     

Examining bias in estimators of linear rational expectations models under misspecification

Most rational expectations models involve equations in which the dependent variable is a function of its lags and its expected future value. We investigate the asymptotic bias of generalized method of moment (GMM) and maximum likelihood (ML) estimators in such models under misspecification. We consider several misspecifications, and focus more specifically on the case of omitted dynamics in the dependent variable. In a stylized DGP, we derive analytically the asymptotic biases of these estimators. We establish that in many cases of interest the two estimators of the degree of forward-lookingness are asymptotically biased in opposite direction with respect to the true value of the parameter. We also propose a quasi-Hausman test of misspecification based on the difference between the GMM and ML estimators. Using Monte-Carlo simulations, we show that the ordering and direction of the estimators still hold in a more realistic New Keynesian macroeconomic model. In this set-up, misspecification is in general found to be more harmful to GMM than to ML estimators.     

Methods for computing marginal data densities from the Gibbs output

We introduce two estimators for estimating the Marginal Data Density (MDD) from the Gibbs output. Our methods are based on exploiting the analytical tractability condition, which requires that some parameter blocks can be analytically integrated out from the conditional posterior densities. This condition is satisfied by several widely used time series models. An empirical application to six-variate VAR models shows that the bias of a fully computational estimator is sufficiently large to distort the implied model rankings. One of the estimators is fast enough to make multiple computations of MDDs in densely parameterized models feasible.     

The second-order bias and mean squared error of estimators in time-series models

We develop analytical results on the second-order bias and mean squared error of estimators in time-series models. These results provide a unified approach to developing the properties of a large class of estimators in linear and nonlinear time-series models and they are valid for both normal and nonnormal samples of observations, and where the regressors are stochastic. The estimators included are the generalized method of moments, maximum likelihood, least squares, and other extremum estimators. Our general results are applied to four time-series models. We investigate the effects of nonnormality on the second-order bias results for two of these models, while for all four models, the second-order bias and mean squared error results are given under normality. Numerical results for some of these models are also presented.     

On MLEs in an extended multivariate linear growth curve model

In this paper the extended growth curve model is considered. The literature comprises two versions of the model. These models can be connected by one-to-one reparameterizations but since estimators are non-linear it is not obvious how to transmit properties of estimators from one model to another. Since it is only for one of the models where detailed knowledge concerning estimators is available (Kollo and von Rosen, Advanced multivariate statistics with matrices. Springer, Dordrecht, 2005) the object in this paper is therefore to present uniqueness properties and moment relations for the estimators of the second model. One aim of the paper is also to complete the results for the model presented in Kollo and von Rosen (Advanced multivariate statistics with matrices. Springer, Dordrecht, 2005). The presented proofs of uniqueness for linear combinations of estimators are valid for both models and are simplifications of proofs given in Kollo and von Rosen (Advanced multivariate statistics with matrices. Springer, Dordrecht, 2005).     

Model reference adaptive systems applied to regression analyses

The adaptive estimation procedure of model reference adaptive systems is modified and applied to linear models. In general the principle can be used for almost any time series model. Because of the recursive nature of the resulting estimator, it is computationally appealing, especially when a time series is considered as a flow of data. In addition, the estimator turns out to have certain statistical optimality properties.
In the linear regression setting, Ridge estimators turn out to constitute a subclass of the adaptive estimators considered, whereas for unknown measurement variance, the resulting estimators are related to J ames -S tkin type estimators, and have better properties than the latter. The estimator is shown to be strongly consistent and to converge in law to a normal variate under the standard assumptions of linear models. Further it is shown to be admissible and minimax in restricted parameter spaces. The connection between K alman filters and the classical least-squares estimator is also pointed out.     

Shrinkage estimation of the proportion in randomized response

This article considers the asymptotic estimation theory for the proportion in randomized response survey usinguncertain prior information (UPI) about the true proportion parameter which is assumed to be available on the basis of some sort of realistic conjecture. Three estimators, namely, the unrestricted estimator, the shrinkage restricted estimator and an estimator based on a preliminary test, are proposed. Their asymptotic mean squared errors are derived and compared. The relative dominance picture of the estimators is presented.     

Approximate inference in multivariate nonlinear functional relationships

An estimation procedure based on estimating equations is presented for the parameters in a multivariate functional relationship model, where all observations are subject to error. The covariance matrix of the observational errors may be parametrized and is allowed to be different for different sets of observations. Estimators are defined for the unknown relation parameters and error parameters.
For linear models (i.e. where the model function is linear in the incidental parameters) the estimators are consistent and asymptotically normal. A consistent expression for the covariance matrix of the estimators is derived. The results are valid for general error distributions.
For nonlinear models the estimators are based on locally linear approximations to the model function. The afore mentioned properties of the estimators are now only approximately valid. The adequacy of the approximate inference, based on asymptotic theory for the linearized model, needs at least informal check. Some examples are given to illustrate the estimation procedure.     

Asymptotic theory for heterogeneous dynamic pseudo-panels

Dynamic pseudo-panel models with inter-cohort parameter heterogeneity are studied. The population is divided into cohorts and the cohort sample means are used as a heterogeneous panel. Least squares and instrumental variables estimators are considered. Multidimensional limits are analyzed as the cross-sectional and temporal dimensions of the data pass to infinity, allowing for both stationary and nonstationary cases. Monte-Carlo simulations on the finite-sample performance of the estimators in these two dimensions are conducted and these, in conjunction with the asymptotic results, are used to make recommendations for practical implementation of the techniques. An empirical illustration finds heterogeneity in consumption growth rates among Taiwanese birth cohorts.     

Conditional empirical likelihood estimation and inference for quantile regression models

This paper considers two empirical likelihood-based estimation, inference, and specification testing methods for quantile regression models. First, we apply the method of conditional empirical likelihood (CEL) by Kitamura et al. [2004. Empirical likelihood-based inference in conditional moment restriction models. Econometrica 72, 1667–1714] and Zhang and Gijbels [2003. Sieve empirical likelihood and extensions of the generalized least squares. Scandinavian Journal of Statistics 30, 1–24] to quantile regression models. Second, to avoid practical problems of the CEL method induced by the discontinuity in parameters of CEL, we propose a smoothed counterpart of CEL, called smoothed conditional empirical likelihood (SCEL). We derive asymptotic properties of the CEL and SCEL estimators, parameter hypothesis tests, and model specification tests. Important features are (i) the CEL and SCEL estimators are asymptotically efficient and do not require preliminary weight estimation; (ii) by inverting the CEL and SCEL ratio parameter hypothesis tests, asymptotically valid confidence intervals can be obtained without estimating the asymptotic variances of the estimators; and (iii) in contrast to CEL, the SCEL method can be implemented by some standard Newton-type optimization. Simulation results demonstrate that the SCEL method in particular compares favorably with existing alternatives.     

Semiparametric quantile regression estimation in dynamic models with partially varying coefficients

We study quantile regression estimation for dynamic models with partially varying coefficients so that the values of some coefficients may be functions of informative covariates. Estimation of both parametric and nonparametric functional coefficients are proposed. In particular, we propose a three stage semiparametric procedure. Both consistency and asymptotic normality of the proposed estimators are derived. We demonstrate that the parametric estimators are root-n$n$ consistent and the estimation of the functional coefficients is oracle. In addition, efficiency of parameter estimation is discussed and a simple efficient estimator is proposed. A simple and easily implemented test for the hypothesis of a varying-coefficient is proposed. A Monte Carlo experiment is conducted to evaluate the performance of the proposed estimators.     

Logarithmic calibration for multiplicative distortion measurement errors regression models

In this article, we propose a new identifiability condition by using the logarithmic calibration for the distortion measurement error models, where neither the response variable nor the covariates can be directly observed but are measured with multiplicative measurement errors. Under the logarithmic calibration, the direct-plug-in estimators of parameters and empirical likelihood based confidence intervals are proposed, and we studied the asymptotic properties of the proposed estimators. For the hypothesis testing of parameter, a restricted estimator under the null hypothesis and a test statistic are proposed. The asymptotic properties for the restricted estimator and test statistic are established. Simulation studies demonstrate the performance of the proposed procedure and a real example is analyzed to illustrate its practical usage.     

Exponentially tilted likelihood inference on growing dimensional unconditional moment models

Growing-dimensional data with likelihood function unavailable are often encountered in various fields. This paper presents a penalized exponentially tilted (PET) likelihood for variable selection and parameter estimation for growing dimensional unconditional moment models in the presence of correlation among variables and model misspecification. Under some regularity conditions, we investigate the consistent and oracle properties of the PET estimators of parameters, and show that the constrained PET likelihood ratio statistic for testing contrast hypothesis asymptotically follows the chi-squared distribution. Theoretical results reveal that the PET likelihood approach is robust to model misspecification. We study high-order asymptotic properties of the proposed PET estimators. Simulation studies are conducted to investigate the finite performance of the proposed methodologies. An example from the Boston Housing Study is illustrated.     

Breakdown concepts for contingency tables

Loglinear Poisson models are commonly used to analyse contingency tables. So far, robustness of parameter estimators as well as outlier detection have rarely been treated in this context. We start with finite-sample breakdown points. We yield that the breakdown point of mean value estimators determines a lower bound for a masking breakdown point of a class of one-step outlier identification rules. Within a more refined breakdown approach, which takes account of the structure of the contingency table, a stochastic breakdown function is defined. It returns the probability that a given proportion of outliers is randomly placed at such a pattern, where breakdown is possible. Finally, the introduced breakdown concepts are applied to characterise the maximum likelihood estimator and a median-polish estimator.     

Asymptotic comparison at optimal levels of reduced‐bias extreme value index estimators

In this article we are interested in the asymptotic comparison, at optimal levels, of a set of semi‐parametric reduced‐bias extreme value (EV) index estimators, valid for a wide class of heavy‐tailed models, underlying the available data. Again, as in the classical case, there is not any estimator that can always dominate the alternatives, but interesting clear‐cut patterns are found. Consequently, and in practice, a suitable choice of a set of EV index estimators will jointly enable us to better estimate the EV index γ, the primary parameter of extreme events.