On efficient estimation of the ordered response model

In this paper, we derive efficiency bounds for the ordered response model when the distribution of the errors is unknown. Furthermore, we develop an estimator that is efficient under suitable conditions. Interestingly, neither the bounds nor the estimator are trivial extensions of what has been proposed in the literature for the binary response model. The estimator is composed of quadratic B-splines, and estimation is performed by the method of sieves. In addition, the estimator of the distribution function is restricted to be a proper distribution function. An empirical example on the effect of fees on attendance rates at universities and community colleges is also included; we get substantively different results by relaxing the assumption that the distribution of the errors is normal.     

Semiparametric estimation of a bivariate Tobit model

The existing semiparametric estimation literature has mainly focused on univariate Tobit models and no semiparametric estimation has been considered for bivariate Tobit models. In this paper, we consider semiparametric estimation of the bivariate Tobit model proposed by Amemiya (1974), under the independence condition without imposing any parametric restriction on the error distribution. Our estimator is shown to be consistent and asymptotically normal, and simulation results show that our estimator performs well in finite samples. It is also worth noting that while Amemiya’s (1974) instrumental variables estimator (IV) requires the normality assumption, our semiparametric estimator actually outperforms his IV estimator even when normality holds. Our approach can be extended to higher dimensional multivariate Tobit models.     

The GMLE based Buckley–James estimator with modified case–cohort data

We consider the estimation problem under the linear regression model with the modified case–cohort design. The extensions of the Buckley–James estimator (BJE) under the case–cohort designs have been studied under an additional assumption that the censoring variable and the covariate are independent. If this assumption is violated, as is the case in a typical real data set in the literature, our simulation results suggest that those extensions are not consistent and we propose a new extension. Our estimator is based on the generalized maximum likelihood estimator (GMLE) of the underlying distributions. We propose a self-consistent algorithm, which is quite different from the one for multivariate interval-censored data. We also show that under certain regularity conditions, the GMLE and the BJE are consistent and asymptotically normally distributed. Some simulation results are presented. The BJE is also applied to the real data set in the literature.     

ML– and semiparametric estimation in logistic models with incomplete covariate data

ML–estimation of regression parameters with incomplete covariate information usually requires a distributional assumption regarding the concerned covariates that implies a source of misspecification. Semiparametric procedures avoid such assumptions at the expense of efficiency. In this paper a simulation study with small sample size is carried out to get an idea of the performance of the ML–estimator under misspecification and to compare it with the semiparametric procedures when the former is based on a correct assumption. The results show that there is only a little gain by correct parametric assumptions, which does not justify the possibly large bias when the assumptions are not met. Additionally, a simple modification of the complete case estimator appears to be nearly semiparametric efficient.     

Quadratic risk domination of restricted least squares estimators via Stein-ruled auxiliary constraints

This paper develops an estimator that under the standard assumption of the General Linear Model, including normality of disturbances, can be designed to dominate the Restricted Least Squares estimator in quadratic risk under very general conditions. The domination is achieved for any choice of symmetric positive definite weighting matrix used in defining the quadratic risk function, regardless of the correctness of the constraints used to define the restricted least squares estimator. The general problem conditions under which the estimator exists, and the risk behavior of the estimator over the parameter space are identified.     

Fitting dynamic factor models to non-stationary time series

Factor modelling of a large time series panel has widely proven useful to reduce its cross-sectional dimensionality. This is done by explaining common co-movements in the panel through the existence of a small number of common components, up to some idiosyncratic behaviour of each individual series. To capture serial correlation in the common components, a dynamic structure is used as in traditional (uni- or multivariate) time series analysis of second order structure, i.e. allowing for infinite-length filtering of the factors via dynamic loadings. In this paper, motivated from economic data observed over long time periods which show smooth transitions over time in their covariance structure, we allow the dynamic structure of the factor model to be non-stationary over time by proposing a deterministic time variation of its loadings. In this respect we generalize the existing recent work on static factor models with time-varying loadings as well as the classical, i.e. stationary, dynamic approximate factor model. Motivated from the stationary case, we estimate the common components of our dynamic factor model by the eigenvectors of a consistent estimator of the now time-varying spectral density matrix of the underlying data-generating process. This can be seen as a time-varying principal components approach in the frequency domain. We derive consistency of this estimator in a “double-asymptotic” framework of both cross-section and time dimension tending to infinity. The performance of the estimators is illustrated by a simulation study and an application to a macroeconomic data set.     

Discussion: Efficiency and Self-efficiency With Multiple Imputation Inference

By closely examining the examples provided in Nielsen (2003), this paper further explores the relationship between self-efficiency (Meng, 1994) and the validity of Rubin's multiple imputation (RMI) variance combining rule. The RMI variance combining rule is based on the common assumption/intuition that the efficiency of our estimators decreases when we have less data. However, there are estimation procedures that will do the opposite, that is, they can produce more efficient estimators with less data. Self-efficiency is a theoretical formulation for excluding such procedures. When a user, typically unaware of the hidden self-inefficiency of his choice, adopts a self-inefficient complete-data estimation procedure to conduct an RMI inference, the theoretical validity of his inference becomes a complex issue, as we demonstrate. We also propose a diagnostic tool for assessing potential self-inefficiency and the bias in the RMI variance estimator, at the outset of RMI inference, by constructing a convenient proxy to the RMI point estimator.     

A simple estimator for nonlinear error in variable models

We propose a simple estimator for nonlinear method of moment models with measurement error of the classical type when no additional data, such as validation data or double measurements, are available. We assume that the marginal distributions of the measurement errors are Laplace (double exponential) with zero means and unknown variances and the measurement errors are independent of the latent variables and are independent of each other. Under these assumptions, we derive simple revised moment conditions in terms of the observed variables. They are used to make inference about the model parameters and the variance of the measurement error. The results of this paper show that the distributional assumption on the measurement errors can be used to point identify the parameters of interest. Our estimator is a parametric method of moments estimator that uses the revised moment conditions and hence is simple to compute. Our estimation method is particularly useful in situations where no additional data are available, which is the case in many economic data sets. Simulation study demonstrates good finite sample properties of our proposed estimator. We also examine the performance of the estimator in the case where the error distribution is misspecified.     

Least squares model averaging by Mallows criterion

This paper is in response to a recent paper by Hansen (2007) who proposed an optimal model average estimator with weights selected by minimizing a Mallows criterion. The main contribution of Hansen’s paper is a demonstration that the Mallows criterion is asymptotically equivalent to the squared error, so the model average estimator that minimizes the Mallows criterion also minimizes the squared error in large samples. We are concerned with two assumptions that accompany Hansen’s approach. The first is the assumption that the approximating models are strictly nested in a way that depends on the ordering of regressors. Often there is no clear basis for the ordering and the approach does not permit non-nested models which are more realistic from a practical viewpoint. Second, for the optimality result to hold the model weights are required to lie within a special discrete set. In fact, Hansen noted both difficulties and called for extensions of the proof techniques. We provide an alternative proof which shows that the result on the optimality of the Mallows criterion in fact holds for continuous model weights and under a non-nested set-up that allows any linear combination of regressors in the approximating models that make up the model average estimator. These results provide a stronger theoretical basis for the use of the Mallows criterion in model averaging by strengthening existing findings.     

Least absolute deviations estimation for the censored regression model

This paper proposes an alternative to maximum likelihood estimation of the parameters of the censored regression (or censored ‘Tobit’) model. The proposed estimator is a generalization of least absolute deviations estimation for the standard linear model, and, unlike estimation methods based on the assumption of normally distributed error terms, the estimator is consistent and asymptotically normal for a wide class of error distributions, and is also robust to heteroscedasticity. The paper gives the regularity conditions and proofs of these large-sample results, and proposes classes of consistent estimators of the asymptotic covariance matrix for both homoscedastic and heteroscedastic disturbances.     

Sampling with probabilities proportional to the variable of interest

To estimate the mean sojourn time, a sample of Tilburg fair visitors was asked for the duration of their stay on the fair grounds. The longer a visitor's sojourn, the larger his/her probability of being interviewed will be; therefore, longer sojourn times will be overrepresented in the sample. As a consequence, the arithmetic sample mean is not a good estimator.
The paper places this problem against a theoretical background. Sampling with unequal probabilities is considered in a general context. The special case that the sampling probabilities are a function of the variable under investigation, is discussed in detail. As a better estimator the harmonic mean of the observations is presented. Most properties of this estimator are difficult to derive analytically, but a suitable variance estimator is derived. The behavior of estimator and variance estimator is studied in a number of quite different examples.     

Nonparametric estimation for self-selected interval data collected through a two-stage approach

Self-selected interval data arise in questionnaire surveys when respondents are free to answer with any interval without having pre-specified ranges. This type of data is a special case of interval-censored data in which the assumption of noninformative censoring is violated, and thus the standard methods for interval-censored data (e.g. Turnbull’s estimator) are not appropriate because they can produce biased results. Based on a certain sampling scheme, this paper suggests a nonparametric maximum likelihood estimator of the underlying distribution function. The consistency of the estimator is proven under general assumptions, and an iterative procedure for finding the estimate is proposed. The performance of the method is investigated in a simulation study.     

Epistemological reasons for preferring component analysis to factor analysis

Spearman's and Thomson's mathematical controversy over factor theory was forgotten when it became evident that empirical tetrad-differences bound away from zero (and when empirical evidence argued the need for extracting more factors from a matrix). In fact, both their models lead to zero tetraddifferences. Being more interested in the psychological than in the mathematical aspects of Spearman's model. Thompson remained indifferent to mathematical aspects of multiple factor analysis when Thurstone theorized it. Thus, he did not perceive that his counter-example negated the assumption Thrustone shared the rank of the matrix. The idea that components to be extracted must be equal to the rank of the matrix is not assumed in Hotelling's component model: as a result, this is the first epistemological reason for preferring component analysis to factor analysis. A second epistemological reason is the central theorem of Thurstone's multiple-factor model, which can be criticized because it is an assumption that, the rank of a complete matrix being n, it becomes k when commonalities are in the principal diagonal. This assumption goes against common sense, a fact demonstrated through comparison between residuals after k components have been extracted and after k principal factors have been extracted.     

Robust and consistent estimation of nonlinear errors-in-variables models

This paper considers the consistent estimation of nonlinear errors-in-variables models. It adopts the functional modeling approach by assuming that the true but unobserved regressors are random variables but making no parametric assumption on the distribution from which the latent variables are drawn. This paper shows how the information extracted from the replicate measurements can be used to identify and consistently estimate a general nonlinear errors-in-variables model. The identification is established through characteristic functions. The estimation procedure involves nonparametric estimation of the conditional density of the latent variables given the measurements using the identification results at the first stage, and at the second stage, a semiparametric nonlinear least-squares estimator is proposed. The consistency of the proposed estimator is also established. Finite sample performance of the estimator is investigated through a Monte Carlo study.     

Variance estimation using auxiliary information: An almost unbiased multivariate ratio estimator

The goal of this paper is to investigate the repeated substitution method (seeSrivastava, 1967) estimating population variance in finite population sample surveys. We propose an almost unbiased multivariate ratio estimator that has a smaller mean squared error than the conventional biased multivariate ratio estimator (established byIsaki (1983)) and with the same precision as the multivariate regression estimator. Furthermore, it is a computationally much more interesting estimator since to compute it we only need to have knowledge of correlation among available variables, which it is common to have in several practical situations. A comparison of the multivariate ratio estimator proposed and the multivariate regression estimator is given.     

Reduced rank regression in cointegrated models

The coefficient matrix of a cointegrated first-order autoregression is estimated by reduced rank regression (RRR), depending on the larger canonical correlations and vectors of the first difference of the observed series and the lagged variables. In a suitable coordinate system the components of the least-squares (LS) estimator associated with the lagged nonstationary variables are of order 1/T, where T is the sample size, and are asymptotically functionals of a Brownian motion process; the components associated with the lagged stationary variables are of the order T^−1/2 and are asymptotically normal. The components of the RRR estimator associated with the stationary part are asymptotically the same as for the LS estimator. Some components of the RRR estimator associated with nonstationary regressors have zero error to order 1/T and the other components have a more concentrated distribution than the corresponding components of the LS estimator.     

Identification and information in monotone binary models

This paper considers binary response models where errors are uncorrelated with a set of instrumental variables and are independent of a continuous regressor v$v$, conditional on all other variables. It is shown that these exclusion restrictions are not sufficient for identification and that additional identifying assumptions are needed. Such an assumption, introduced by Lewbel [Semiparametric qualitative response model estimation with unknown heteroskedasticity or instrumental variables. Journal of Econometrics 97, 145–177], is that the support of the continuous regressor is large, but we show that it significantly restricts the class of binary phenomena which can be analysed. We propose an alternative additional assumption under which β$\beta$ remains just identified and the estimation unchanged. This alternative assumption does not impose specific restrictions on the data, which broadens the scope of the estimation method in empirical work. The semiparametric efficiency bound of the model is also established and an existing estimator is shown to achieve that bound. The efficient estimator uses a plug-in density estimate. It is shown that plugging in the true density rather than an estimate is inefficient. Extensions to ordered choice models are provided.     

Estimation of bias and standard error of an improved estimator of normal mean

This paper considers an improved estimator of normal mean which is obtained by considering a feasible version of minimum mean squared error estimator. The exact expression for the bias and the mean squared error are fairly complicated and do not provide any guidelines as how to estimate the standard error of improved estimator. As is well known that any estimator without a formula for standard error has little practical utility. We therefore derive unbiased estimators for the bias and mean squared error of the improved estimator. Incidently, they turn out to be minimum variance unbiased estimators. Further, this exercise yields a simple formula for estimating the standard error. Based on the criterion of estimated standard error, the efficiency of the improved estimator with respect to the traditional unbiased estimator (i.e., sample mean) is examined numerically. The relationship with asymptotic standard error is also studied.     

The locally MIMSQE of nonnormal error variance in quadratically balanced models

Without normality assumption, an explicit form of the locally minimum mean square error translation-invariant quadratic estimator for the error variance in a quadratically balanced design is obtained. The estimator depends on the kurtosis of the random error. Under the normality the estimator becomes globally optimal.     

Semiparametric deconvolution with unknown error variance

Deconvolution is a useful statistical technique for recovering an unknown density in the presence of measurement error. Typically, the method hinges on stringent assumptions about the nature of the measurement error, more specifically, that the distribution is entirely known. We relax this assumption in the context of a regression error component model and develop an estimator for the unknown density. We show semi-uniform consistency of the estimator and provide an application to the stochastic frontier model.