Semiparametric robust estimation of truncated and censored regression models

Many estimation methods of truncated and censored regression models such as the maximum likelihood and symmetrically censored least squares (SCLS) are sensitive to outliers and data contamination as we document. Therefore, we propose a semiparametric general trimmed estimator (GTE) of truncated and censored regression, which is highly robust but relatively imprecise. To improve its performance, we also propose data-adaptive and one-step trimmed estimators. We derive the robust and asymptotic properties of all proposed estimators and show that the one-step estimators (e.g., one-step SCLS) are as robust as GTE and are asymptotically equivalent to the original estimator (e.g., SCLS). The finite-sample properties of existing and proposed estimators are studied by means of Monte Carlo simulations.     

On kernel nonparametric regression designed for complex survey data

In this article, we consider nonparametric regression analysis between two variables when data are sampled through a complex survey. While nonparametric regression analysis has been widely used with data that may be assumed to be generated from independently and identically distributed (iid) random variables, the methods and asymptotic analyses established for iid data need to be extended in the framework of complex survey designs. Local polynomial regression estimators are studied, which include as particular cases design-based versions of the Nadaraya–Watson estimator and of the local linear regression estimator. In this paper, special emphasis is given to the local linear regression estimator. Our estimators incorporate both the sampling weights and the kernel weights. We derive the asymptotic mean squared error (MSE) of the kernel estimators using a combined inference framework, and as a corollary consistency of the estimators is deduced. Selection of a bandwidth is necessary for the resulting estimators; an optimal bandwidth can be determined, according to the MSE criterion in the combined mode of inference. Simulation experiments are conducted to illustrate the proposed methodology and an application with the Canadian survey of labour and income dynamics is presented.     

Estimating regression coefficients from survey data by asymptotic design-cum-model based approach

Postulating a linear regression of a variable of interest on an auxiliary variable with values of the latter known for all units of a survey population, we consider appropriate ways of choosing a sample and estimating the regression parameters. Recalling Thomsen’s (1978) results on non-existence of ‘design-cum-model’ based minimum variance unbiased estimators of regression coefficients we apply Brewer’s (1979) ‘asymptotic’ analysis to derive ‘asymptotic-design-cummodel’ based optimal estimators assuming large population and sample sizes. A variance estimation procedure is also proposed.     

Estimation of linear models with nequal restrictions

Inequality constrained regression involves the notion of a truncated parameter space, which was studied extensively by Moors (1985). His general results are extended here and applied to linear models. Using the invariance principle, for every observation x a set V_x is defined with the property that estimators taking values in V_x (with positive probability) are inadmissible. One of the main conclusions is that the usual estimators in inequality constrained regression are inadmissible; a method to obtain better estimators is indicated.     

Models for truncated counts

This paper examines a class of maximum-likelihood regression estimators for count data from truncated samples. Estimators for the truncated Poisson and negative binomial distributions are illustrated. Simulation results are given to illustrate the magnitude of the bias that may result from the failure to account for overdispersion in truncated samples. An empirical application based upon the number of recreational fishing trips taken by a sample of Alaskan fishermen is provided.     

Survey statisticians celebrate golden jubilee year 2003 of the linear regression estimator

In the present investigation, a general set-up for inference from survey data that covers the estimation of variance of estimators of totals and distribution functions has been considered, using known first and second order moments of auxiliary information at the estimation stage. The traditional linear regression estimator of population total owed to Hansen et al. Sample survey methods and theory. vol. 1 & 2, New York, Wiley (1953) is shown to be unique in its class of estimators, and celebrates Golden Jubilee Year-2003 for its outstanding performance in the literature by following Singh Advanced sampling theory with applications: How Michael selected Amy, vols 1 & 2, Kluwer, The Netherlands, pp 1–1247 2003. This particular paper has been designed to repair the methodology of Rao J. Off Stat 10(2):153–165 (1994) and hence that of Singh Ann Ins Stat Math 53(2):404–417 (2001). Although there is no need of simulation study to demonstrate the superiority of the proposed technique, because the theoretical results are crystal clear, but a small scale level simulation study have been designed to show the performance of the proposed estimators over the existing estimators in the literature.     

Semiparametric econometric estimators for a truncated regression model: a review with an extension

Econometric estimators for a truncated regression model are reviewed. For each estimator, the motivations, the key assumptions, the asymptotic distribution and estimates for the asymptotic variance matrix are presented; also a new estimator is suggested. We select five practical estimators among those, and compare them through a Monte Carlo study where the response variable is simulated but the covariates are drawn from a real data set. Some practical and computational issues are addressed as well.     

Blockwise bootstrap wavelet in nonparametric regression model with weakly dependent processes

In this paper, we suggest a blockwise bootstrap wavelet to estimate the regression function in the nonparametric regression models with weakly dependent processes for both designs of fixed and random. We obtain the asymptotic orders of the biases and variances of the estimators and establish the asymptotic normality for a modified version of the estimators. We also introduce a principle to select the length of data block. These results show that the blockwise bootstrap wavelet is valid for general weakly dependent processes such as α-mixing, φ-mixing and ρ-mixing random variables.     

Large-sample estimation strategies for eigenvalues of a Wishart matrix

The problem of simultaneous asymptotic estimation of eigenvalues of covariance matrix of Wishart matrix is considered under a weighted quadratic loss function. James-Stein type of estimators are obtained which dominate the sample eigenvalues. The relative merits of the proposed estimators are compared to the sample eigenvalues using asymptotic quadratic distributional risk under loal alternatives. It is shown that the proposed estimators are asymptotically superior to the sample eigenvalues. Further, it is demonstrated that the James-Stein type estimator is dominated by its truncated part.     

Semiparametric estimation of logistic regression model with missing covariates and outcome

We consider a semiparametric method to estimate logistic regression models with missing both covariates and an outcome variable, and propose two new estimators. The first, which is based solely on the validation set, is an extension of the validation likelihood estimator of Breslow and Cain (Biometrika 75:11–20, 1988). The second is a joint conditional likelihood estimator based on the validation and non-validation data sets. Both estimators are semiparametric as they do not require any model assumptions regarding the missing data mechanism nor the specification of the conditional distribution of the missing covariates given the observed covariates. The asymptotic distribution theory is developed under the assumption that all covariate variables are categorical. The finite-sample properties of the proposed estimators are investigated through simulation studies showing that the joint conditional likelihood estimator is the most efficient. A cable TV survey data set from Taiwan is used to illustrate the practical use of the proposed methodology.     

Preliminary test Liu estimators based on the conflicting W,LR and LM tests in a regression model with multivariate Student-<Emphasis Type="Italic">t</Emphasis> error

In this paper, the problem of estimation of the regression coefficients in a multiple regression model with multivariate Student-t error is considered under the multicollinearity situation when it is suspected that the regression coefficients may be restricted to a linear manifold. The preliminary test Liu estimators (PTLE) based on the Wald, Likelihood ratio (LR) and Lagrangian multiplier (LM) tests are given. The bias and mean square error (MSE) of the proposed estimators are derived and conditions of superiority of these estimators are provided. In particular, we show that in the neighborhood of the null hypothesis, the PTLE based on the LM test has the best performance followed by the estimators based on LR and W tests, while the situation is reversed when the parameter moves away from the manifold of the restriction. Furthermore, the optimum choice of the level of significance is also discussed.     

Productivity drivers and market dynamics in the Spanish first division football league

This paper analyses efficiency drivers of a representative sample of Spanish football clubs by means of the two-stage data envelopment analysis (DEA) procedure proposed by Simar and Wilson (J Econ, 136:31–64, 2007). In the first stage, the technical efficiency of football clubs is estimated using a bootstrapped DEA model in order to establish which of them are the most efficient; the ranking is based on total productivity in the period 1996–2004. In the second stage, the Simar and Wilson (J Econ, 136:31–64, 2007) procedure is used to bootstrap the DEA scores with a truncated bootstrapped regression. Policy implications of the main findings are also considered.     

Sieve estimation of panel data models with cross section dependence

In this paper we consider the problem of estimating semiparametric panel data models with cross section dependence, where the individual-specific regressors enter the model nonparametrically whereas the common factors enter the model linearly. We consider both heterogeneous and homogeneous regression relationships when both the time and cross-section dimensions are large. We propose sieve estimators for the nonparametric regression functions by extending Pesaran’s (2006) common correlated effect (CCE) estimator to our semiparametric framework. Asymptotic normal distributions for the proposed estimators are derived and asymptotic variance estimators are provided. Monte Carlo simulations indicate that our estimators perform well in finite samples.     

Semiparametric quantile regression estimation in dynamic models with partially varying coefficients

We study quantile regression estimation for dynamic models with partially varying coefficients so that the values of some coefficients may be functions of informative covariates. Estimation of both parametric and nonparametric functional coefficients are proposed. In particular, we propose a three stage semiparametric procedure. Both consistency and asymptotic normality of the proposed estimators are derived. We demonstrate that the parametric estimators are root-n$n$ consistent and the estimation of the functional coefficients is oracle. In addition, efficiency of parameter estimation is discussed and a simple efficient estimator is proposed. A simple and easily implemented test for the hypothesis of a varying-coefficient is proposed. A Monte Carlo experiment is conducted to evaluate the performance of the proposed estimators.     

Quantile cointegrating regression

Quantile regression has important applications in risk management, portfolio optimization, and asset pricing. The current paper studies estimation, inference and financial applications of quantile regression with cointegrated time series. In addition, a new cointegration model with quantile-varying coefficients is proposed. In the proposed model, the value of cointegrating coefficients may be affected by the shocks and thus may vary over the innovation quantile. The proposed model may be viewed as a stochastic cointegration model which includes the conventional cointegration model as a special case. It also provides a useful complement to cointegration models with (G)ARCH effects. Asymptotic properties of the proposed model and limiting distribution of the cointegrating regression quantiles are derived. In the presence of endogenous regressors, fully-modified quantile regression estimators and augmented quantile cointegrating regression are proposed to remove the second order bias and nuisance parameters. Regression Wald tests are constructed based on the fully modified quantile regression estimators. An empirical application to stock index data highlights the potential of the proposed method.     

Variance estimation in the change analysis of a linear regression model

We study a “direct test” of Chu and White (1992) proposed for detecting changes in the trend of a linear regression model. The power of this test strongly depends on a suitable estimation of the variance of the error variables involved. We discuss various types of variance estimators and derive their asymptotic properties under the null-hypothesis of “no change” as well as under the alternative of “a change in linear trend”. A small simulation study illustrates the estimators' finite sample behaviour.     

Estimation of the parameters of log-gamma distribution using order statistics

In this work we propose a technique of estimating the location parameter μ and scale parameter σ of log-gamma distribution by U-statistics constructed by taking best linear functions of order statistics as kernels. The efficiency comparison of the proposed estimators with respect to maximum likelihood estimators is also made.     

Estimation of the precision matrix of multivariate Pearson type II model

In this paper, the problem of estimating the precision matrix of a multivariate Pearson type II-model is considered. A new class of estimators is proposed. Moreover, the risk functions of the usual and the proposed estimators are explicitly derived. It is shown that the proposed estimator dominates the MLE and the unbiased estimator, under the quadratic loss function. A simulation study is carried out and confirms these results. Improved estimator of tr (Σ ⁻¹) is also obtained.     

Identification and estimation of polynomial errors-in-variables models

Methods of estimation of regression coefficients are proposed when the regression function includes a polynomial in a ‘true’ regressor which is measured with error. Two sources of additional information concerning the unobservable regressor are considered: either an additional indicator of the regressor (itself measured with error) or instrumental variables which characterize the systematic variation in the true regressor. In both cases, estimators are constructed by relating moments involving the unobserved variables to moments of observables; these relations lead to recursion formulae for computation of the regression coefficients and nuisance parameters (e.g., moments of the measurement error). Consistency and asymptotic normality of the estimated coefficients is demonstrated, and consistent estimators of the asymptotic covariant matrices are provided.     

Natural estimation of variances in a general finite discrete spectrum linear regression model

The method of “natural” estimation of variances in a general (orthogonal or nonorthogonal) finite discrete spectrum linear regression model of time series is suggested. Using geometrical language of the theory of projectors a form and properties of the estimators are investigated. Obtained results show that in describing the first and second moment properties of the new estimators the central role plays a matrix known in linear algebra as the Schur complement. Illustrative examples with particular regressors demonstrate direct applications of the results.