Robust penalized quantile regression estimation for panel data

This paper investigates a class of penalized quantile regression estimators for panel data. The penalty serves to shrink a vector of individual specific effects toward a common value. The degree of this shrinkage is controlled by a tuning parameter λ$\lambda$. It is shown that the class of estimators is asymptotically unbiased and Gaussian, when the individual effects are drawn from a class of zero-median distribution functions. The tuning parameter, λ$\lambda$, can thus be selected to minimize estimated asymptotic variance. Monte Carlo evidence reveals that the estimator can significantly reduce the variability of the fixed-effect version of the estimator without introducing bias.     

Nonparametric estimation and inference on conditional quantile processes

This paper presents estimation methods and asymptotic theory for the analysis of a nonparametrically specified conditional quantile process. Two estimators based on local linear regressions are proposed. The first estimator applies simple inequality constraints while the second uses rearrangement to maintain quantile monotonicity. The bandwidth parameter is allowed to vary across quantiles to adapt to data sparsity. For inference, the paper first establishes a uniform Bahadur representation and then shows that the two estimators converge weakly to the same limiting Gaussian process. As an empirical illustration, the paper considers a dataset from Project STAR and delivers two new findings.     

Efficient estimation in dynamic conditional quantile models

In this paper we consider the problem of semiparametric efficient estimation in conditional quantile models with time series data. We construct an M-estimator which achieves the semiparametric efficiency bound recently derived by Komunjer and Vuong (forthcoming). Our efficient M-estimator is obtained by minimizing an objective function which depends on a nonparametric estimator of the conditional distribution of the variable of interest rather than its density. The estimator is new and not yet seen in the literature. We illustrate its performance through a Monte Carlo experiment.     

Two-stage rank estimation of quantile index models

This paper estimates a class of models which satisfy a monotonicity condition on the conditional quantile function of the response variable. This class includes as a special case the monotonic transformation model with the error term satisfying a conditional quantile restriction, thus allowing for very general forms of conditional heteroscedasticity. A two-stage approach is adopted to estimate the relevant parameters. In the first stage the conditional quantile function is estimated nonparametrically by the local polynomial estimator discussed in Chaudhuri (Journal of Multivariate Analysis 39 (1991a) 246–269; Annals of Statistics 19 (1991b) 760–777) and Cavanagh (1996, Preprint). In the second stage, the monotonicity of the quantile function is exploited to estimate the parameters of interest by maximizing a rank-based objective function. The proposed estimator is shown to have desirable asymptotic properties and can then also be used for dimensionality reduction or to estimate the unknown structural function in the context of a transformation model.     

Conditional empirical likelihood estimation and inference for quantile regression models

This paper considers two empirical likelihood-based estimation, inference, and specification testing methods for quantile regression models. First, we apply the method of conditional empirical likelihood (CEL) by Kitamura et al. [2004. Empirical likelihood-based inference in conditional moment restriction models. Econometrica 72, 1667–1714] and Zhang and Gijbels [2003. Sieve empirical likelihood and extensions of the generalized least squares. Scandinavian Journal of Statistics 30, 1–24] to quantile regression models. Second, to avoid practical problems of the CEL method induced by the discontinuity in parameters of CEL, we propose a smoothed counterpart of CEL, called smoothed conditional empirical likelihood (SCEL). We derive asymptotic properties of the CEL and SCEL estimators, parameter hypothesis tests, and model specification tests. Important features are (i) the CEL and SCEL estimators are asymptotically efficient and do not require preliminary weight estimation; (ii) by inverting the CEL and SCEL ratio parameter hypothesis tests, asymptotically valid confidence intervals can be obtained without estimating the asymptotic variances of the estimators; and (iii) in contrast to CEL, the SCEL method can be implemented by some standard Newton-type optimization. Simulation results demonstrate that the SCEL method in particular compares favorably with existing alternatives.     

Semiparametric quantile regression estimation in dynamic models with partially varying coefficients

We study quantile regression estimation for dynamic models with partially varying coefficients so that the values of some coefficients may be functions of informative covariates. Estimation of both parametric and nonparametric functional coefficients are proposed. In particular, we propose a three stage semiparametric procedure. Both consistency and asymptotic normality of the proposed estimators are derived. We demonstrate that the parametric estimators are root-n$n$ consistent and the estimation of the functional coefficients is oracle. In addition, efficiency of parameter estimation is discussed and a simple efficient estimator is proposed. A simple and easily implemented test for the hypothesis of a varying-coefficient is proposed. A Monte Carlo experiment is conducted to evaluate the performance of the proposed estimators.     

Common correlated effects estimation of heterogeneous dynamic panel quantile regression models

This paper proposes a quantile regression estimator for a heterogeneous panel model with lagged dependent variables and interactive effects. The paper adopts the Common Correlated Effects (CCE) approach proposed in the literature and demonstrates that the extension to the estimation of dynamic quantile regression models is feasible under similar conditions to the ones used in the literature. The new quantile regression estimator is shown to be consistent and its asymptotic distribution is derived. Monte Carlo studies are carried out to study the small sample behavior of the proposed approach. The evidence shows that the estimator can significantly improve on the performance of existing estimators as long as the time series dimension of the panel is large. We present an application to the evaluation of Time-of-Use pricing using a large randomized control trial.     

Small sample considerations in estimation from panel data

Recent interest in statistical inference for panel data has focused on the problem of unobservable, individual-specific, random effects and the inconsistencies they introduce in estimation when they are correlated with other exogenous variables. Analysis of this problem has always assumed the variance components to be known. In this paper, we re-examine some of these questions in finite samples when the variance components must be estimated. In particular, when the effects are uncorrelated with other explanatory variables, we show that (i) the feasible Gauss-Markov estimator is more efficient than the within groups estimator for all but the fewest degrees of freedom and its variance is never more than 17% above the Cramer-Rao bound, (ii) the asymptotic approximation to the variance of the feasible Gauss-Markov estimator is similarly within 17% of the true variance but remains significantly smaller for moderately large samples sizes, and (iii) more efficient estimators for the variance components do not necessarily yield more efficient feasible Gauss-Markov estimators.     

Strong representation of the presmoothed quantile function estimator for censored data

We consider lifetime data subject to right random censorship. In this context, this paper deals with the topic of estimating the distribution function of the lifetime and the corresponding quantile function. As it has been shown that the classical Kaplan–Meier estimator of the distribution function can be improved by means of presmoothing ideas, we introduce a quantile function estimator via the presmoothed distribution function estimator studied by Cao et al. [Journal of Nonparametric statistics, Vol. 17 (2005) pp. 31–56.] The main result of this paper is an almost sure representation of this presmoothed estimator. As a consequence, its strong consistency and asymptotic normality are established. The performance of this new quantile estimator is analyzed in a simulation study and applied to a real data example.     

Health and political regimes: Evidence from quantile regression

This study investigates how political regimes affect health conditions such as infant and child mortality rates and life expectancy using data from 180 countries observed between 1960 and 2013. Panel quantile regression is used to examine the effects at different intervals throughout the distribution of health outcomes. The estimation results indicate that democracy has significant positive effects on health outcomes and that its impacts are greater when health outcomes are worse. These results are robust to different democracy and health indices. The effects of different types of democracies and dictatorships are also considered, that is parliamentary, mixed (semi-presidential) and presidential democracies, and civilian, military and royal dictatorships. The parliamentary form of democracy has the largest positive impact on health outcomes at the worst quantile of health outcomes, although the difference in the impacts of the three types of democracies is not necessarily large. Furthermore, all types of dictatorships have a negative impact on health outcomes, with military dictatorship having the worst outcome when health outcomes are worse. Finally, the effects of democratization on health outcomes are significantly positive when the health outcomes are worse.     

Design and estimation problems when estimating a regression coefficient from survey data

Summary The values of a variablex are assumed known for all elements in a finite population. Between this variable and another variableY, whose values are registered in a sample survey, there is the usual linear regression relationship. This paper considers problems of design and of estimation of the regression coefficienta and the interceptb. The followingGodambe type theorem is proved: There exists no minimum variance unbiased linear estimator ofa andb. We also derive that the usual estimators ofa andb have minimum variance if attention is restricted to the class of linear estimators unbiased in any given sample.     

A minimum chi-squared method for indirect parameter estimation from Poisson data

In this paper, we introduce a new algorithm for estimating non-negative parameters from Poisson observations of a linear transformation of the parameters. The proposed objective function fits both a weighted least squares (WLS) and a minimum χ² estimation framework, and results in a convex optimization problem. Unlike conventional WLS methods, the weights do not need to be estimated from the datas, but are incorporated in the objective function. The iterative algorithm is derived from an alternating projection procedure in which "distance" is determined by the chi-squared test statistic, which is interpreted as a measure of the discrepancy between two distributions. This may be viewed as an alternative to the Kullback-Leibler divergence which corresponds to the maximum likelihood (ML) estimation. The algorithm is similar in form to, and shares many properties with, the expectation maximization algorithm for ML estimation. In particular, we show that every limit point of the algorithm is an estimator, and the sequence of projected (by the linear transformation into the data space) means converge. Despite the similarities, we show that the new estimators are quite distinct from ML estimators, and obtain conditions under which they are identical.     

On the estimation of multinomial logit models from relative frequency data

Standard estimators for the binomial logit model and for the multinomial logit model allow for an error arising from the use of relative frequencies instead of the true probabilities as the dependent variable. Recently Amemiya and Nold (1975) have considered the effect of the presence of an additional specification error in the binomial logit model and have proposed a modified logit estimation scheme to take the additional error variance into account. This paper extends their idea to the multinomial logit model and proposes an estimator that is consistent and asymptotically more efficient than the standard multinomial logit estimator. The paper presents a comparison of the results of applying the new estimator and existing estimators to a logit model for the choice of automobile ownership in the United States.     

Probabilistic energy forecasting using the nearest neighbors quantile filter and quantile regression

Parametric quantile regression is a useful tool for obtaining probabilistic energy forecasts. Nonetheless, traditional quantile regressions may be complicated to obtain using complex data mining techniques (e.g., artificial neural networks), since they are trained using a non-differentiable cost function. This article presents a method that uses a new nearest neighbors quantile filter to obtain quantile regressions independently of the data mining technique utilized and without the non-differentiable cost function. This method is subsequently validated using the dataset from the 2014 Global Energy Forecasting Competition. The results show that the method presented here is able to solve the competition’s task with a similar accuracy to the competition’s winner and in a similar timeframe, but requiring a much less powerful computer. This property may be relevant in an online forecasting service for which the fast computation of probabilistic forecasts using less powerful machines is required.     

SCAD‐penalized quantile regression for high‐dimensional data analysis and variable selection

The present penalized quantile variable selection methods are only applicable to finite number of predictors or do not have oracle property associated with estimator. This technique is considered as an alternative to ordinary least squares regression in case of the outliers and the heavy‐tailed errors existing in linear models. The variable selection through quantile regression with diverging number of parameters is investigated in this paper. The convergence rate of estimator with smoothly clipped absolute deviation penalty function is also studied. Moreover, the oracle property with proper selection of tuning parameter for quantile regression under certain regularity conditions is also established. In addition, the rank correlation screening method is used to accommodate ultra‐high dimensional data settings. Monte Carlo simulations demonstrate finite performance of the proposed estimator. The results of real data reveal that this approach provides substantially more information as compared with ordinary least squares, conventional quantile regression, and quantile lasso.     

Non-parametric, unconditional quantile estimation for efficiency analysis with an application to Federal Reserve check processing operations

This paper examines the technical efficiency of US Federal Reserve check processing offices over 1980–2003. We extend results from Park et al. [Park, B., Simar, L., Weiner, C., 2000. FDH efficiency scores from a stochastic point of view. Econometric Theory 16, 855–877] and Daouia and Simar [Daouia, A., Simar, L., 2007. Nonparametric efficiency analysis: a multivariate conditional quantile approach. Journal of Econometrics 140, 375–400] to develop an unconditional, hyperbolic, α-quantile estimator of efficiency. Our new estimator is fully non-parametric and robust with respect to outliers; when used to estimate distance to quantiles lying close to the full frontier, it is strongly consistent and converges at rate root-n, thus avoiding the curse of dimensionality that plagues data envelopment analysis (DEA) estimators. Our methods could be used by policymakers to compare inefficiency levels across offices or by managers of individual offices to identify peer offices.     

Efficient estimation and inference in linear pseudo-panel data models

We consider pseudo-panel data models constructed from repeated cross sections in which the number of individuals per group is large relative to the number of groups and time periods. First, we show that, when time-invariant group fixed effects are neglected, the OLS estimator does not converge in probability to a constant but rather to a random variable. Second, we show that, while the fixed-effects (FE) estimator is consistent, the usual t statistic is not asymptotically normally distributed, and we propose a new robust t statistic whose asymptotic distribution is standard normal. Third, we propose efficient GMM estimators using the orthogonality conditions implied by grouping and we provide t tests that are valid even in the presence of time-invariant group effects. Our Monte Carlo results show that the proposed GMM estimator is more precise than the FE estimator and that our new t test has good size and is powerful.