Variable selection via composite quantile regression with dependent errors

We propose composite quantile regression for dependent data, in which the errors are from short‐range dependent and strictly stationary linear processes. Under some regularity conditions, we show that composite quantile estimator enjoys root‐n consistency and asymptotic normality. We investigate the asymptotic relative efficiency of composite quantile estimator to both single‐level quantile regression and least‐squares regression. When the errors have finite variance, the relative efficiency of composite quantile estimator with respect to the least‐squares estimator has a universal lower bound. Under some regularity conditions, the adaptive least absolute shrinkage and selection operator penalty leads to consistent variable selection, and the asymptotic distribution of the non‐zero coefficient is the same as that of the counterparts obtained when the true model is known. We conduct a simulation study and a real data analysis to evaluate the performance of the proposed approach.     

Sparse estimators and the oracle property,or the return of Hodges’ estimator

We point out some pitfalls related to the concept of an oracle property as used in Fan and Li [2001. Variable selection via nonconcave penalized likelihood and its oracle properties. Journal of the American Statistical Association 96, 1348–1360; 2002. Variable selection for Cox's proportional hazards model and frailty model. Annals of Statistics 30, 74–99; 2004. New estimation and model selection procedures for semiparametric modeling in longitudinal data analysis. Journal of the American Statistical Association 99, 710–723] which are reminiscent of the well-known pitfalls related to Hodges’ estimator. The oracle property is often a consequence of sparsity of an estimator. We show that any estimator satisfying a sparsity property has maximal risk that converges to the supremum of the loss function; in particular, the maximal risk diverges to infinity whenever the loss function is unbounded. For ease of presentation the result is set in the framework of a linear regression model, but generalizes far beyond that setting. In a Monte Carlo study we also assess the extent of the problem in finite samples for the smoothly clipped absolute deviation (SCAD) estimator introduced in Fan and Li [2001. Variable selection via nonconcave penalized likelihood and its oracle properties. Journal of the American Statistical Association 96, 1348–1360]. We find that this estimator can perform rather poorly in finite samples and that its worst-case performance relative to maximum likelihood deteriorates with increasing sample size when the estimator is tuned to sparsity.     

Asymptotics and smoothing parameter selection for penalized spline regression with various loss functions

Penalized splines are used in various types of regression analyses, including non‐parametric quantile, robust and the usual mean regression. In this paper, we focus on the penalized spline estimator with general convex loss functions. By specifying the loss function, we can obtain the mean estimator, quantile estimator and robust estimator. We will first study the asymptotic properties of penalized splines. Specifically, we will show the asymptotic bias and variance as well as the asymptotic normality of the estimator. Next, we will discuss smoothing parameter selection for the minimization of the mean integrated squares error. The new smoothing parameter can be expressed uniquely using the asymptotic bias and variance of the penalized spline estimator. To validate the new smoothing parameter selection method, we will provide a simulation. The simulation results show that the consistency of the estimator with the proposed smoothing parameter selection method can be confirmed and that the proposed estimator has better behavior than the estimator with generalized approximate cross‐validation. A real data example is also addressed.     

Functional Coefficient Cointegration Models Subject to Time–Varying Volatility with an Application to the Purchasing Power Parity

This paper analyses functional coefficient cointegration models with both stationary and non‐stationary covariates, allowing time‐varying (unconditional) volatility of a general form. The conventional kernel weighted least squares (KLS) estimator is subject to potential efficiency loss, and can be improved by an adaptive kernel weighted least squares (AKLS) estimator that adapts to heteroscedasticity of unknown form. The AKLS estimator is shown to be as efficient as the oracle generalized kernel weighted least squares estimator asymptotically, and can achieve significant efficiency gain relative to the KLS estimator in finite samples. An illustrative example is provided by investigating the Purchasing Power Parity hypothesis.     

The effect of a Durbin–Watson pretest on confidence intervals in regression

Consider a linear regression model and suppose that our aim is to find a confidence interval for a specified linear combination of the regression parameters. In practice, it is common to perform a Durbin–Watson pretest of the null hypothesis of zero first‐order autocorrelation of the random errors against the alternative hypothesis of positive first‐order autocorrelation. If this null hypothesis is accepted then the confidence interval centered on the ordinary least squares estimator is used; otherwise the confidence interval centered on the feasible generalized least squares estimator is used. For any given design matrix and parameter of interest, we compare the confidence interval resulting from this two‐stage procedure and the confidence interval that is always centered on the feasible generalized least squares estimator, as follows. First, we compare the coverage probability functions of these confidence intervals. Second, we compute the scaled expected length of the confidence interval resulting from the two‐stage procedure, where the scaling is with respect to the expected length of the confidence interval centered on the feasible generalized least squares estimator, with the same minimum coverage probability. These comparisons are used to choose the better confidence interval, prior to any examination of the observed response vector.     

On solving bias‐corrected non‐linear estimation equations with an application to the dynamic linear model

In a seminal paper, Mak, Journal of the Royal Statistical Society B, 55, 1993, 945, derived an efficient algorithm for solving non‐linear unbiased estimation equations. In this paper, we show that when Mak's algorithm is applied to biased estimation equations, it results in the estimates that would come from solving a bias‐corrected estimation equation, making it a consistent estimator if regularity conditions hold. In addition, the properties that Mak established for his algorithm also apply in the case of biased estimation equations but for estimates from the bias‐corrected equations. The marginal likelihood estimator is obtained when the approach is applied to both maximum likelihood and least squares estimation of the covariance matrix parameters in the general linear regression model. The new approach results in two new estimators when applied to the profile and marginal likelihood functions for estimating the lagged dependent variable coefficient in the dynamic linear regression model. Monte Carlo simulation results show the new approach leads to a better estimator when applied to the standard profile likelihood. It is therefore recommended for situations in which standard estimators are known to be biased.     

Estimation in monotone single‐index models

Single‐index models are popular regression models that are more flexible than linear models and still maintain more structure than purely nonparametric models. We consider the problem of estimating the regression parameters under a monotonicity constraint on the unknown link function. In contrast to the standard approach of using smoothing techniques, we review different “non‐smooth” estimators that avoid the difficult smoothing parameter selection. For about 30 years, one has had the conjecture that the profile least squares estimator is an ‐consistent estimator of the regression parameter, but the only non‐smooth argmin/argmax estimators that are actually known to achieve this ‐rate are not based on the nonparametric least squares estimator of the link function. However, solving a score equation corresponding to the least squares approach results in ‐consistent estimators. We illustrate the good behavior of the score approach via simulations. The connection with the binary choice and current status linear regression models is also discussed.     

Robust Non‐nested Testing for Ordinary Least Squares Regression when Some of the Regressors are Lagged Dependent Variables*

The problem of testing non‐nested regression models that include lagged values of the dependent variable as regressors is discussed. It is argued that it is essential to test for error autocorrelation if ordinary least squares and the associated J and F tests are to be used. A heteroskedasticity–robust joint test against a combination of the artificial alternatives used for autocorrelation and non‐nested hypothesis tests is proposed. Monte Carlo results indicate that implementing this joint test using a wild bootstrap method leads to a well‐behaved procedure and gives better control of finite sample significance levels than asymptotic critical values.     

Posterior Inference in Bayesian Quantile Regression with Asymmetric Laplace Likelihood

The paper discusses the asymptotic validity of posterior inference of pseudo‐Bayesian quantile regression methods with complete or censored data when an asymmetric Laplace likelihood is used. The asymmetric Laplace likelihood has a special place in the Bayesian quantile regression framework because the usual quantile regression estimator can be derived as the maximum likelihood estimator under such a model, and this working likelihood enables highly efficient Markov chain Monte Carlo algorithms for posterior sampling. However, it seems to be under‐recognised that the stationary distribution for the resulting posterior does not provide valid posterior inference directly. We demonstrate that a simple adjustment to the covariance matrix of the posterior chain leads to asymptotically valid posterior inference. Our simulation results confirm that the posterior inference, when appropriately adjusted, is an attractive alternative to other asymptotic approximations in quantile regression, especially in the presence of censored data.     

Application of one‐step method to parameter estimation in ODE models

In this paper, we study application of Le Cam's one‐step method to parameter estimation in ordinary differential equation models. This computationally simple technique can serve as an alternative to numerical evaluation of the popular non‐linear least squares estimator, which typically requires the use of a multistep iterative algorithm and repetitive numerical integration of the ordinary differential equation system. The one‐step method starts from a preliminary ‐consistent estimator of the parameter of interest and next turns it into an asymptotic (as the sample size n →∞ ) equivalent of the least squares estimator through a numerically straightforward procedure. We demonstrate performance of the one‐step estimator via extensive simulations and real data examples. The method enables the researcher to obtain both point and interval estimates. The preliminary ‐consistent estimator that we use depends on non‐parametric smoothing, and we provide a data‐driven methodology for choosing its tuning parameter and support it by theory. An easy implementation scheme of the one‐step method for practical use is pointed out.     

CEO Stock‐Based Incentive Compensation and Firm Performance: A Quantile Regression Approach

This study employs the quantile regression model to examine the non‐monotonic impact of CEO stock‐based compensation on firm performance, using the data for U.S. non‐financial firms from 1993 to 2005. The results indicate that while the impact of CEO stock‐based pay on firm performance is positive for firms in the higher earnings quantile levels, the impact is negative for firms in the lower levels. In addition, the “V‐shaped” relationship between CEO stock‐based pay and firm performance satisfactorily explains the longstanding disagreement among earlier studies with regard to whether CEO stock‐based pay can enhance firm performance. Furthermore, the quantile‐varying pattern of the impact of stock‐based compensation on firm performance is robust after controlling for the industrial and yearly effects. It is also robust to the use of the pay‐for‐performance sensitivity as an alternative explanatory variable or the market‐based measure of performance as the dependent variable, or the consideration of the suspected endogenous problem between firm performance and stock‐based compensation.     

Projection‐Based Inference in Randomised Clinical Trials

Covariate information is often available in randomised clinical trials for each subject prior to treatment assignment and is commonly utilised to make covariate adjustment for baseline characteristics predictive of the outcome in order to increase precision and improve power in the detection of a treatment effect. Motivated by a nonparametric covariance analysis, we study a projection approach to making objective covariate adjustment in randomised clinical trials on the basis of two unbiased estimating functions that decouple the outcome and covariate data. The proposed projection approach extends a weighted least‐squares procedure by projecting one of the estimating functions onto the linear subspace spanned by the other estimating function that is E‐ancillary for the average treatment effect. Compared with the weighted least‐squares method, the projection method allows for objective inference on the average treatment effect by exploiting the treatment specific covariate–outcome associations. The resulting projection‐based estimator of the average treatment effect is asymptotically efficient when the treatment‐specific working regression models are correctly specified and is asymptotically more efficient than other existing competitors when the treatment‐specific working regression models are misspecified. The proposed projection method is illustrated by an analysis of data from an HIV clinical trial. In a simulation study, we show that the proposed projection method compares favourably with its competitors in finite samples.     

Realized extreme quantile: A joint model for conditional quantiles and measures of volatility with EVT refinements

We propose a new framework exploiting realized measures of volatility to estimate and forecast extreme quantiles. Our realized extreme quantile (REQ) combines quantile regression with extreme value theory and uses a measurement equation that relates the realized measure to the latent conditional quantile. Model estimation is performed by quasi maximum likelihood, and a simulation experiment validates this estimator in finite samples. An extensive empirical analysis shows that high‐frequency measures are particularly informative of the dynamic quantiles. Finally, an out‐of‐sample forecast analysis of quantile‐based risk measures confirms the merit of the REQ.     

Semiparametric time series regression modeling with a diverging number of parameters

Variable selection and error structure determination of a partially linear model with time series errors are important issues. In this paper, we investigate the regression coefficient and autoregressive order shrinkage and selection via the smoothly clipped absolute deviation penalty for a partially linear model with a divergent number of covariates and finite order autoregressive time series errors. Both consistency and asymptotic normality of the proposed penalized estimators are derived. The oracle property of the resultant estimators is proved. Simulation studies are carried out to assess the finite‐sample performance of the proposed procedure. A real data analysis is made to illustrate the usefulness of the proposed procedure as well.     

Semiparametric quantile averaging in the presence of high-dimensional predictors

The paper proposes a method for forecasting conditional quantiles. In practice, one often does not know the “true” structure of the underlying conditional quantile function, and in addition, we may have a large number of predictors. Focusing on such cases, we introduce a flexible and practical framework based on penalized high-dimensional quantile averaging. In addition to prediction, we show that the proposed method can also serve as a predictor selector. We conduct extensive simulation experiments to asses its prediction and variable selection performances for nonlinear and linear time series model designs. In terms of predictor selection, the approach tends to select the true set of predictors with minimal false positives. With respect to prediction accuracy, the method competes well even with the benchmark/oracle methods that know one or more aspects of the underlying quantile regression model. We further illustrate the merit of the proposed method by providing an application to the out-of-sample forecasting of U.S. core inflation using a large set of monthly macroeconomic variables based on FRED-MD database. The application offers several empirical findings.     

Estimation of limited dependent variable models by ordinary least squares and the method of moments

Under certain conditions, a broad class of qualitative and limited dependent variable models can be consistently estimated by the method of moments using a non-iterative correction to the ordinary least squares estimator, with only a small loss of efficiency compared to maximum likelihood estimation. The class of models is that obtained from a classical multinormal regression by any type of censoring or truncation and includes the tobit, probit, two-limit probit, truncated regression, and some variants of the sample selection models. The paper derives the estimators and their asymptotic covariance matrices.     

Instrumental variable estimation of nonseparable models

There are many environments where knowledge of a structural relationship is required to answer questions of interest. Also, nonseparability of a structural disturbance is a key feature of many models. Here, we consider nonparametric identification and estimation of a model that is monotonic in a nonseparable scalar disturbance, which disturbance is independent of instruments. This model leads to conditional quantile restrictions. We give local identification conditions for the structural equations from those quantile restrictions. We find that a modified completeness condition is sufficient for local identification. We also consider estimation via a nonparametric minimum distance estimator. The estimator minimizes the sum of squares of predicted values from a nonparametric regression of the quantile residual on the instruments. We show consistency of this estimator.     

SMOOTH QUANTILE‐BASED MODELING OF BRAND SALES,PRICE AND PROMOTIONAL EFFECTS FROM RETAIL SCANNER PANELS

Semiparametric quantile regression is employed to flexibly estimate sales response for frequently purchased consumer goods. Using retail store‐level data, we compare the performance of models with and without monotonic smoothing for fit and prediction accuracy. We find that (a) flexible models with monotonicity constraints imposed on price effects dominate both in‐sample and out‐of‐sample comparisons while being robust even at the boundaries of the price distribution when data is sparse; (b) quantile‐based confidence intervals are much more accurate compared to least‐squares‐based intervals; (c) specifications reflecting that managers may not have exact knowledge about future competitive pricing perform extremely well. Copyright © 2013 John Wiley & Sons, Ltd.     

Statistical inference on seemingly unrelated non‐parametric regression models with serially correlated errors

This article is concerned with the inference on seemingly unrelated non‐parametric regression models with serially correlated errors. Based on an initial estimator of the mean functions, we first construct an efficient estimator of the autoregressive parameters of the errors. Then, by applying an undersmoothing technique, and taking both of the contemporaneous correlation among equations and serial correlation into account, we propose an efficient two‐stage local polynomial estimation for the unknown mean functions. It is shown that the resulting estimator has the same bias as those estimators which neglect the contemporaneous and/or serial correlation and smaller asymptotic variance. The asymptotic normality of the resulting estimator is also established. In addition, we develop a wild block bootstrap test for the goodness‐of‐fit of models. The finite sample performance of our procedures is investigated in a simulation study whose results come out very supportive, and a real data set is analysed to illustrate the usefulness of our procedures.     

Testing Convergence in Income Distribution*

The generalized method of moments (GMM) estimator is often used to test for convergence in income distribution in a dynamic panel set‐up. We argue that though consistent, the GMM estimator utilizes the sample observations inefficiently. We propose a simple ordinary least squares (OLS) estimator with more efficient use of sample information. Our Monte Carlo study shows that the GMM estimator can be very imprecise and severely biased in finite samples. In contrast, the OLS estimator overcomes these shortcomings.