Regularization of nonparametric frontier estimators

In production theory and efficiency analysis, we estimate the production frontier, the locus of the maximal attainable level of an output (the production), given a set of inputs (the production factors). In other setups, we estimate rather an input (or cost) frontier, the minimal level of the input (cost) attainable for a given set of outputs (goods or services produced). In both cases the problem can be viewed as estimating a surface under shape constraints (monotonicity, …). In this paper we derive the theory of an estimator of the frontier having an asymptotic normal distribution. It is based on the order-m$m$ partial frontier where we let the order m$m$ to converge to infinity when n→∞$n\to \infty$ but at a slow rate. The final estimator is then corrected for its inherent bias. We thus can view our estimator as a regularized frontier. In addition, the estimator is more robust to extreme values and outliers than the usual nonparametric frontier estimators, like FDH and than the unregularized order-_mn$m_n$ estimator of Cazals et al. (2002) converging to the frontier with a Weibull distribution if _mn→∞$m_n\to \infty$ fast enough when n→∞$n\to \infty$. The performances of our estimators are evaluated in finite samples and compared to other estimators through some Monte-Carlo experiments, showing a better behavior (in terms of robustness, bias, MSE and achieved coverage of the resulting confidence intervals). The practical implementation and the robustness properties are illustrated through simulated data sets but also with a real data set.     

Dominating estimators for minimum-variance portfolios

In this paper, we derive two shrinkage estimators for minimum-variance portfolios that dominate the traditional estimator with respect to the out-of-sample variance of the portfolio return. The presented results hold for any number of assets d≥4$d\ge 4$ and number of observations n≥d+2$n\ge d+2$. The small-sample properties of the shrinkage estimators as well as their large-sample properties for fixed d$d$ but n→∞$n\to \infty$ and n,d→∞$n,d\to \infty$ but n/d→q≤∞$n/d\to q\le \infty$ are investigated. Furthermore, we present a small-sample test for the question of whether it is better to completely ignore time series information in favor of naive diversification.     

On the distribution of estimated technical efficiency in stochastic frontier models

We consider a stochastic frontier model with error ε=v−u$\epsilon =v-u$, where v$v$ is normal and u$u$ is half normal. We derive the distribution of the usual estimate of u,E(u|ε)$u,E\left(u\right|\epsilon )$. We show that as the variance of v$v$ approaches zero, E(u|ε)−u$E\left(u\right|\epsilon )-u$ converges to zero, while as the variance of v$v$ approaches infinity, E(u|ε)$E\left(u\right|\epsilon )$ converges to E(u)$E\left(u\right)$. We graph the density of E(u|ε)$E\left(u\right|\epsilon )$ for intermediate cases. To show that E(u|ε)$E\left(u\right|\epsilon )$ is a shrinkage of u towards its mean, we derive and graph the distribution of E(u|ε)$E\left(u\right|\epsilon )$ conditional on u$u$. We also consider the distribution of estimated inefficiency in the fixed-effects panel data setting.     

On bootstrapping panel factor series

This paper studies the asymptotic validity of sieve bootstrap for nonstationary panel factor series. Two main results are shown. Firstly, a bootstrap Invariance Principle is derived pointwise in i$i$, obtaining an upper bound for the order of truncation of the AR polynomial that depends on n$n$ and T$T$. Consistent estimation of the long run variances is also studied for (n,T)→∞$(n,T)\to \infty$. Secondly, joint bootstrap asymptotics is also studied, investigating the conditions under which the bootstrap is valid. In particular, the extent of cross sectional dependence which can be allowed for is investigated. Whilst we show that, for general forms of cross dependence, consistent estimation of the long run variance (and therefore validity of the bootstrap) is fraught with difficulties, however we show that “one-cross-sectional-unit-at-a-time” resampling schemes yield valid bootstrap based inference under weak forms of cross-sectional dependence.     

High dimensional covariance matrix estimation using a factor model

High dimensionality comparable to sample size is common in many statistical problems. We examine covariance matrix estimation in the asymptotic framework that the dimensionality p$p$ tends to ∞$\infty$ as the sample size n$n$ increases. Motivated by the Arbitrage Pricing Theory in finance, a multi-factor model is employed to reduce dimensionality and to estimate the covariance matrix. The factors are observable and the number of factors K$K$ is allowed to grow with p$p$. We investigate the impact of p$p$ and K$K$ on the performance of the model-based covariance matrix estimator. Under mild assumptions, we have established convergence rates and asymptotic normality of the model-based estimator. Its performance is compared with that of the sample covariance matrix. We identify situations under which the factor approach increases performance substantially or marginally. The impacts of covariance matrix estimation on optimal portfolio allocation and portfolio risk assessment are studied. The asymptotic results are supported by a thorough simulation study.     

Cointegrating rank selection in models with time-varying variance

Reduced rank regression (RRR) models with time varying heterogeneity are considered. Standard information criteria for selecting cointegrating rank are shown to be weakly consistent in semiparametric RRR models in which the errors have general nonparametric short memory components and shifting volatility provided the penalty coefficient _Cn→∞$C_n\to \infty$ and _Cn/n→0$C_n/n\to 0$ as n→∞$n\to \infty$. The AIC criterion is inconsistent and its limit distribution is given. The results extend those in Cheng and Phillips (2009a) and are useful in empirical work where structural breaks or time evolution in the error variances is present. An empirical application to exchange rate data is provided.     

First difference maximum likelihood and dynamic panel estimation

First difference maximum likelihood (FDML) seems an attractive estimation methodology in dynamic panel data modeling because differencing eliminates fixed effects and, in the case of a unit root, differencing transforms the data to stationarity, thereby addressing both incidental parameter problems and the possible effects of nonstationarity. This paper draws attention to certain pathologies that arise in the use of FDML that have gone unnoticed in the literature and that affect both finite sample performance and asymptotics. FDML uses the Gaussian likelihood function for first differenced data and parameter estimation is based on the whole domain over which the log-likelihood is defined. However, extending the domain of the likelihood beyond the stationary region has certain consequences that have a major effect on finite sample and asymptotic performance. First, the extended likelihood is not the true likelihood even in the Gaussian case and it has a finite upper bound of definition. Second, it is often bimodal, and one of its peaks can be so peculiar that numerical maximization of the extended likelihood frequently fails to locate the global maximum. As a result of these pathologies, the FDML estimator is a restricted estimator, numerical implementation is not straightforward and asymptotics are hard to derive in cases where the peculiarity occurs with non-negligible probabilities. The peculiarities in the likelihood are found to be particularly marked in time series with a unit root. In this case, the asymptotic distribution of the FDMLE has bounded support and its density is infinite at the upper bound when the time series sample size T→∞$T\to \infty$. As the panel width n→∞$n\to \infty$ the pathology is removed and the limit theory is normal. This result applies even for T$T$ fixed and we present an expression for the asymptotic distribution which does not depend on the time dimension. We also show how this limit theory depends on the form of the extended likelihood.     

Quasi ML estimation of the panel AR(1) model with arbitrary initial conditions

In this paper we show that the Quasi ML estimation method yields consistent Random and Fixed Effects estimators for the autoregression parameter ρ$\rho$ in the panel AR(1) model with arbitrary initial conditions and possibly time-series heteroskedasticity even when the error components are drawn from heterogeneous distributions. We investigate both analytically and by means of Monte Carlo simulations the properties of the QML estimators for ρ$\rho$. The RE(Q)MLE for ρ$\rho$ is asymptotically at least as robust to individual heterogeneity and, when the data are i.i.d. and normal, at least as efficient as the FE(Q)MLE for ρ$\rho$. Furthermore, the QML estimators for ρ$\rho$ only suffer from a ‘weak moment conditions’ problem when ρ$\rho$ is close to one if the cross-sectional average of the variances of the errors is (almost) constant over time, e.g. under time-series homoskedasticity. However, in this case the QML estimators for ρ$\rho$ are still consistent when ρ$\rho$ is local to or equal to one although they converge to a non-normal possibly asymmetric distribution at a rate that is lower than N^1/2$N^{1/2}$ but at least N^1/4$N^{1/4}$. Finally, we study the finite sample properties of two types of estimators for the standard errors of the QML estimators for ρ$\rho$, and the bounds of QML based confidence intervals for ρ$\rho$.     

Estimating covariation: Epps effect,microstructure noise

This paper is about how to estimate the integrated covariance _〈X,Y〉T${〈X,Y〉}_T$ of two assets over a fixed time horizon [0,T]$[0,T]$, when the observations of X$X$ and Y$Y$ are “contaminated” and when such noisy observations are at discrete, but not synchronized, times. We show that the usual previous-tick covariance estimator is biased, and the size of the bias is more pronounced for less liquid assets. This is an analytic characterization of the Epps effect. We also provide the optimal sampling frequency which balances the tradeoff between the bias and various sources of stochastic error terms, including nonsynchronous trading, microstructure noise, and time discretization. Finally, a two scales covariance estimator is provided which simultaneously cancels (to first order) the Epps effect and the effect of microstructure noise. The gain is demonstrated in data.     

Panel unit root tests in the presence of a multifactor error structure

This paper extends the cross-sectionally augmented panel unit root test (CIPS$CIPS$) proposed by Pesaran (2007) to the case of a multifactor error structure, and proposes a new panel unit root test based on a simple average of cross-sectionally augmented Sargan–Bhargava statistics (CSB$CSB$). The basic idea is to exploit information regarding the m$m$ unobserved factors that are shared by k$k$ observed time series in addition to the series under consideration. Initially, we develop the tests assuming that m⁰$m^0$, the true number of factors, is known and show that the limit distribution of the tests does not depend on any nuisance parameters, so long as k≥m⁰−1$k\ge m^0-1$. Small sample properties of the tests are investigated by Monte Carlo experiments and are shown to be satisfactory. Particularly, the proposed CIPS$CIPS$ and CSB$CSB$ tests have the correct size for all   combinations of the cross section (N$N$) and time series (T$T$) dimensions considered. The power of both tests rises with N$N$ and T$T$, although the CSB$CSB$ test performs better than the CIPS$CIPS$ test for smaller sample sizes. The various testing procedures are illustrated with empirical applications to real interest rates and real equity prices across countries.     

A simple,robust and powerful test of the trend hypothesis

In this paper we develop a simple test procedure for a linear trend which does not require knowledge of the form of serial correlation in the data, is robust to strong serial correlation, and has a standard normal limiting null distribution under either I(0)$I(0)$ or I(1)$I(1)$ shocks. In contrast to other available robust linear trend tests, our proposed test achieves the Gaussian asymptotic local power envelope in both the I(0)$I(0)$ and I(1)$I(1)$ cases. For near-I(1)$I(1)$ errors our proposed procedure is conservative and a modification for this situation is suggested. An estimator of the trend parameter, together with an associated confidence interval, which is asymptotically efficient, again regardless of whether the shocks are I(0)$I(0)$ or I(1)$I(1)$, is also provided.     

Identification and nonparametric estimation of a transformed additively separable model

Let r(x,z)$r(x,z)$ be a function that, along with its derivatives, can be consistently estimated nonparametrically. This paper discusses the identification and consistent estimation of the unknown functions H$H$, M$M$, G$G$ and F$F$, where r(x,z)=H[M(x,z)]$r(x,z)=H\left[M(x,z)\right]$, M(x,z)=G(x)+F(z)$M(x,z)=G\left(x\right)+F\left(z\right)$, and H$H$ is strictly monotonic. An estimation algorithm is proposed for each of the model’s unknown components when r(x,z)$r(x,z)$ represents a conditional mean function. The resulting estimators use marginal integration to separate the components G$G$ and F$F$. Our estimators are shown to have a limiting Normal distribution with a faster rate of convergence than unrestricted nonparametric alternatives. Their small sample performance is studied in a Monte Carlo experiment. We apply our results to estimate generalized homothetic production functions for four industries in the Chinese economy.     

Semiparametric binary regression models under shape constraints with an application to Indian schooling data

We consider estimation of the regression function in a semiparametric binary regression model defined through an appropriate link function (with emphasis on the logistic link) using likelihood-ratio based inversion. The dichotomous response variable Δ$\Delta$ is influenced by a set of covariates that can be partitioned as (X,Z)$(X,Z)$ where Z$Z$ (real valued) is the covariate of primary interest and X$X$ (vector valued) denotes a set of control variables. For any fixed X$X$, the conditional probability of the event of interest (Δ=1$\Delta =1$) is assumed to be a non-decreasing function of Z$Z$. The effect of the control variables is captured by a regression parameter β$\beta$. We show that the baseline conditional probability function (corresponding to X=0$X=0$) can be estimated by isotonic regression procedures and develop a likelihood ratio based method for constructing asymptotic confidence intervals for the conditional probability function (the regression function) that avoids the need to estimate nuisance parameters. Interestingly enough, the calibration of the likelihood ratio based confidence sets for the regression function no longer involves the usual χ²${\chi }^2$ quantiles, but those of the distribution of a new random variable that can be characterized as a functional of convex minorants of Brownian motion with quadratic drift. Confidence sets for the regression parameter β$\beta$ can however be constructed using asymptotically χ²${\chi }^2$ likelihood ratio statistics. The finite sample performance of the methods are assessed via a simulation study. The techniques of the paper are applied to data sets on primary school attendance among children belonging to different socio-economic groups in rural India.     

Asymptotics for panel quantile regression models with individual effects

This paper studies panel quantile regression models with individual fixed effects. We formally establish sufficient conditions for consistency and asymptotic normality of the quantile regression estimator when the number of individuals, n$n$, and the number of time periods, T$T$, jointly go to infinity. The estimator is shown to be consistent under similar conditions to those found in the nonlinear panel data literature. Nevertheless, due to the non-smoothness of the objective function, we had to impose a more restrictive condition on T$T$ to prove asymptotic normality than that usually found in the literature. The finite sample performance of the estimator is evaluated by Monte Carlo simulations.     

Treatment effects in sample selection models and their nonparametric estimation

In a sample-selection model with the ‘selection’ variable Q$Q$ and the ‘outcome’ variable Y^∗$Y^{\ast }$, Y^∗$Y^{\ast }$ is observed only when Q=1$Q=1$. For a treatment D$D$ affecting both Q$Q$ and Y^∗$Y^{\ast }$, three effects are of interest: ‘participation  ’ (i.e., the selection) effect of D$D$ on Q$Q$, ‘visible performance  ’ (i.e., the observed outcome) effect of D$D$ on Y≡QY^∗$Y\equiv Q{Y}^{\ast }$, and ‘invisible performance  ’ (i.e., the latent outcome) effect of D$D$ on Y^∗$Y^{\ast }$. This paper shows the conditions under which the three effects are identified, respectively, by the three corresponding mean differences of Q$Q$, Y$Y$, and Y|Q=1$Y|Q=1$ (i.e., Y^∗|Q=1$Y^{\ast }|Q=1$) across the control (D=0$D=0$) and treatment (D=1$D=1$) groups. Our nonparametric estimators for those effects adopt a two-sample framework and have several advantages over the usual matching methods. First, there is no need to select the number of matched observations. Second, the asymptotic distribution is easily obtained. Third, over-sampling the control/treatment group is allowed. Fourth, there is a built-in mechanism that takes into account the ‘non-overlapping support problem’, which the usual matching deals with by choosing a ‘caliper’. Fifth, a sensitivity analysis to gauge the presence of unobserved confounders is available. A simulation study is conducted to compare the proposed methods with matching methods, and a real data illustration is provided.     

Asymptotic distribution of factor augmented estimators for panel regression

In this paper we derive an asymptotic theory for linear panel regression augmented with estimated common factors. We give conditions under which the estimated factors can be used in place of the latent factors in the regression equation. For the principal components estimate of the factor space it is shown that these conditions are satisfied when T/N→0$T/N\to 0$ and N/T³→0$N/T^3\to 0$ under regularity. Monte Carlo studies verify the asymptotic theory.