NONPARAMETRIC AND SEMIPARAMETRIC PANEL DATA MODELS: RECENT DEVELOPMENTS

In this paper, we provide an intensive review of the recent developments for semiparametric and fully nonparametric panel data models that are linearly separable in the innovation and the individual-specific term. We analyze these developments under two alternative model specifications: fixed and random effects panel data models. More precisely, in the random effects setting, we focus our attention in the analysis of some efficiency issues that have to do with the so-called working independence condition. This assumption is introduced when estimating the asymptotic variance–covariance matrix of nonparametric estimators. In the fixed effects setting, to cope with the so-called incidental parameters problem, we consider two different estimation approaches: profiling techniques and differencing methods. Furthermore, we are also interested in the endogeneity problem and how instrumental variables are used in this context. In addition, for practitioners, we also show different ways of avoiding the so-called curse of dimensionality problem in pure nonparametric models. In this way, semiparametric and additive models appear as a solution when the number of explanatory variables is large.     

CCE in fixed‐T panels

The presence of unobserved heterogeneity and its likely detrimental effect on inference has recently motivated the use of factor‐augmented panel regression models. The workhorse of this literature is based on first estimating the unknown factors using the cross‐section averages of the observables, and then applying ordinary least squares conditional on the first‐step factor estimates. This is the common correlated effects (CCE) approach, the existing asymptotic theory for which is based on the requirement that both the number of time series observations, T, and the number of cross‐section units, N, tend to infinity. The obvious implication of this theory for empirical work is that both N and T should be large, which means that CCE is impossible for the typical micro panel where only N is large. In the current paper, we put the existing CCE theory and its implications to a test. This is done by developing a new theory that enables T to be fixed. The results show that many of the previously derived large‐T results hold even if T is fixed. In particular, the pooled CCE estimator is still consistent and asymptotically normal, which means that CCE is more applicable than previously thought. In fact, not only do we allow T to be fixed, but the conditions placed on the time series properties of the factors and idiosyncratic errors are also much more general than those considered previously.     

Fixed effects demeaning in the presence of interactive effects in treatment effects regressions and elsewhere

The present paper shows that cross-section demeaning with respect to time fixed effects is more useful than commonly appreciated, in that it enables consistent and asymptotically normal estimation of interactive effects models with heterogeneous slope coefficients when the number of time periods, T, is small and only the number of cross-sectional units, N, is large. This is important when using OLS but also when using more sophisticated estimators of interactive effects models whose validity does not require demeaning, a point that to the best of our knowledge has not been made before in the literature. As an illustration, we consider the problem of estimating the average treatment effect in the presence of unobserved time-varying heterogeneity. Gobillon and Magnac (2016) recently considered this problem. They employed a principal components-based approach designed to deal with general unobserved heterogeneity, which does not require fixed effects demeaning. The approach does, however, require that T is large, which is typically not the case in practice, and the results reported here confirm that the performance can be extremely poor in small-T samples. The exception is when the approach is applied to data that have been demeaned with respect to fixed effects.     

Sieve estimation of panel data models with cross section dependence

In this paper we consider the problem of estimating semiparametric panel data models with cross section dependence, where the individual-specific regressors enter the model nonparametrically whereas the common factors enter the model linearly. We consider both heterogeneous and homogeneous regression relationships when both the time and cross-section dimensions are large. We propose sieve estimators for the nonparametric regression functions by extending Pesaran’s (2006) common correlated effect (CCE) estimator to our semiparametric framework. Asymptotic normal distributions for the proposed estimators are derived and asymptotic variance estimators are provided. Monte Carlo simulations indicate that our estimators perform well in finite samples.     

Introducing Environmental Variables in Nonparametric Frontier Models: a Probabilistic Approach

This paper proposes a general formulation of a nonparametric frontier model introducing external environmental factors that might influence the production process but are neither inputs nor outputs under the control of the producer. A representation is proposed in terms of a probabilistic model which defines the data generating process. Our approach extends the basic ideas from Cazals et al. (2002) to the full multivariate case. We introduce the concepts of conditional efficiency measure and of conditional efficiency measure of order-m. Afterwards we suggest a practical way for computing the nonparametric estimators. Finally, a simple methodology to investigate the influence of these external factors on the production process is proposed. Numerical illustrations through some simulated examples and through a real data set on Mutual Funds show the usefulness of the approach.JEL Classification: C13, C14, D20     

Estimation of spatial autoregressive panel data models with fixed effects

This paper establishes asymptotic properties of quasi-maximum likelihood estimators for SAR panel data models with fixed effects and SAR disturbances. A direct approach is to estimate all the parameters including the fixed effects. Because of the incidental parameter problem, some parameter estimators may be inconsistent or their distributions are not properly centered. We propose an alternative estimation method based on transformation which yields consistent estimators with properly centered distributions. For the model with individual effects only, the direct approach does not yield a consistent estimator of the variance parameter unless T is large, but the estimators for other common parameters are the same as those of the transformation approach. We also consider the estimation of the model with both individual and time effects.     

Testing a linear dynamic panel data model against nonlinear alternatives

The most popular econometric models in the panel data literature are the class of linear panel data models with unobserved individual- and/or time-specific effects. The consistency of parameter estimators and the validity of their economic interpretations as marginal effects depend crucially on the correct functional form specification of the linear panel data model. In this paper, a new class of residual-based tests is proposed for checking the validity of dynamic panel data models with both large cross-sectional units and time series dimensions. The individual and time effects can be fixed or random, and panel data can be balanced or unbalanced. The tests can detect a wide range of model misspecifications in the conditional mean of a dynamic panel data model, including functional form and lag misspecification. They check a large number of lags so that they can capture misspecification at any lag order asymptotically. No common alternative is assumed, thus allowing for heterogeneity in the degrees and directions of functional form misspecification across individuals. Thanks to the use of panel data with large $N$ and $T$, the proposed nonparametric tests have an asymptotic normal distribution under the null hypothesis without requiring the smoothing parameters to grow with the sample sizes. This suggests better nonparametric asymptotic approximation for the panel data than for time series or cross sectional data. This is confirmed in a simulation study. We apply the new tests to test linear specification of cross-country growth equations and found significant nonlinearities in mean for OECD countries’ growth equation for annual and quintannual panel data.     

An algorithm for panel ANOVA with grouped data

In this paper, we present an algorithm suitable for analysing the variance of panel data when some observations are either given in grouped form or are missed. The analysis is carried out from the perspective of ANOVA panel data models with general errors. The classification intervals of the grouped observations may vary from one to another, thus the missing observations are in fact a particular case of grouping. The proposed Algorithm (1) estimates the parameters of the panel data models; (2) evaluates the covariance matrices of the asymptotic distribution of the time-dependent parameters assuming that the number of time periods, T, is fixed and the number of individuals, N, tends to infinity and similarly, of the individual parameters when T → ∞ and N is fixed; and, finally, (3) uses these asymptotic covariance matrix estimations to analyse the variance of the panel data.     

Statistical Inference in Nonparametric Frontier Models: The State of the Art

Efficiency scores of firms are measured by their distance to an estimated production frontier. The economic literature proposes several nonparametric frontier estimators based on the idea of enveloping the data (FDH and DEA-type estimators). Many have claimed that FDH and DEA techniques are non-statistical, as opposed to econometric approaches where particular parametric expressions are posited to model the frontier. We can now define a statistical model allowing determination of the statistical properties of the nonparametric estimators in the multi-output and multi-input case. New results provide the asymptotic sampling distribution of the FDH estimator in a multivariate setting and of the DEA estimator in the bivariate case. Sampling distributions may also be approximated by bootstrap distributions in very general situations. Consequently, statistical inference based on DEA/FDH-type estimators is now possible. These techniques allow correction for the bias of the efficiency estimators and estimation of confidence intervals for the efficiency measures. This paper summarizes the results which are now available, and provides a brief guide to the existing literature. Emphasizing the role of hypotheses and inference, we show how the results can be used or adapted for practical purposes.     

Nonparametric fixed effects model for panel data with locally stationary regressors

We develop methods for inference in nonparametric time-varying fixed effects panel data models that allow for locally stationary regressors and for the time series length $T$ and cross-section size $N$ both being large. We first develop a pooled nonparametric profile least squares dummy variable approach to estimate the nonparametric function, and establish the optimal convergence rate and asymptotic normality of the resultant estimator. We then propose a test statistic to check whether the bivariate nonparametric function is time-varying or the time effect is separable, and derive the asymptotic distribution of the proposed test statistic. We present several simulated examples and two real data analyses to illustrate the finite sample performance of the proposed methods.     

Inference by the <Emphasis Type="Italic">m</Emphasis> out of <Emphasis Type="Italic">n</Emphasis> bootstrap in nonparametric frontier models

It is well-known that the naive bootstrap yields inconsistent inference in the context of data envelopment analysis (DEA) or free disposal hull (FDH) estimators in nonparametric frontier models. For inference about efficiency of a single, fixed point, drawing bootstrap pseudo-samples of size m < n provides consistent inference, although coverages are quite sensitive to the choice of subsample size m. We provide a probabilistic framework in which these methods are shown to valid for statistics comprised of functions of DEA or FDH estimators. We examine a simple, data-based rule for selecting m suggested by Politis et al. (Stat Sin 11:1105–1124, 2001), and provide Monte Carlo evidence on the size and power of our tests. Our methods (i) allow for heterogeneity in the inefficiency process, and unlike previous methods, (ii) do not require multivariate kernel smoothing, and (iii) avoid the need for solutions of intermediate linear programs.     

Nonparametric estimation for a current status right‐censored data model

We consider the Case 1 interval censoring approach for right‐censored survival data. An important feature of the model is that right‐censored event times are not observed exactly, but at some inspection times. The model covers as particular cases right‐censored data, current status data, and life table survival data with a single inspection time. We discuss the nonparametric estimation approach and consider three nonparametric estimators for the survival function of failure time: maximum likelihood, pseudolikelihood, and the naïve estimator. We establish strong consistency of the estimators with the L₁ rate of convergence. Simulation results confirm consistency of the estimators.     

To Pool or Not to Pool: Revisited

This paper provides a new comparative analysis of pooled least squares and fixed effects (FE) estimators of the slope coefficients in the case of panel data models when the time dimension (T) is fixed while the cross section dimension (N) is allowed to increase without bounds. The individual effects are allowed to be correlated with the regressors, and the comparison is carried out in terms of an exponent coefficient, δ, which measures the degree of pervasiveness of the FE in the panel. The use of δ allows us to distinguish between poolability of small N dimensional panels with large T from large N dimensional panels with small T. It is shown that the pooled estimator remains consistent so long as δ<1, and is asymptotically normally distributed if δ<1/2, for a fixed T and as N→∞. It is further shown that when δ<1/2, the pooled estimator is more efficient than the FE estimator. We also propose a Hausman type diagnostic test of δ<1/2 as a simple test of poolability, and propose a pretest estimator that could be used in practice. Monte Carlo evidence supports the main theoretical findings and gives some indications of gains to be made from pooling when δ<1/2.     

Nonparametric identification and estimation of current status data in the presence of death

We present a nonparametric study of current status data in the presence of death. Such data arise from biomedical investigations in which patients are examined for the onset of a certain disease, for example, tumor progression, but may die before the examination. A key difference between such studies on human subjects and the survival–sacrifice model in animal carcinogenicity experiments is that, due to ethical and perhaps technical reasons, deceased human subjects are not examined, so that the information on their disease status is lost. We show that, for current status data with death, only the overall and disease‐free survival functions can be identified, whereas the cumulative incidence of the disease is not identifiable. We describe a fast and stable algorithm to estimate the disease‐free survival function by maximizing a pseudo‐likelihood with plug‐in estimates for the overall survival rates. It is then proved that the global rate of convergence for the nonparametric maximum pseudo‐likelihood estimator is equal to O_p(n^?1/3) or the convergence rate of the estimated overall survival function, whichever is slower. Simulation studies show that the nonparametric maximum pseudo‐likelihood estimators are fairly accurate in small‐ to medium‐sized samples. Real data from breast cancer studies are analyzed as an illustration.     

Some properties of the LIML estimator in a dynamic panel structural equation

We investigate the finite sample and asymptotic properties of the within-groups (WG), the random-effects quasi-maximum likelihood (RQML), the generalized method of moment (GMM) and the limited information maximum likelihood (LIML) estimators for a panel autoregressive structural equation model with random effects when both T (time-dimension) and N (cross-section dimension) are large. When we use the forward-filtering due to Alvarez and Arellano (2003), the WG, the RQML and GMM estimators are significantly biased when both T and N are large while T/N is different from zero. The LIML estimator gives desirable asymptotic properties when T/N converges to a constant.     

Nonparametric trending regression with cross-sectional dependence

Panel data, whose series length T$T$ is large but whose cross-section size N$N$ need not be, are assumed to have common time trend, of unknown form. The model includes additive, unknown, individual-specific components and allows for spatial or other cross-sectional dependence and/or heteroscedasticity. A simple smoothed nonparametric trend estimate is shown to be dominated by an estimate which exploits availability of cross-sectional data. Asymptotically optimal bandwidth choices are justified for both estimates. Feasible optimal bandwidths, and feasible optimal trend estimates, are asymptotically justified, finite sample performance of the latter being examined in a Monte Carlo study. Potential extensions are discussed.     

Estimating efficiencies from frontier models with panel data: A comparison of parametric,non-parametric and semi-parametric methods with bootstrapping

The aim of this article is first to review how the standard econometric methods for panel data may be adapted to the problem of estimating frontier models and (in)efficiencies. The aim is to clarify the difference between the fixed and random effect model and to stress the advantages of the latter. Then a semi-parametric method is proposed (using a non-parametric method as a first step), the message being that in order to estimate frontier models and (in)efficiences with panel data, it is an appealing method. Since analytic sampling distributions of efficiencies are not available, a bootstrap method is presented in this framework. This provides a tool allowing to assess the statistical significance of the obtained estimators. All the methods are illustrated in the problem of estimating the inefficiencies of 19 railway companies observed over a period of 14 years (1970–1983).Article presented at the ORSA/TIMS joint national meeting, Productivity and Global Competition, Philadelphia, October 29–31, 1990. An earlier version of the paper was presented at the European Workshop on Efficiency and Productivity Measurement in the Service Industries held at CORE, October 20–21, 1989. Helpful comments of Jacques Mairesse, Benoît Mulkay, Sergio Perelman, Michel Mouchart, Shawna Grosskopf and Rolf Färe, at various stages of the paper, are gratefully acknowledged.     

Estimating the distribution of welfare effects using quantiles

This paper proposes a framework to model welfare effects that are associated with a price change in a population of heterogeneous consumers. The framework is similar to that of Hausman and Newey (Econometrica, 1995, 63, 1445–1476), but allows for more general forms of heterogeneity. Individual demands are characterized by a general model that is nonparametric in the regressors, as well as monotonic in unobserved heterogeneity, allowing us to identify the distribution of welfare effects. We first argue why a decision maker should care about this distribution. Then we establish constructive identification, propose a sample counterparts estimator, and analyze its large‐sample properties. Finally, we apply all concepts to measuring the heterogeneous effect of a change of gasoline price using US consumer data and find very substantial differences in individual effects across quantiles.     

Bootstrap unit root tests in panels with cross-sectional dependency

We apply bootstrap methodology to unit root tests for dependent panels with N cross-sectional units and T time series observations. More specifically, we let each panel be driven by a general linear process which may be different across cross-sectional units, and approximate it by a finite order autoregressive integrated process of order increasing with T. As we allow the dependency among the innovations generating the individual series, we construct our unit root tests from the estimation of the system of the entire N cross-sectional units. The limit distributions of the tests are derived by passing T to infinity, with N fixed. We then apply bootstrap method to the approximated autoregressions to obtain critical values for the panel unit root tests, and establish the asymptotic validity of such bootstrap panel unit root tests under general conditions. The proposed bootstrap tests are indeed quite general covering a wide class of panel models. They in particular allow for very general dynamic structures which may vary across individual units, and more importantly for the presence of arbitrary cross-sectional dependency. The finite sample performance of the bootstrap tests is examined via simulations, and compared to that of commonly used panel unit root tests. We find that our bootstrap tests perform relatively well, especially when N is small.     

Consistent inference in fixed-effects stochastic frontier models

The classical stochastic frontier panel data models provide no mechanism to disentangle individual time invariant unobserved heterogeneity from inefficiency. Greene (2005a, b) proposed the so-called “true” fixed-effects specification that distinguishes these two latent components. However, due to the incidental parameters problem, his maximum likelihood estimator may lead to biased variance estimates. We propose two alternative estimators that achieve consistency for $n\to \infty$ with fixed $T$. Furthermore, we extend the Chen et al. (2014) results providing a feasible estimator when the inefficiency is heteroskedastic and follows a first-order autoregressive process. We investigate the behavior of the proposed estimators through Monte Carlo simulations showing good finite sample properties, especially in small samples. An application to hospitals’ technical efficiency illustrates the usefulness of the new approach.