Stochastic non-smooth envelopment of data: semi-parametric frontier estimation subject to shape constraints

The field of productive efficiency analysis is currently divided between two main paradigms: the deterministic, nonparametric Data Envelopment Analysis (DEA) and the parametric Stochastic Frontier Analysis (SFA). This paper examines an encompassing semiparametric frontier model that combines the DEA-type nonparametric frontier, which satisfies monotonicity and concavity, with the SFA-style stochastic homoskedastic composite error term. To estimate this model, a new two-stage method is proposed, referred to as Stochastic Non-smooth Envelopment of Data (StoNED). The first stage of the StoNED method applies convex nonparametric least squares (CNLS) to estimate the shape of the frontier without any assumptions about its functional form or smoothness. In the second stage, the conditional expectations of inefficiency are estimated based on the CNLS residuals, using the method of moments or pseudolikelihood techniques. Although in a cross-sectional setting distinguishing inefficiency from noise in general requires distributional assumptions, we also show how these can be relaxed in our approach if panel data are available. Performance of the StoNED method is examined using Monte Carlo simulations.     

Stochastic FDH/DEA estimators for frontier analysis

In this paper we extend the work of Simar (J Product Ananl 28:183–201, 2007) introducing noise in nonparametric frontier models. We develop an approach that synthesizes the best features of the two main methods in the estimation of production efficiency. Specifically, our approach first allows for statistical noise, similar to Stochastic frontier analysis (even in a more flexible way), and second, it allows modelling multiple-inputs-multiple-outputs technologies without imposing parametric assumptions on production relationship, similar to what is done in non-parametric methods, like Data Envelopment Analysis (DEA), Free Disposal Hull (FDH), etc.... The methodology is based on the theory of local maximum likelihood estimation and extends recent works of Kumbhakar et al. (J Econom 137(1):1–27, 2007) and Park et al. (J Econom 146:185–198, 2008). Our method is suitable for modelling and estimation of the marginal effects onto inefficiency level jointly with estimation of marginal effects of input. The approach is robust to heteroskedastic cases and to various (unknown) distributions of statistical noise and inefficiency, despite assuming simple anchorage models. The method also improves DEA/FDH estimators, by allowing them to be quite robust to statistical noise and especially to outliers, which were the main problems of the original DEA/FDH estimators. The procedure shows great performance for various simulated cases and is also illustrated for some real data sets. Even in the single-output case, our simulated examples show that our stochastic DEA/FDH improves the Kumbhakar et al. (J Econom 137(1):1–27, 2007) method, by making the resulting frontier smoother, monotonic and, if we wish, concave.     

Nonparametric estimation of the determinants of inefficiency

We consider the benchmark stochastic frontier model where inefficiency is directly influenced by observable determinants. In this setting, we estimate the stochastic frontier and the conditional mean of inefficiency without imposing any distributional assumptions. To do so we cast this model in the partly linear regression framework for the conditional mean. We provide a test of correct parametric specification of the scaling function. An empirical example is also provided to illustrate the practical value of the methods described here.     

A General Method of Deriving the Inefficiencies of Banks from a Profit Function

This article develops a new method of estimating inefficiencies in joint production and shows that unlike the approaches utilized in the previous studies of inefficiency, this method maintains a consistent relationship between the error term of a profit function and the error terms of its price derivatives. A useful by-product of the method is a proof of a Hotelling-like lemma that relates stochastic input demand and output supply functions to stochastic profit functions. While the previous studies fit a single frontier to data on all firms, this paper estimates a frontier unique to every observed firm to allow each one to have a different potential of achieving maximal levels of profit. The new method is applied in the analysis of annual data, 1984–1989, for U.S. commercial banks. Both the analytical and numerical results of the paper show that the residual that the previous studies attribute to inefficiency includes the effects of excluded variables and of inaccuracies in the specified functional forms. Once accurate estimates of these effects are subtracted from the residual, the distortions in the measured inefficiencies should be considerably reduced. Consequently, this article considers how such estimates might be obtained.     

Technical efficiency in competing panel data models: a study of Norwegian grain farming

Estimation of technical efficiency is widely used in empirical research using both cross-sectional and panel data. Although several stochastic frontier models for panel data are available, only a few of them are normally applied in empirical research. In this article we chose a broad selection of such models based on different assumptions and specifications of heterogeneity, heteroskedasticity and technical inefficiency. We applied these models to a single dataset from Norwegian grain farmers for the period 2004–2008. We also introduced a new model that disentangles firm effects from persistent (time-invariant) and residual (time-varying) technical inefficiency. We found that efficiency results are quite sensitive to how inefficiency is modeled and interpreted. Consequently, we recommend that future empirical research should pay more attention to modeling and interpreting inefficiency as well as to the assumptions underlying each model when using panel data.     

Technical efficiency and firm heterogeneity in stochastic frontier models: application to smallholder maize farms in Ethiopia

This study estimates the technical efficiency measures of maize producing farm households in Ethiopia using stochastic frontier (SF) panel models that take different approaches to model firm heterogeneity. The efficiency measures are found to vary depending on how the estimation model treats both unobserved and observed firm heterogeneity. Estimates from the ‘true’ random effects (TRE) models that treat firm effects as heterogeneity are found to be identical to those from pooled SF models. Those results differ from the ones generated from the basic random effects (RE) models that treat firm effects as part of overall technical inefficiency. The more flexible generalised ‘true’ random effects (GTRE) model that splits the error term into firm effects, persistent inefficiency, transient inefficiency, and a random noise component indicates the presence of higher levels of persistent inefficiency than transient inefficiency. The basic truncated-normal RE model and heteroscedastic RE model yields similar efficiency estimates. The GTRE model predict persistent efficiency measures similar to those from the basic RE and flexible RE model with environmental variables incorporated in the variance function as well as in the deterministic production frontier. These results imply that the RE and GTRE panel models provide reliable efficiency estimates for our data compared to the TRE models. All the estimated SF models generate comparable production function parameters in terms of magnitude and sign. Overall, the results underscore the importance of scrutinising stochastic frontier models for their reliability of analytical results before drawing policy inferences.

     

Estimation of the two-tiered stochastic frontier model with the scaling property

The two-tiered stochastic frontier model has enjoyed success across a range of application domains where it is believed that incomplete information on both sides of the market leads to surplus which buyers and sellers can extract. Currently, this model is hindered by the fact that estimation relies on very restrictive distributional assumptions on the behavior of incomplete information on both sides of the market. However, this reliance on specific parametric distributional assumptions can be eschewed if the scaling property is invoked. The scaling property has been well studied in the stochastic frontier literature, but as of yet, has not been used in the two-tier frontier setting.     

Using DEA to Identify and Manage Congestion

This paper deals with identifying and managing congestion. For this purpose, DEA (Data Envelopment Analysis) is used to identify congestion when the data show it to be present, estimate its amounts, and separate it from other forms of inefficiency. DEA is also used to identify where improvements may be made in the management of congestion and to estimate input decreases and output increases that may be made after managerial inefficiencies in managing congestion are eliminated. The treatment here differs from the usual approaches that are restricted to identifying sources and amounts of technical inefficiency and congestion to be eliminated. The focus is directed rather to efficiency of performances in the presence of inefficiencies imposed by, say, labor contracts or government regulations and policies. Other developments include a use of rates of substitution formulated in terms of slack variables that help to avoid instabilities associated with the very small values that are often encountered in the use of dual variables to determine the rates of substitution. These rates of substitution are intended for use in guiding allocations (or reallocations) of inputs between different plants (or other entities) in ways that can further improve performance without reducing the congesting inputs that are to be employed. Hence modifications are needed to extend the usual restrictions to movements on the efficiency frontier so that frontiers associated with congestion and other inefficiencies can be dealt with.     

A Stochastic Frontier Production Function with Flexible Risk Properties

This paper considers a stochastic frontier production function which has additive, heteroscedastic error structure. The model allows for negative or positive marginal production risks of inputs, as originally proposed by Just and Pope (1978). The technical efficiencies of individual firms in the sample are a function of the levels of the input variables in the stochastic frontier, in addition to the technical inefficiency effects. These are two features of the model which are not exhibited by the commonly used stochastic frontiers with multiplicative error structures.An empirical application is presented using cross-sectional data on Ethiopian peasant farmers. The null hypothesis of no technical inefficiencies of production among these farmers is accepted. Further, the flexible risk models do not fit the data on peasant farmers as well as the traditional stochastic frontier model with multiplicative error structure.     

Inefficiency Spillovers in Five OECD Countries: An Interindustry Analysis

Empirical studies have widely demonstrated that real-world activities are rarely on their production frontier. Hence, an obvious concern arises towards the detection of inefficiencies affecting sectoral performances. The current literature and practice have widely explored the sources of inefficiency internal to decision-making units. This paper argues that a major role is played by external effects due to inefficiency spillovers propagating through interindustry transactions. In order to take this mechanism into account, the paper suggests assessing sectoral performances by a system approach that makes use of shadow prices of intermediate inputs. Our approach is able to disentangle sectoral inefficiencies into internal sectoral inefficiencies and inefficiencies imported from other sectors. The latter component is due to inefficiency spillovers that appear to be empirically relevant in all sectors of five OECD countries.     

Estimation and testing of stochastic frontier models using variational Bayes

We show how a wide range of stochastic frontier models can be estimated relatively easily using variational Bayes. We derive approximate posterior distributions and point estimates for parameters and inefficiency effects for (a) time invariant models with several alternative inefficiency distributions, (b) models with time varying effects, (c) models incorporating environmental effects, and (d) models with more flexible forms for the regression function and error terms. Despite the abundance of stochastic frontier models, there have been few attempts to test the various models against each other, probably due to the difficulty of performing such tests. One advantage of the variational Bayes approximation is that it facilitates the computation of marginal likelihoods that can be used to compare models. We apply this idea to test stochastic frontier models with different inefficiency distributions. Estimation and testing is illustrated using three examples.     

Stochastic frontier models with network selectivity

Worker peer-effects and managerial selection have received limited attention in the stochastic frontier analysis literature. We develop a parametric production function model that allows for worker peer-effects in output and worker-level inefficiency that is correlated with a manager’s selection of worker teams. The model is the usual “composed error” specification of the stochastic frontier model, but we allow for managerial selectivity (endogeneity) that works through the worker-level inefficiency term. The new specification captures both worker-level inefficiency and the manager’s ability to efficiently select teams to produce output. As the correlation between the manager’s selection equation and worker inefficiency goes to zero, our parametric model reduces to the normal-exponential stochastic frontier model of Aigner et al. (1977) with peer-effects. A comprehensive application to the NBA is provided.     

A Recursive Thick Frontier Approach to Estimating Production Efficiency*

We introduce a new panel data estimation technique for production and cost functions, the recursive thick frontier approach (RTFA). RTFA has two advantages over existing econometric frontier methods. First, technical inefficiency is allowed to be dependent on the explanatory variables of the frontier model. Secondly, RTFA does not hinge on distributional assumptions on the inefficiency component of the error term. We show by means of simulation experiments that RTFA outperforms the popular stochastic frontier approach and the ‘within’ ordinary least squares estimator for realistic parameterizations of a productivity model. Although RTFAs formal statistical properties are unknown, we argue, based on these simulation experiments, that RTFA is a useful complement to existing methods.     

Fixed and Random Effects in Stochastic Frontier Models

Received stochastic frontier analyses with panel data have relied on traditional fixed and random effects models. We propose extensions that circumvent two shortcomings of these approaches. The conventional panel data estimators assume that technical or cost inefficiency is time invariant. Second, the fixed and random effects estimators force any time invariant cross unit heterogeneity into the same term that is being used to capture the inefficiency. Inefficiency measures in these models may be picking up heterogeneity in addition to or even instead of inefficiency. A fixed effects model is extended to the stochastic frontier model using results that specifically employ the nonlinear specification. The random effects model is reformulated as a special case of the random parameters model. The techniques are illustrated in applications to the U.S. banking industry and a cross country comparison of the efficiency of health care delivery.JEL classification: C1, C4     

A zero inefficiency stochastic frontier model

Traditional stochastic frontier models impose inefficient behavior on all firms in the sample of interest. If the data under investigation represent a mixture of both fully efficient and inefficient firms then off-the-shelf frontier models are statistically inadequate. We introduce the zero inefficiency stochastic frontier model which can accommodate the presence of both efficient and inefficient firms in the sample. We derive the corresponding log-likelihood function, conditional mean of inefficiency, to estimate observation-specific inefficiency and discuss testing for the presence of fully efficient firms. We provide both simulated evidence as well as an empirical example which demonstrates the applicability of the proposed method.     

Pitfalls of Normal-Gamma Stochastic Frontier Models

Although conceptually pleasing, normal-gamma frontier models lead to difficult estimation problems. It is shown here that unless the sample size reaches several thousands of observations the shape parameter of the gamma density is hard to estimate, and that this carries over to estimates of the stochastic frontier, the individual inefficiencies, and the allocation of the overall variance to the stochastic frontier and to the inefficiencies.     

Panel estimators and the identification of firm-specific efficiency levels in parametric,semiparametric and nonparametric settings

The paper analyzes a number of competing approaches to modeling efficiency in panel studies. The specifications considered include the fixed effects stochastic frontier, the random effects stochastic frontier, the Hausman–Taylor random effects stochastic frontier, and the random and fixed effects stochastic frontier with an AR(1) error. I have summarized the foundations and properties of estimators that have appeared elsewhere and have described the model assumptions under which each of the estimators have been developed. I discuss parametric and nonparametric treatments of time varying efficiency including the Battese–Coelli estimator and linear programming approaches to efficiency measurement. Monte Carlo simulation is used to compare the various estimators and to assess their relative performances under a variety of misspecified settings. A brief illustration of the estimators is conducted using U.S. banking data.     

The Components of Output Growth: A Stochastic Frontier Analysis

This paper uses Bayesian stochastic frontier methods to decompose output change into technical, efficiency and input changes. In the context of macroeconomic growth exercises, which typically involve small and noisy data sets, we argue that stochastic frontier methods are useful since they incorporate measurement error and assume a (flexible) parametric form for the production relationship. These properties enable us to calculate measures of uncertainty associated with the decomposition and minimize the risk of overfitting the noise in the data. Tools for Bayesian inference in such models are developed. An empirical investigation using data from 17 OECD countries for 10 years illustrates the practicality and usefulness of our approach.     

Aspects of statistical analysis in DEA-type frontier models

In Grosskopf (1995) and Banker (1995) different approaches and problems of statistical inference in DEA frontier models are presented. This paper focuses on the basic characteristics of DEA models from a statistical point of view. It arose from comments and discussions on both papers above. The framework of DEA models is deterministic (all the observed points lie on the same side of the frontier), nevertheless a stochastic model can be constructed once a data generating process is defined. So statistical analysis may be performed and sampling properties of DEA estimators can be established. However, practical statistical inference (such as test of hypothesis, confidence intervals) still needs artifacts like the bootstrap to be performed. A consistent bootstrap relies also on a clear definition of the data generating proces and on a consistent estimator of it: The approach of Simar and Wilson (1995) is described. Finally, some trails are proposed for introducing stochastic noise in DEA models, in the spirit of the Kneip-Simar (1995) approach.     

Parametric approximations of nonparametric frontiers

The maximal achievable level of output for a given level of inputs defines the production frontier that can serve as benchmark to evaluate individual firm efficiencies. Nonparametric envelopment estimators (free disposal hull, data envelopment analysis) have been mostly used because they rely on very few assumptions, whereas parametric forms for the frontier allow for richer economic interpretation. Most of the parametric approaches rely on standard regression fitting the shape of the center of the cloud of points. In this paper, we investigated a new approach, which captures the shape of the cloud points near its boundary. It offers parametric approximations of nonparametric frontiers. We provide the statistical theory (asymptotic). Some simulated examples show the advantages of our method compared with the usual regression-type estimators.