Statistical inference on seemingly unrelated non‐parametric regression models with serially correlated errors

This article is concerned with the inference on seemingly unrelated non‐parametric regression models with serially correlated errors. Based on an initial estimator of the mean functions, we first construct an efficient estimator of the autoregressive parameters of the errors. Then, by applying an undersmoothing technique, and taking both of the contemporaneous correlation among equations and serial correlation into account, we propose an efficient two‐stage local polynomial estimation for the unknown mean functions. It is shown that the resulting estimator has the same bias as those estimators which neglect the contemporaneous and/or serial correlation and smaller asymptotic variance. The asymptotic normality of the resulting estimator is also established. In addition, we develop a wild block bootstrap test for the goodness‐of‐fit of models. The finite sample performance of our procedures is investigated in a simulation study whose results come out very supportive, and a real data set is analysed to illustrate the usefulness of our procedures.     

Variable selection for additive partially linear models with measurement error

Variable selection for additive partially linear models with measurement error is considered. By the backfitting technique, we first propose a variable selection procedure for the parametric components based on the smoothly clipped absolute deviation (SCAD) penalization, and one-step spare estimates for parametric components are also presented. The resulting estimates perform asymptotic normality as well as an oracle property. Then, two-stage backfitting estimators are also presented for the nonparametric components by using the local linear method, and the structures of asymptotic biases and covariances of the proposed estimators are the same as those in partially linear model with measurement error. The finite sample performance of the proposed procedures is illustrated by simulation studies.     

Estimation in monotone single‐index models

Single‐index models are popular regression models that are more flexible than linear models and still maintain more structure than purely nonparametric models. We consider the problem of estimating the regression parameters under a monotonicity constraint on the unknown link function. In contrast to the standard approach of using smoothing techniques, we review different “non‐smooth” estimators that avoid the difficult smoothing parameter selection. For about 30 years, one has had the conjecture that the profile least squares estimator is an ‐consistent estimator of the regression parameter, but the only non‐smooth argmin/argmax estimators that are actually known to achieve this ‐rate are not based on the nonparametric least squares estimator of the link function. However, solving a score equation corresponding to the least squares approach results in ‐consistent estimators. We illustrate the good behavior of the score approach via simulations. The connection with the binary choice and current status linear regression models is also discussed.     

Estimating panel data models in the presence of endogeneity and selection

We consider estimation of panel data models with sample selection when the equation of interest contains endogenous explanatory variables as well as unobserved heterogeneity. Assuming that appropriate instruments are available, we propose several tests for selection bias and two estimation procedures that correct for selection in the presence of endogenous regressors. The tests are based on the fixed effects two-stage least squares estimator, thereby permitting arbitrary correlation between unobserved heterogeneity and explanatory variables. The first correction procedure is parametric and is valid under the assumption that the errors in the selection equation are normally distributed. The second procedure estimates the model parameters semiparametrically using series estimators. In the proposed testing and correction procedures, the error terms may be heterogeneously distributed and serially dependent in both selection and primary equations. Because these methods allow for a rather flexible structure of the error variance and do not impose any nonstandard assumptions on the conditional distributions of explanatory variables, they provide a useful alternative to the existing approaches presented in the literature.     

Nonlinear regression models with single‐index heteroscedasticity

We consider nonlinear heteroscedastic single‐index models where the mean function is a parametric nonlinear model and the variance function depends on a single‐index structure. We develop an efficient estimation method for the parameters in the mean function by using the weighted least squares estimation, and we propose a “delete‐one‐component” estimator for the single‐index in the variance function based on absolute residuals. Asymptotic results of estimators are also investigated. The estimation methods for the error distribution based on the classical empirical distribution function and an empirical likelihood method are discussed. The empirical likelihood method allows for incorporation of the assumptions on the error distribution into the estimation. Simulations illustrate the results, and a real chemical data set is analyzed to demonstrate the performance of the proposed estimators.     

On solving bias‐corrected non‐linear estimation equations with an application to the dynamic linear model

In a seminal paper, Mak, Journal of the Royal Statistical Society B, 55, 1993, 945, derived an efficient algorithm for solving non‐linear unbiased estimation equations. In this paper, we show that when Mak's algorithm is applied to biased estimation equations, it results in the estimates that would come from solving a bias‐corrected estimation equation, making it a consistent estimator if regularity conditions hold. In addition, the properties that Mak established for his algorithm also apply in the case of biased estimation equations but for estimates from the bias‐corrected equations. The marginal likelihood estimator is obtained when the approach is applied to both maximum likelihood and least squares estimation of the covariance matrix parameters in the general linear regression model. The new approach results in two new estimators when applied to the profile and marginal likelihood functions for estimating the lagged dependent variable coefficient in the dynamic linear regression model. Monte Carlo simulation results show the new approach leads to a better estimator when applied to the standard profile likelihood. It is therefore recommended for situations in which standard estimators are known to be biased.     

Robust Small Area Estimation under Spatial Non‐stationarity

The effective use of spatial information in a regression‐based approach to small area estimation is an important practical issue. One approach to account for geographic information is by extending the linear mixed model to allow for spatially correlated random area effects. An alternative is to include the spatial information by a non‐parametric mixed models. Another option is geographic weighted regression where the model coefficients vary spatially across the geography of interest. Although these approaches are useful for estimating small area means efficiently under strict parametric assumptions, they can be sensitive to outliers. In this paper, we propose robust extensions of the geographically weighted empirical best linear unbiased predictor. In particular, we introduce robust projective and predictive estimators under spatial non‐stationarity. Mean squared error estimation is performed by two analytic approaches that account for the spatial structure in the data. Model‐based simulations show that the methodology proposed often leads to more efficient estimators. Furthermore, the analytic mean squared error estimators introduced have appealing properties in terms of stability and bias. Finally, we demonstrate in the application that the new methodology is a good choice for producing estimates for average rent prices of apartments in urban planning areas in Berlin.     

Partially varying coefficient instrumental variables models

In this article, we study a new class of semiparametric instrumental variables models, in which the structural function has a partially varying coefficient functional form. Under this specification, the model is linear in the endogenous/exogenous components with unknown constant or functional coefficients. As a result, the ill‐posed inverse problem in a general non‐parametric model with continuous endogenous variables can be avoided. We propose a three‐step estimation procedure for estimating both constant and functional coefficients and establish their asymptotic properties such as consistency and asymptotic normality. We develop consistent estimators for their error variances. We demonstrate that the constant coefficient estimators achieve the optimal ‐convergence rate, and the functional coefficient estimators are oracle. In addition, efficiency issue of the parameter estimation is discussed and a simple efficient estimator is proposed. The proposed procedure is illustrated via a Monte Carlo simulation and an application to returns to education.     

Partially generalized least squares and two-stage least squares estimators

A class of partially generalized least squares estimators and a class of partially generalized two-stage least squares estimators in regression models with heteroscedastic errors are proposed. By using these estimators a researcher can attain higher efficiency than that attained by the least squares or the two-stage least squares estimators without explicitly estimating each component of the heteroscedastic variances. However, the efficiency is not as high as that of the generalized least squares or the generalized two-stage least squares estimator calculated using the knowledge of the true variances. Hence the use of the term partial.     

Application of one‐step method to parameter estimation in ODE models

In this paper, we study application of Le Cam's one‐step method to parameter estimation in ordinary differential equation models. This computationally simple technique can serve as an alternative to numerical evaluation of the popular non‐linear least squares estimator, which typically requires the use of a multistep iterative algorithm and repetitive numerical integration of the ordinary differential equation system. The one‐step method starts from a preliminary ‐consistent estimator of the parameter of interest and next turns it into an asymptotic (as the sample size n →∞ ) equivalent of the least squares estimator through a numerically straightforward procedure. We demonstrate performance of the one‐step estimator via extensive simulations and real data examples. The method enables the researcher to obtain both point and interval estimates. The preliminary ‐consistent estimator that we use depends on non‐parametric smoothing, and we provide a data‐driven methodology for choosing its tuning parameter and support it by theory. An easy implementation scheme of the one‐step method for practical use is pointed out.     

Improved instrumental variables estimation of simultaneous equations under conditionally heteroskedastic disturbances

In this paper we develop estimation techniques and a specification test for the validity of instrumental variables allowing for conditionally heteroskedastic disturbances. We propose modified two‐stage least squares (2SLS) and modified 3SLS procedures where the conditional heteroskedasticity is taken into account, which are natural extensions of the traditional 2SLS and 3SLS estimators and which achieve a lower variance. We recommend the use of these modified 2SLS and 3SLS procedures in practice instead of alternative estimators like limited‐information maximum likelihood/full‐information maximum likelihood, where the non‐existence of moments leads to extreme values, and also for ease of computation. It is shown theoretically and with simulation that in some cases 2SLS, 3SLS and our modified 2SLS and 3SLS procedures can have very severe biases (including the weak instruments case), and we present bias correction procedures to apply in practice along the lines of Flores‐Lagunes ( 2007 ). Our new estimation procedures can also be used to extend the test for weak instruments of Stock and Yogo ( 2005 ) and to allow for conditional heteroskedasticity. Finally, we show the usefulness of our estimation procedures with an application to the demand and supply of fish. Copyright © 2010 John Wiley & Sons, Ltd.     

TOTAL FACTOR PRODUCTIVITY ESTIMATION: A PRACTICAL REVIEW

Abstract This paper aims to provide empirical researchers with an overview of the methodological issues that arise when estimating total factor productivity at the establishment level, as well as of the existing (parametric and semi‐parametric) techniques designed to overcome them. Apart from the well‐known simultaneity and selection bias, attention is given to methodological issues that have emerged more recently and that are related to the use of deflated values of inputs and outputs (as opposed to quantities) in estimating productivity at the firm level, as well as to the endogeneity of product choice. In discussing the estimation procedures applied in the literature, attention is given to recent developments in the field. Using data on single‐product firms active in the Belgian food and beverages sector, the most commonly applied estimators are illustrated, allowing for comparison of the obtained productivity estimates by way of a simple evaluation exercise.     

Non‐parametric regression in clustered multistate current status data with informative cluster size

Datasets examining periodontal disease records current (disease) status information of tooth‐sites, whose stochastic behavior can be attributed to a multistate system with state occupation determined at a single inspection time. In addition, the tooth‐sites remain clustered within a subject, and the number of available tooth‐sites may be representative of the true periodontal disease status of that subject, leading to an ‘informative cluster size’ scenario. To provide insulation against incorrect model assumptions, we propose a non‐parametric regression framework to estimate state occupation probabilities at a given time and state exit/entry distributions, utilizing weighted monotonic regression and smoothing techniques. We demonstrate the superior performance of our proposed weighted estimators over the unweighted counterparts via a simulation study and illustrate the methodology using a dataset on periodontal disease.     

Mean estimation bias in least squares estimation of autoregressive processes

Estimation of the parameters of an autoregressive process with a mean that is a function of time is considered. Approximate expressions for the bias of the least squares estimator of the autoregressive parameters that is due to estimating the unknown mean function are derived. For the case of a mean function that is a polynomial in time, a reparameterization that isolates the bias is given. Using the approximate expressions, a method of modifying the least squares estimator is proposed. A Monte Carlo study of the second-order autoregressive process is presented. The Monte Carlo results agree well with the approximate theory and, generally speaking, the modified least squares estimators performed better than the least squares estimator. For the second-order process we also considered the empirical properties of the estimated generalized least squares estimator of the mean function and the error made in predicting the process one, two and three periods in the future.     

Weighted least squares estimators in possibly misspecified nonlinear regression

The behavior of estimators for misspecified parametric models has been well studied. We consider estimators for misspecified nonlinear regression models, with error and covariates possibly dependent. These models are described by specifying a parametric model for the conditional expectation of the response given the covariates. This is a parametric family of conditional constraints, which makes the model itself close to nonparametric. We study the behavior of weighted least squares estimators both when the regression function is correctly specified, and when it is misspecified and also involves possible additional covariates.     

Identification and Estimation of Distributional Impacts of Interventions Using Changes in Inequality Measures

This paper presents estimators of distributional impacts of interventions when selection to the program is based on observable characteristics. Distributional impacts are calculated as differences in inequality measures of the marginal distributions of potential outcomes of receiving and not receiving the treatment. The estimation procedure involves a first non‐parametric estimation of the propensity score. In the second step weighted versions of inequality measures are computed using weights based on the estimated propensity score. Consistency, semi‐parametric efficiency and validity of inference based on the percentile bootstrap are shown for the estimators. Results from Monte Carlo exercises show its good performance in small samples. Copyright © 2015 John Wiley & Sons, Ltd.     

Testing for linear vector autoregressive dynamics under multivariate generalized autoregressive heteroskedasticity

In this paper, we propose a fixed design wild bootstrap procedure to test parameter restrictions in vector autoregressive models, which is robust in cases of conditionally heteroskedastic error terms. The wild bootstrap does not require any parametric specification of the volatility process and takes contemporaneous error correlation implicitly into account. Via a Monte Carlo investigation, empirical size and power properties of the method are illustrated for the case of white noise under the null hypothesis. We compare the bootstrap approach with standard ordinary least squares (OLS)-based, weighted least squares (WLS) and quasi-maximum likelihood (QML) approaches. In terms of empirical size, the proposed method outperforms competing approaches and achieves size-adjusted power close to WLS or QML inference. A White correction of standard OLS inference is satisfactory only in large samples. We investigate the case of Granger causality in a bivariate system of inflation expectations in France and the United Kingdom. Our evidence suggests that the former are Granger causal for the latter while for the reverse relation Granger non-causality cannot be rejected.     

Estimation of dynamic panel data models with sample selection

We propose a new method for estimating dynamic panel data models with selection. The method uses backward substitution for the lagged dependent variable, which leads to an estimating equation that requires correcting for contemporaneous selection only. The estimator is valid under relatively weak assumptions about errors and permits avoiding the weak instruments problem associated with differencing. We also propose a simple test for selection bias that is based on the addition of a selection term to the first‐difference equation and subsequent testing for significance of this term. The methods are applied to estimating dynamic earnings equations for women. Copyright © 2011 John Wiley & Sons, Ltd.     

Functional coefficient regression models with time trend

We consider the problem of estimating a varying coefficient regression model when regressors include a time trend. We show that the commonly used local constant kernel estimation method leads to an inconsistent estimation result, while a local polynomial estimator yields a consistent estimation result. We establish the asymptotic normality result for the proposed estimator. We also provide asymptotic analysis of the data-driven (least squares cross validation) method of selecting the smoothing parameters. In addition, we consider a partially linear time trend model and establish the asymptotic distribution of our proposed estimator. Two test statistics are proposed to test the null hypotheses of a linear and of a partially linear time trend models. Simulations are reported to examine the finite sample performances of the proposed estimators and the test statistics.     

A flexible parametric approach for estimating switching regime models and treatment effect parameters

In this paper, we propose a flexible, parametric class of switching regime models allowing for both skewed and fat-tailed outcome and selection errors. Specifically, we model the joint distribution of each outcome error and the selection error via a newly constructed class of multivariate distributions which we call generalized normal mean–variance mixture distributions. We extend Heckman’s two-step estimation procedure for the Gaussian switching regime model to the new class of models. When the distributions of the outcome errors are asymmetric, we show that an additional correction term accounting for skewness in the outcome error distribution (besides the analogue of the well known inverse mill’s ratio) needs to be included in the second step regression. We use the two-step estimators of parameters in the model to construct simple estimators of average treatment effects and establish their asymptotic properties. Simulation results confirm the importance of accounting for skewness in the outcome errors in estimating both model parameters and the average treatment effect and the treatment effect for the treated.