Nonparametric regression function estimation using interaction least squares splines and comlexity regularization

Let (X, Y) be a pair of random variables withsupp(X)⊆[0,1] ^l andEY ²<∞. Letm ^* be the best approximation of the regression function of (X, Y) by sums of functions of at mostd variables (1≤d≤l). Estimation ofm ^* from i.i.d. data is considered. For the estimation interaction least squares splines, which are defined as sums of polynomial tensor product splines of at mostd variables, are used. The knot sequences of the tensor product splines are chosen equidistant. Complexity regularization is used to choose the number of the knots and the degree of the splines automatically using only the given data. Without any additional condition on the distribution of (X, Y) the weak and strongL ₂-consistency of the estimate is shown. Furthermore, for everyp≥1 and every distribution of (X, Y) withsupp(X)⊆[0,1] ^l ,y bounded andm ^* p-smooth, the integrated squared error of the estimate achieves up to a logarithmic factor the (optimal) rate      

Nonparametric least squares methods for stochastic frontier models

When analyzing productivity and efficiency of firms, stochastic frontier models are very attractive because they allow, as in typical regression models, to introduce some noise in the Data Generating Process . Most of the approaches so far have been using very restrictive fully parametric specified models, both for the frontier function and for the components of the stochastic terms. Recently, local MLE approaches were introduced to relax these parametric hypotheses. In this work we show that most of the benefits of the local MLE approach can be obtained with less assumptions and involving much easier, faster and numerically more robust computations, by using nonparametric least-squares methods. Our approach can also be viewed as a semi-parametric generalization of the so-called “modified OLS” that was introduced in the parametric setup. If the final evaluation of individual efficiencies requires, as in the local MLE approach, the local specification of the distributions of noise and inefficiencies, it is shown that a lot can be learned on the production process without such specifications. Even elasticities of the mean inefficiency can be analyzed with unspecified noise distribution and a general class of local one-parameter scale family for inefficiencies. This allows to discuss the variation in inefficiency levels with respect to explanatory variables with minimal assumptions on the Data Generating Process.     

Nonparametric estimation and inference about the overlap of two distributions

This paper develops methodology for nonparametric estimation of a measure of the overlap of two distributions based on kernel estimation techniques. This quantity has been proposed as a measure of economic polarization between two groups, Anderson (2004) and Anderson et al. (2010). In ecology it has been used to measure the overlap of species. We give the asymptotic distribution theory of our estimator, which in some cases of practical relevance is nonstandard due to a boundary value problem. We also propose a method for conducting inference based on estimation of unknown quantities in the limiting distribution and show that our method yields consistent inference in all cases we consider. We investigate the finite sample properties of our methods by simulation methods. We give an application to the study of polarization within China in recent years using household survey data from two provinces taken in 1987 and 2001. We find a big increase in polarization between 1987 and 2001 according to monetary outcomes but less change in terms of living space.     

Mean estimation bias in least squares estimation of autoregressive processes

Estimation of the parameters of an autoregressive process with a mean that is a function of time is considered. Approximate expressions for the bias of the least squares estimator of the autoregressive parameters that is due to estimating the unknown mean function are derived. For the case of a mean function that is a polynomial in time, a reparameterization that isolates the bias is given. Using the approximate expressions, a method of modifying the least squares estimator is proposed. A Monte Carlo study of the second-order autoregressive process is presented. The Monte Carlo results agree well with the approximate theory and, generally speaking, the modified least squares estimators performed better than the least squares estimator. For the second-order process we also considered the empirical properties of the estimated generalized least squares estimator of the mean function and the error made in predicting the process one, two and three periods in the future.     

Estimation and inference in unstable nonlinear least squares models

There is compelling evidence that many macroeconomic and financial variables are not generated by linear models. This evidence is based on testing linearity against either smooth nonlinearity or piece-wise linearity, but there is no framework that encompasses both. This paper provides an econometric framework that allows for both breaks and smooth nonlinearity in between breaks. We estimate the unknown break-dates simultaneously with other parameters via nonlinear least-squares. Using new central limit results for nonlinear processes, we provide inference methods on break-dates and parameter estimates and several instability tests. We illustrate our methods via simulated and empirical smooth transition models with breaks.     

Nonparametric estimation of conditional VaR and expected shortfall

This paper considers a new nonparametric estimation of conditional value-at-risk and expected shortfall functions. Conditional value-at-risk is estimated by inverting the weighted double kernel local linear estimate of the conditional distribution function. The nonparametric estimator of conditional expected shortfall is constructed by a plugging-in method. Both the asymptotic normality and consistency of the proposed nonparametric estimators are established at both boundary and interior points for time series data. We show that the weighted double kernel local linear conditional distribution estimator has the advantages of always being a distribution, continuous, and differentiable, besides the good properties from both the double kernel local linear and weighted Nadaraya–Watson estimators. Moreover, an ad hoc data-driven fashion bandwidth selection method is proposed, based on the nonparametric version of the Akaike information criterion. Finally, an empirical study is carried out to illustrate the finite sample performance of the proposed estimators.     

Nonparametric estimation of distributional policy effects

This paper proposes a fully nonparametric procedure to evaluate the effect of a counterfactual change in the distribution of some covariates on the unconditional distribution of an outcome variable of interest. In contrast to other methods, we do not restrict attention to the effect on the mean. In particular, our method can be used to conduct inference on the change of the distribution function as a whole, its moments and quantiles, inequality measures such as the Lorenz curve or Gini coefficient, and to test for stochastic dominance. The practical applicability of our procedure is illustrated via a simulation study and an empirical example.     

A smoothed least squares estimator for threshold regression models

We propose a smoothed least squares estimator of the parameters of a threshold regression model. Our model generalizes that considered in Hansen [2000. Sample splitting and threshold estimation. Econometrica 68, 575–603] to allow the thresholding to depend on a linear index of observed regressors, thus allowing discrete variables to enter. We also do not assume that the threshold effect is vanishingly small. Our estimator is shown to be consistent and asymptotically normal thus facilitating standard inference techniques based on estimated standard errors or standard bootstrap for the slope and threshold parameters.     

Two-step two-stage least squares estimation in models with rational expectations

The paper develops a two-step estimator for use in rational-expectations models with autocorrelated residuals and predetermined, but not strictly exogenous, instruments. The estimator extends the applicability of McCallum's (1976) error-in-variablesapproach to estimating such models, and is asymptotically efficient in a class of intrumental-variables estimators. As an application we use instrumental-variables techniques to estimate Taylor's (1979) rational-expectations macroeconomic model of the United States.     

Local indirect least squares and average marginal effects in nonseparable structural systems

We study the scope of local indirect least squares (LILS) methods for nonparametrically estimating average marginal effects of an endogenous cause X on a response Y in triangular structural systems that need not exhibit linearity, separability, or monotonicity in scalar unobservables. One main finding is negative: in the fully nonseparable case, LILS methods cannot recover the average marginal effect. LILS methods can nevertheless test the hypothesis of no effect in the general nonseparable case. We provide new nonparametric asymptotic theory, treating both the traditional case of observed exogenous instruments Z and the case where one observes only error-laden proxies for Z.     

Nonparametric estimation and inference on conditional quantile processes

This paper presents estimation methods and asymptotic theory for the analysis of a nonparametrically specified conditional quantile process. Two estimators based on local linear regressions are proposed. The first estimator applies simple inequality constraints while the second uses rearrangement to maintain quantile monotonicity. The bandwidth parameter is allowed to vary across quantiles to adapt to data sparsity. For inference, the paper first establishes a uniform Bahadur representation and then shows that the two estimators converge weakly to the same limiting Gaussian process. As an empirical illustration, the paper considers a dataset from Project STAR and delivers two new findings.     

More efficient estimation under non-normality when higher moments do not depend on the regressors,using residual augmented least squares

Under normality, least squares is efficient. However, if the errors are not normal, we can gain efficiency from the assertion that higher moments do not depend on the regressors. In this paper, we show how the assumption that higher moments do not depend on the regressors can be exploited in a GMM framework, and we provide simple estimators that are asymptotically equivalent to the GMM estimators. These estimators can be calculated by linear regressions which have been augmented with functions of the least squares residuals.     

Difference in difference meets generalized least squares: Higher order properties of hypotheses tests

We investigate the estimation and inference in difference in difference econometric models used in the analysis of treatment effects. When the innovations in such models display serial correlation, commonly used ordinary least squares (OLS) procedures are inefficient and may lead to tests with incorrect size. Implementation of feasible generalized least squares (FGLS) procedures is often hindered by too few observations in the cross-section to allow for unrestricted estimation of the weight matrix without leading to tests with similar size distortions as conventional OLS based procedures. We analyze the small sample properties of FGLS based tests with a formal higher order Edgeworth expansion that allows us to construct a size corrected version of the test. We also address the question of optimal temporal aggregation as a method to reduce the dimension of the weight matrix. We apply our procedure to data on regulation of mobile telephone service prices. We find that a size corrected FGLS based test outperforms tests based on OLS.     

Nonparametric estimation in case of endogenous selection

This paper addresses the problem of estimation of a nonparametric regression function from selectively observed data when selection is endogenous. Our approach relies on independence between covariates and selection conditionally on potential outcomes. Endogeneity of regressors is also allowed for. In the exogenous and endogenous case, consistent two-step estimation procedures are proposed and their rates of convergence are derived. Pointwise asymptotic distribution of the estimators is established. In addition, bootstrap uniform confidence bands are obtained. Finite sample properties are illustrated in a Monte Carlo simulation study and an empirical illustration.     

Nonparametric IV estimation of local average treatment effects with covariates

In this paper nonparametric instrumental variable estimation of local average treatment effects (LATE) is extended to incorporate covariates. Estimation of LATE is appealing since identification relies on much weaker assumptions than the identification of average treatment effects in other nonparametric instrumental variable models. Including covariates in the estimation of LATE is necessary when the instrumental variable itself is confounded, such that the IV assumptions are valid only conditional on covariates. Previous approaches to handle covariates in the estimation of LATE relied on parametric or semiparametric methods. In this paper, a nonparametric estimator for the estimation of LATE with covariates is suggested that is root-n asymptotically normal and efficient.     

Asymptotic normality of narrow-band least squares in the stationary fractional cointegration model and volatility forecasting

We consider semiparametric frequency domain analysis of cointegration between long memory processes, i.e. fractional cointegration, allowing derivation of useful long-run relations even among stationary processes. The approach is due to Robinson (1994b. Annals of Statistics 22, 515–539) and uses a degenerating part of the periodogram near the origin to form a narrow-band frequency domain least squares (FDLS) estimator of the cointegrating relation, which is consistent for arbitrary short-run dynamics. We derive the asymptotic distribution theory for the FDLS estimator of the cointegration vector in the stationary long memory case, thus complementing Robinson's consistency result. An application to the relation between the volatility realized in the stock market and the associated implicit volatility derived from option prices is offered.     

Improved forecasting of autoregressive series by weighted least squares approximate REML estimation

Restricted maximum likelihood (REML) estimation has recently been shown to provide less biased estimates in autoregressive series. A simple weighted least squares approximate REML procedure has been developed that is particularly useful for vector autoregressive processes. Here, we compare the forecasts of such processes using both the standard ordinary least squares (OLS) estimates and the new approximate REML estimates. Forecasts based on the approximate REML estimates are found to provide a significant improvement over those obtained using the standard OLS estimates.     

Approximating the distribution of the two-stage least squares estimator when the concentration parameter is small

This paper presents a new approximation to the exact sampling distribution of the instrumental variables estimator in simultaneous equations models. It differs from many of the approximations currently available, Edgeworth expansions for example, in that it is specifically designed to work well when the concentration parameter is small. The approximation is remarkable in that simultaneously: (i) it has an extremely simple final form; (ii) in situations for which it is designed it is typically much more accurate than is the large sample normal approximation; and (iii) it is able to capture most of those stylized facts that characterize lack of identification and weak instrument scenarios. The development leading to the approximation is also novel in that it introduces techniques of some independent interest not seen in this literature hitherto.     

Bilateral matching with Latin squares

We develop a general procedure to construct pairwise meeting processes characterized by two features. First, in each period the process maximizes the number of matches in the population. Second, over time agents meet everybody else exactly once. We call this type of meetings “absolute strangers.” Our methodological contribution to economics is to offer a simple procedure to construct a type of decentralized trading environments usually employed in both theoretical and experimental economics. In particular, we demonstrate how to make use of the mathematics of Latin squares to enrich the modeling of matching economies.     

Semiparametric estimation in models of first-price,sealed-bid auctions with affiliation

Within the affiliated private-values paradigm, we develop a tractable empirical model of equilibrium behaviour at first-price, sealed-bid auctions. The model is non-parametrically identified, but the rate of convergence in estimation is slow when the number of bidders is even moderately large, so we develop a semiparametric estimation strategy, focusing on the Archimedean family of copulae and implementing this framework using particular members—the Clayton, Frank, and Gumbel copulae. We apply our framework to data from low-price, sealed-bid auctions used by the Michigan Department of Transportation to procure road-resurfacing services, rejecting the hypothesis of independence and finding significant (and high) affiliation in cost signals.