Semiparametric time series regression modeling with a diverging number of parameters

Variable selection and error structure determination of a partially linear model with time series errors are important issues. In this paper, we investigate the regression coefficient and autoregressive order shrinkage and selection via the smoothly clipped absolute deviation penalty for a partially linear model with a divergent number of covariates and finite order autoregressive time series errors. Both consistency and asymptotic normality of the proposed penalized estimators are derived. The oracle property of the resultant estimators is proved. Simulation studies are carried out to assess the finite‐sample performance of the proposed procedure. A real data analysis is made to illustrate the usefulness of the proposed procedure as well.     

Statistical inference on seemingly unrelated varying coefficient partially linear models

This paper is concerned with the statistical inference on seemingly unrelated varying coefficient partially linear models. By combining the local polynomial and profile least squares techniques, and estimating the contemporaneous correlation, we propose a class of weighted profile least squares estimators (WPLSEs) for the parametric components. It is shown that the WPLSEs achieve the semiparametric efficiency bound and are asymptotically normal. For the non‐parametric components, by applying the undersmoothing technique, and taking the contemporaneous correlation into account, we propose an efficient local polynomial estimation. The resulting estimators are shown to have mean‐squared errors smaller than those estimators that neglect the contemporaneous correlation. In addition, a class of variable selection procedures is developed for simultaneously selecting significant variables and estimating unknown parameters, based on the non‐concave penalized and weighted profile least squares techniques. With a proper choice of regularization parameters and penalty functions, the proposed variable selection procedures perform as efficiently as if one knew the true submodels. The proposed methods are evaluated using wide simulation studies and applied to a set of real data.     

Partially varying coefficient instrumental variables models

In this article, we study a new class of semiparametric instrumental variables models, in which the structural function has a partially varying coefficient functional form. Under this specification, the model is linear in the endogenous/exogenous components with unknown constant or functional coefficients. As a result, the ill‐posed inverse problem in a general non‐parametric model with continuous endogenous variables can be avoided. We propose a three‐step estimation procedure for estimating both constant and functional coefficients and establish their asymptotic properties such as consistency and asymptotic normality. We develop consistent estimators for their error variances. We demonstrate that the constant coefficient estimators achieve the optimal ‐convergence rate, and the functional coefficient estimators are oracle. In addition, efficiency issue of the parameter estimation is discussed and a simple efficient estimator is proposed. The proposed procedure is illustrated via a Monte Carlo simulation and an application to returns to education.     

Spatial correlation robust inference with errors in location or distance

This paper presents results from a Monte Carlo study concerning inference with spatially dependent data. We investigate the impact of location/distance measurement errors upon the accuracy of parametric and nonparametric estimators of asymptotic variances. Nonparametric estimators are quite robust to such errors, method of moments estimators perform surprisingly well, and MLE estimators are very poor. We also present and evaluate a specification test based on a parametric bootstrap that has good power properties for the types of measurement error we consider.     

Kernel-weighted GMM estimators for linear time series models

This paper analyzes the higher-order asymptotic properties of generalized method of moments (GMM) estimators for linear time series models using many lags as instruments. A data-dependent moment selection method based on minimizing the approximate mean squared error is developed. In addition, a new version of the GMM estimator based on kernel-weighted moment conditions is proposed. It is shown that kernel-weighted GMM estimators can reduce the asymptotic bias compared to standard GMM estimators. Kernel weighting also helps to simplify the problem of selecting the optimal number of instruments. A feasible procedure similar to optimal bandwidth selection is proposed for the kernel-weighted GMM estimator.     

Nonparametric dynamic panel data models: Kernel estimation and specification testing

Motivated by the first-differencing method for linear panel data models, we propose a class of iterative local polynomial estimators for nonparametric dynamic panel data models with or without exogenous regressors. The estimators utilize the additive structure of the first-differenced model—the fact that the two additive components have the same functional form, and the unknown function of interest is implicitly defined as a solution of a Fredholm integral equation of the second kind. We establish the uniform consistency and asymptotic normality of the estimators. We also propose a consistent test for the correct specification of linearity in typical dynamic panel data models based on the _L2$L_2$ distance of our nonparametric estimates and the parametric estimates under the linear restriction. We derive the asymptotic distributions of the test statistic under the null hypothesis and a sequence of Pitman local alternatives, and prove its consistency against global alternatives. Simulations suggest that the proposed estimators and tests perform well for finite samples. We apply our new method to study the relationships among economic growth, the initial economic condition and capital accumulation, and find a significant nonlinear relation between economic growth and the initial economic condition.     

Estimating panel data models in the presence of endogeneity and selection

We consider estimation of panel data models with sample selection when the equation of interest contains endogenous explanatory variables as well as unobserved heterogeneity. Assuming that appropriate instruments are available, we propose several tests for selection bias and two estimation procedures that correct for selection in the presence of endogenous regressors. The tests are based on the fixed effects two-stage least squares estimator, thereby permitting arbitrary correlation between unobserved heterogeneity and explanatory variables. The first correction procedure is parametric and is valid under the assumption that the errors in the selection equation are normally distributed. The second procedure estimates the model parameters semiparametrically using series estimators. In the proposed testing and correction procedures, the error terms may be heterogeneously distributed and serially dependent in both selection and primary equations. Because these methods allow for a rather flexible structure of the error variance and do not impose any nonstandard assumptions on the conditional distributions of explanatory variables, they provide a useful alternative to the existing approaches presented in the literature.     

Statistical inference on restricted partial linear regression models with partial distortion measurement errors

We consider the estimation and hypothesis testing problems for the partial linear regression models when some variables are distorted with errors by some unknown functions of commonly observable confounding variable. The proposed estimation procedure is designed to accommodate undistorted as well as distorted variables. To test a hypothesis on the parametric components, a restricted least squares estimator is proposed under the null hypothesis. Asymptotic properties for the estimators are established. A test statistic based on the difference between the residual sums of squares under the null and alternative hypotheses is proposed, and we also obtain the asymptotic properties of the test statistic. A wild bootstrap procedure is proposed to calculate critical values. Simulation studies are conducted to demonstrate the performance of the proposed procedure, and a real example is analyzed for an illustration.     

Functional coefficient instrumental variables models

We consider estimation of nonparametric structural models under a functional coefficient representation for the regression function. Under this representation, models are linear in the endogenous components with coefficients given by unknown functions of the predetermined variables, a nonparametric generalization of random coefficient models. The functional coefficient restriction is an intermediate approach between fully nonparametric structural models that are ill posed when endogenous variables are continuously distributed, and partially linear models over which they have appreciable flexibility. We propose two-step estimators that use local linear approximations in both steps. The first step is to estimate a vector of reduced forms of regression models and the second step is local linear regression using the estimated reduced forms as regressors. Our large sample results include consistency and asymptotic normality of the proposed estimators. The high practical power of estimators is illustrated via both a Monte Carlo simulation study and an application to returns to education.     

Semiparametric quantile regression estimation in dynamic models with partially varying coefficients

We study quantile regression estimation for dynamic models with partially varying coefficients so that the values of some coefficients may be functions of informative covariates. Estimation of both parametric and nonparametric functional coefficients are proposed. In particular, we propose a three stage semiparametric procedure. Both consistency and asymptotic normality of the proposed estimators are derived. We demonstrate that the parametric estimators are root-n$n$ consistent and the estimation of the functional coefficients is oracle. In addition, efficiency of parameter estimation is discussed and a simple efficient estimator is proposed. A simple and easily implemented test for the hypothesis of a varying-coefficient is proposed. A Monte Carlo experiment is conducted to evaluate the performance of the proposed estimators.     

Robust Small Area Estimation under Spatial Non‐stationarity

The effective use of spatial information in a regression‐based approach to small area estimation is an important practical issue. One approach to account for geographic information is by extending the linear mixed model to allow for spatially correlated random area effects. An alternative is to include the spatial information by a non‐parametric mixed models. Another option is geographic weighted regression where the model coefficients vary spatially across the geography of interest. Although these approaches are useful for estimating small area means efficiently under strict parametric assumptions, they can be sensitive to outliers. In this paper, we propose robust extensions of the geographically weighted empirical best linear unbiased predictor. In particular, we introduce robust projective and predictive estimators under spatial non‐stationarity. Mean squared error estimation is performed by two analytic approaches that account for the spatial structure in the data. Model‐based simulations show that the methodology proposed often leads to more efficient estimators. Furthermore, the analytic mean squared error estimators introduced have appealing properties in terms of stability and bias. Finally, we demonstrate in the application that the new methodology is a good choice for producing estimates for average rent prices of apartments in urban planning areas in Berlin.     

Logarithmic calibration for multiplicative distortion measurement errors regression models

In this article, we propose a new identifiability condition by using the logarithmic calibration for the distortion measurement error models, where neither the response variable nor the covariates can be directly observed but are measured with multiplicative measurement errors. Under the logarithmic calibration, the direct-plug-in estimators of parameters and empirical likelihood based confidence intervals are proposed, and we studied the asymptotic properties of the proposed estimators. For the hypothesis testing of parameter, a restricted estimator under the null hypothesis and a test statistic are proposed. The asymptotic properties for the restricted estimator and test statistic are established. Simulation studies demonstrate the performance of the proposed procedure and a real example is analyzed to illustrate its practical usage.     

Variable selection and parameter estimation for partially linear models via Dantzig selector

Variable selection plays an important role in the high dimensionality data analysis, the Dantzig selector performs variable selection and model fitting for linear and generalized linear models. In this paper we focus on variable selection and parametric estimation for partially linear models via the Dantzig selector. Large sample asymptotic properties of the Dantzig selector estimator are studied when sample size n tends to infinity while p is fixed. We see that the Dantzig selector might not be consistent. To remedy this drawback, we take the adaptive Dantzig selector motivated by Dicker and Lin (submitted). Moreover, we obtain that the adaptive Dantzig selector estimator for the parametric component of partially linear models has the oracle properties under some appropriate conditions. As generalizations of the Dantzig selector, both the adaptive Dantzig selector and the Dantzig selector optimization can be implemented by the efficient algorithm DASSO proposed by James et al. (J R Stat Soc Ser B 71:127–142, 2009). Choices of tuning parameter and bandwidth are also discussed.     

On kernel nonparametric regression designed for complex survey data

In this article, we consider nonparametric regression analysis between two variables when data are sampled through a complex survey. While nonparametric regression analysis has been widely used with data that may be assumed to be generated from independently and identically distributed (iid) random variables, the methods and asymptotic analyses established for iid data need to be extended in the framework of complex survey designs. Local polynomial regression estimators are studied, which include as particular cases design-based versions of the Nadaraya–Watson estimator and of the local linear regression estimator. In this paper, special emphasis is given to the local linear regression estimator. Our estimators incorporate both the sampling weights and the kernel weights. We derive the asymptotic mean squared error (MSE) of the kernel estimators using a combined inference framework, and as a corollary consistency of the estimators is deduced. Selection of a bandwidth is necessary for the resulting estimators; an optimal bandwidth can be determined, according to the MSE criterion in the combined mode of inference. Simulation experiments are conducted to illustrate the proposed methodology and an application with the Canadian survey of labour and income dynamics is presented.     

Functional coefficient regression models with time trend

We consider the problem of estimating a varying coefficient regression model when regressors include a time trend. We show that the commonly used local constant kernel estimation method leads to an inconsistent estimation result, while a local polynomial estimator yields a consistent estimation result. We establish the asymptotic normality result for the proposed estimator. We also provide asymptotic analysis of the data-driven (least squares cross validation) method of selecting the smoothing parameters. In addition, we consider a partially linear time trend model and establish the asymptotic distribution of our proposed estimator. Two test statistics are proposed to test the null hypotheses of a linear and of a partially linear time trend models. Simulations are reported to examine the finite sample performances of the proposed estimators and the test statistics.     

Parameter estimation and bias correction for diffusion processes

This paper considers parameter estimation for continuous-time diffusion processes which are commonly used to model dynamics of financial securities including interest rates. To understand why the drift parameters are more difficult to estimate than the diffusion parameter, as observed in previous studies, we first develop expansions for the bias and variance of parameter estimators for two of the most employed interest rate processes, Vasicek and CIR processes. Then, we study the first order approximate maximum likelihood estimator for linear drift processes. A parametric bootstrap procedure is proposed to correct bias for general diffusion processes with a theoretical justification. Simulation studies confirm the theoretical findings and show that the bootstrap proposal can effectively reduce both the bias and the mean square error of parameter estimates, for both univariate and multivariate processes. The advantages of using more accurate parameter estimators when calculating various option prices in finance are demonstrated by an empirical study.     

Estimating non-simultaneous changes in the mean of vectors

A sequence of independent vectors with correlated components is considered. It is supposed that there is one change point in the mean of each component and changes need not occur simultaneously. The asymptotic distribution of the change point estimators is studied. If the true change points are well separated, the explicit asymptotic distribution of the change point estimators is presented. In the case the true change points coincide, it is shown that the limit distribution of properly standardized change points estimates exists. It depends not only on the underlying time series dependence structure, but also on the ratio of the sizes of the changes. The asymptotic distribution function is not known, but due to the invariance principle it can be obtained by simulations.     

Asymptotics of SIMEX-based variance estimation

In this paper, we study the asymptotic properties of simulation extrapolation (SIMEX) based variance estimation that was proposed by Wang et al. (J R Stat Soc Series B 71:425–445, 2009). We first investigate the asymptotic normality of the parameter estimator in general parametric variance function and the local linear estimator for nonparametric variance function when permutation SIMEX (PSIMEX) is used. The asymptotic optimal bandwidth selection with respect to approximate mean integrated squared error (AMISE) for nonparametric estimator is also studied. We finally discuss constructing confidence intervals/bands of the parameter/function of interest. Other than applying the asymptotic results so that normal approximation can be used, we recommend a nonparametric Monte Carlo algorithm to avoid estimating the asymptotic variance of estimator. Simulation studies are carried out for illustration.     

部分线性单指数动态面板模型的惩罚二次推断函数估计

本文将个体效应与模型的线性部分和非线性部分同时进行估计,构建了惩罚二次推断函数估计法,估计了个体内具有自相关结构的随机效应部分线性单指数动态面板模型。该方法的优点是能够克服由个体效应引起的内生性问题,因此无论滞后因变量处于线性部分还是处于非参数部分均可得到一致有效的估计。进一步,本文证明了该估计方法的一致性和渐近正态性,同时还用Monte Carlo模拟实验评估了该估计方法在有限样本下的表现。