A note on the unbiasedness of Swamy's estimator for the random coefficient regression model

In this note the estimator proposed by Swamy (1970) for the random coefficient regression model is proved to be unbiased under fairly general conditions. In addition, the conditions under which the mean of the estimator exists are derived.     

Consistent selection of explanatory variables

We consider a linear regression model where some explanatory variables are unknown members of sets of alternative explanatory variables. It will be shown that under weak conditions the minimum residual variance criterion for selecting these explanatory variables has the property that the probability of selecting wrong explanatory variables vanishes if the number of observations increases to infmity. Moreover, the O.L.S. estimator of the resulting "specified" model turns out to be consistent, while in the case that all the parameters are nonzero it can be shown that this O.L.S. estimator has the same limiting distribution as the O.L.S. estimator of the true model.     

Common correlated effects estimation of heterogeneous dynamic panel quantile regression models

This paper proposes a quantile regression estimator for a heterogeneous panel model with lagged dependent variables and interactive effects. The paper adopts the Common Correlated Effects (CCE) approach proposed in the literature and demonstrates that the extension to the estimation of dynamic quantile regression models is feasible under similar conditions to the ones used in the literature. The new quantile regression estimator is shown to be consistent and its asymptotic distribution is derived. Monte Carlo studies are carried out to study the small sample behavior of the proposed approach. The evidence shows that the estimator can significantly improve on the performance of existing estimators as long as the time series dimension of the panel is large. We present an application to the evaluation of Time-of-Use pricing using a large randomized control trial.     

Regression analysis with dichotomous regressors and misclassification

We discuss a regression model in which the regressors are dummy variables. The basic idea is that the observation units can be assigned to some well-defined combination of treatments, corresponding to the dummy variables. This assignment can not be done without some error, i.e. misclassification can play a role. This situation is analogous to regression with errors in variables. It is well-known that in these situations identification of the parameters is a prominent problem. We will first show that, in our case, the parameters are not identified by the first two moments but can be identified by the likelihood. Then we analyze two estimators. The first is a moment estimator involving moments up to the third order, and the second is a maximum likelihood estimator calculated with the help of the EM algorithm. Both estimators are evaluated on the basis of a small Monte Carlo experiment.     

Contamination in linear regression models and its influence on estimators

The consequences of the omission of possibly contaminated observations in a linear regression model for the performance of the ordinary least squares ( LS- ) estimator are discussed. We compare the ordinary L Sestimator with the corresponding 'never pooled' LS -estimator with respect to the matrix-valued mean squared error. Necessary and sufficient conditions are derived for the superiority of an estimator to another one and tests are proposed to check these conditions. Finally the resulting preliminary-test-estimators are investigated.     

A simple estimator for nonlinear error in variable models

We propose a simple estimator for nonlinear method of moment models with measurement error of the classical type when no additional data, such as validation data or double measurements, are available. We assume that the marginal distributions of the measurement errors are Laplace (double exponential) with zero means and unknown variances and the measurement errors are independent of the latent variables and are independent of each other. Under these assumptions, we derive simple revised moment conditions in terms of the observed variables. They are used to make inference about the model parameters and the variance of the measurement error. The results of this paper show that the distributional assumption on the measurement errors can be used to point identify the parameters of interest. Our estimator is a parametric method of moments estimator that uses the revised moment conditions and hence is simple to compute. Our estimation method is particularly useful in situations where no additional data are available, which is the case in many economic data sets. Simulation study demonstrates good finite sample properties of our proposed estimator. We also examine the performance of the estimator in the case where the error distribution is misspecified.     

On kernel nonparametric regression designed for complex survey data

In this article, we consider nonparametric regression analysis between two variables when data are sampled through a complex survey. While nonparametric regression analysis has been widely used with data that may be assumed to be generated from independently and identically distributed (iid) random variables, the methods and asymptotic analyses established for iid data need to be extended in the framework of complex survey designs. Local polynomial regression estimators are studied, which include as particular cases design-based versions of the Nadaraya–Watson estimator and of the local linear regression estimator. In this paper, special emphasis is given to the local linear regression estimator. Our estimators incorporate both the sampling weights and the kernel weights. We derive the asymptotic mean squared error (MSE) of the kernel estimators using a combined inference framework, and as a corollary consistency of the estimators is deduced. Selection of a bandwidth is necessary for the resulting estimators; an optimal bandwidth can be determined, according to the MSE criterion in the combined mode of inference. Simulation experiments are conducted to illustrate the proposed methodology and an application with the Canadian survey of labour and income dynamics is presented.     

Long difference instrumental variables estimation for dynamic panel models with fixed effects

This paper proposes a new instrumental variables estimator for a dynamic panel model with fixed effects with good bias and mean squared error properties even when identification of the model becomes weak near the unit circle. We adopt a weak instrument asymptotic approximation to study the behavior of various estimators near the unit circle. We show that an estimator based on long differencing the model is much less biased than conventional implementations of the GMM estimator for the dynamic panel model. We also show that under the weak instrument approximation conventional GMM estimators are dominated in terms of mean squared error by an estimator with far less moment conditions. The long difference (LD) estimator mimics the infeasible optimal procedure through its reliance on a small set of moment conditions.     

Characterization of the asymptotic distribution of semiparametric M-estimators

This paper develops a concrete formula for the asymptotic distribution of two-step, possibly non-smooth semiparametric M-estimators under general misspecification. Our regularity conditions are relatively straightforward to verify and also weaker than those available in the literature. The first-stage nonparametric estimation may depend on finite dimensional parameters. We characterize: (1) conditions under which the first-stage estimation of nonparametric components do not affect the asymptotic distribution, (2) conditions under which the asymptotic distribution is affected by the derivatives of the first-stage nonparametric estimator with respect to the finite-dimensional parameters, and (3) conditions under which one can allow non-smooth objective functions. Our framework is illustrated by applying it to three examples: (1) profiled estimation of a single index quantile regression model, (2) semiparametric least squares estimation under model misspecification, and (3) a smoothed matching estimator.     

Ridge regression revisited

In general ridge (GR) regression p ridge parameters have to be determined, whereas simple ridge regression requires the determination of only one parameter. In a recent textbook on linear regression, Jürgen Gross argues that this constitutes a major complication. However, as we show in this paper, the determination of these p parameters can fairly easily be done. Furthermore, we introduce a generalization of the GR estimator derived by Hemmerle and by Teekens and de Boer. This estimator, which is more conservative, performs better than the Hoerl and Kennard estimator in terms of a weighted quadratic loss criterion.     

Detections of changes in return by a wavelet smoother with conditional heteroscedastic volatility

In this paper, we propose two estimators, an integral estimator and a discretized estimator, for the wavelet coefficient of regression functions in nonparametric regression models with heteroscedastic variance. These estimators can be used to test the jumps of the regression function. The model allows for lagged-dependent variables and other mixing regressors. The asymptotic distributions of the statistics are established, and the asymptotic critical values are analytically obtained from the asymptotic distribution. We also use the test to determine consistent estimators for the locations of change points. The jump sizes and locations of change points can be consistently estimated using wavelet coefficients, and the convergency rates of these estimators are derived. We perform some Monte Carlo simulations to check the powers and sizes of the test statistics. Finally, we give practical examples in finance and economics to detect changes in stock returns and short-term interest rates using the empirical wavelet method.     

Quasi Score is more Efficient than Corrected Score in a Polynomial Measurement Error Model

We consider a polynomial regression model, where the covariate is measured with Gaussian errors. The measurement error variance is supposed to be known. The covariate is normally distributed with known mean and variance. Quasi score (QS) and corrected score (CS) are two consistent estimation methods, where the first makes use of the distribution of the covariate (structural method), while the latter does not (functional method). It may therefore be surmised that the former method is (asymptotically) more efficient than the latter one. This can, indeed, be proved for the regression parameters. We do this by introducing a third, so-called simple score (SS), estimator, the efficiency of which turns out to be intermediate between QS and CS. When one includes structural and functional estimators for the variance of the error in the equation, SS is still more efficient than CS. When the mean and variance of the covariate are not known and have to be estimated as well, one can still maintain that QS is more efficient than SS for the regression parameters.     

Variance estimation using auxiliary information: An almost unbiased multivariate ratio estimator

The goal of this paper is to investigate the repeated substitution method (seeSrivastava, 1967) estimating population variance in finite population sample surveys. We propose an almost unbiased multivariate ratio estimator that has a smaller mean squared error than the conventional biased multivariate ratio estimator (established byIsaki (1983)) and with the same precision as the multivariate regression estimator. Furthermore, it is a computationally much more interesting estimator since to compute it we only need to have knowledge of correlation among available variables, which it is common to have in several practical situations. A comparison of the multivariate ratio estimator proposed and the multivariate regression estimator is given.     

Control variate method for stationary processes

The sample mean is one of the most natural estimators of the population mean based on independent identically distributed sample. However, if some control variate is available, it is known that the control variate method reduces the variance of the sample mean. The control variate method often assumes that the variable of interest and the control variable are i.i.d. Here we assume that these variables are stationary processes with spectral density matrices, i.e. dependent. Then we propose an estimator of the mean of the stationary process of interest by using control variate method based on nonparametric spectral estimator. It is shown that this estimator improves the sample mean in the sense of mean square error. Also this analysis is extended to the case when the mean dynamics is of the form of regression. Then we propose a control variate estimator for the regression coefficients which improves the least squares estimator (LSE). Numerical studies will be given to see how our estimator improves the LSE.     

A smoothed least squares estimator for threshold regression models

We propose a smoothed least squares estimator of the parameters of a threshold regression model. Our model generalizes that considered in Hansen [2000. Sample splitting and threshold estimation. Econometrica 68, 575–603] to allow the thresholding to depend on a linear index of observed regressors, thus allowing discrete variables to enter. We also do not assume that the threshold effect is vanishingly small. Our estimator is shown to be consistent and asymptotically normal thus facilitating standard inference techniques based on estimated standard errors or standard bootstrap for the slope and threshold parameters.     

One-stage estimation of the effects of operational conditions and practices on productive performance: asymptotically normal and efficient,root-<Emphasis Type="Italic">n</Emphasis> consistent StoNEZD method

Understanding the effects of operational conditions and practices on productive efficiency can provide valuable economic and managerial insights. The conventional approach is to use a two-stage method where the efficiency estimates are regressed on contextual variables representing the operational conditions. The main problem of the two-stage approach is that it ignores the correlations between inputs and contextual variables. To address this shortcoming, we build on the recently developed regression interpretation of data envelopment analysis (DEA) to develop a new one-stage semi-nonparametric estimator that combines the nonparametric DEA-style frontier with a regression model of the contextual variables. The new method is referred to as stochastic semi-nonparametric envelopment of z variables data (StoNEZD). The StoNEZD estimator for the contextual variables is shown to be statistically consistent under less restrictive assumptions than those required by the two-stage DEA estimator. Further, the StoNEZD estimator is shown to be unbiased, asymptotically efficient, asymptotically normally distributed, and converge at the standard parametric rate of order n ^−1/2. Therefore, the conventional methods of statistical testing and confidence intervals apply for asymptotic inference. Finite sample performance of the proposed estimators is examined through Monte Carlo simulations.     

Estimating dynamic models from repeated cross-sections

An important feature of panel data is that it allows the estimation of parameters characterizing dynamics from individual level data. Several authors argue that such parameters can also be identified from repeated cross-section data and present estimators to do so. This paper reviews the identification conditions underlying these estimators. As grouping data to obtain a pseudo-panel is an application of instrumental variables (IV), identification requires that standard IV conditions are met. This paper explicitly discusses the implications of these conditions for empirical analyses. We also propose a computationally attractive IV estimator that is consistent under essentially the same conditions as existing estimators. While a Monte Carlo study indicates that this estimator may work well under relatively weak conditions, these conditions are not trivially satisfied in applied work. Accordingly, a key conclusion of the paper is that these estimators cannot be implemented under general conditions.     

The discrete Kalman filter applied to linear regression models: statistical considerations and an application

In this paper we show how the Kalman filter, which is a recursive estimation procedure, can be applied to the standard linear regression model. The resulting "Kalman estimator" is compared with the classical least-squares estimator.
The applicability and (dis)advantages of the filter are illustrated by means of a case study which consists of two parts. In the first part we apply the filter to a regression model with constant parameters and in the second part the filter is applied to a regression model with time-varying stochastic parameters. The prediction-powers of various "Kalman predictors" are compared with "least-squares predictors" by using T heil 's prediction-error coefficient U.     

A univariate analysis of EMS exchange rates using a target zone model

The models in the literature on exchange-rate target zones imply a non-linear time series model for the exchange rate. We show how the parameters of such models can be estimated and develop Maximum Likelihood and Method of Simulated Moments estimators for the target zone model of Krugman (1991). The Maximum Likelihood estimator is based on a computationally attractive approximation to the exact predictive density of the continuous time model. Monte Carlo experiments are used to assess the properties of this estimator. In the empirical part we estimate the model with data on recent EMS exchange rates. We find that the Krugman (1991) target zone model is not able to explain the full observed kurtosis and conditional heteroscedasticity of the exchange-rate returns.     

Estimation of linear models with crossed-error structure

Sufficient conditions are presented under which the generalized least-squares estimator, with estimated covariance matrix, is unbiased for the parameters in the crossed-error model and has the same asymptotic distribution as the generalized least-squares estimator. The model permits the presence of independent variables that are constant over cross sections or time periods. The model does not require that the variance components associated with cross sections or time periods be positive.