Bayesian limited-information analysis of nonlinear simultaneous equations systems

This paper presents a Bayesian limited-information estimation method that can be used to estimate a single nonlinear equation that forms part of a system of simultaneous equations. The method can be looked upon as the Bayesian counterpart of Amemiya's nonlinear limited-information maximum-likelihood estimator as well as a generalization of Drèze's Bayesian limited-information estimator for linear simultaneous equations systems. The method is illustrated by applying it to the problem of estimating a CES-production function which forms part of a complete model of firm behavior.     

Three-stage least-squares estimation for a system of simultaneous,nonlinear, implicit equations

The article describes a nonlinear three-stage least-squares estimator for the parameters of a system of simultaneous, nonlinear, implicit equations; the method allows the estimation of these parameters subject to nonlinear parametric restrictions across equations. The estimator is shown to be strongly consistent, asymptotically normally distributed, and more efficient than the nonlinear two-stage least-squares estimator. Some practical implications of the regularity conditions used to obtain these results are discussed from the point of view of one whose interest is in applications, Also, computing methods using readily available nonlinear regression programs are described.     

A new class of limited-information estimators for simultaneous equations systems

The TSLS and LIML estimators are evaluated by means of a new class of limited-information estimators, the so-called Ω-class estimators. Under certain assumptions the Ω-class estimator is a maximun-likelihood estimator. These assumptions are superfluous, however, if we view the Ω-class as a class of minimun-distance estimators; all the members are shown to be consistent under general conditions. Besides the TSLS and the LIML estimators some other interesting members are introduced, and it is shown that, under certain conditions, the Ω-class estimators are weighted averages of different TSLS estimators. The use of TSLS in small samples is criticized; an alternative estimator is proposed.     

Robust and consistent estimation of nonlinear errors-in-variables models

This paper considers the consistent estimation of nonlinear errors-in-variables models. It adopts the functional modeling approach by assuming that the true but unobserved regressors are random variables but making no parametric assumption on the distribution from which the latent variables are drawn. This paper shows how the information extracted from the replicate measurements can be used to identify and consistently estimate a general nonlinear errors-in-variables model. The identification is established through characteristic functions. The estimation procedure involves nonparametric estimation of the conditional density of the latent variables given the measurements using the identification results at the first stage, and at the second stage, a semiparametric nonlinear least-squares estimator is proposed. The consistency of the proposed estimator is also established. Finite sample performance of the estimator is investigated through a Monte Carlo study.     

A simple estimator for nonlinear error in variable models

We propose a simple estimator for nonlinear method of moment models with measurement error of the classical type when no additional data, such as validation data or double measurements, are available. We assume that the marginal distributions of the measurement errors are Laplace (double exponential) with zero means and unknown variances and the measurement errors are independent of the latent variables and are independent of each other. Under these assumptions, we derive simple revised moment conditions in terms of the observed variables. They are used to make inference about the model parameters and the variance of the measurement error. The results of this paper show that the distributional assumption on the measurement errors can be used to point identify the parameters of interest. Our estimator is a parametric method of moments estimator that uses the revised moment conditions and hence is simple to compute. Our estimation method is particularly useful in situations where no additional data are available, which is the case in many economic data sets. Simulation study demonstrates good finite sample properties of our proposed estimator. We also examine the performance of the estimator in the case where the error distribution is misspecified.     

A consistent estimator for nonlinear regression models

In this paper an estimator for the general (nonlinear) regression model with random regressors is studied which is based on the Fourier transform of a certain weight function. Consistency and asymptotic normality of the estimator are established and simulation results are presented to illustrate the theoretical ones.Supported by the Hungarian National Science Foundation OTKA under Grants No. F 032060/2000 and F 046061/2004 and by the Bolyai Grant of the Hungarian Academy of Sciences.Received October 2003     

Partially generalized least squares and two-stage least squares estimators

A class of partially generalized least squares estimators and a class of partially generalized two-stage least squares estimators in regression models with heteroscedastic errors are proposed. By using these estimators a researcher can attain higher efficiency than that attained by the least squares or the two-stage least squares estimators without explicitly estimating each component of the heteroscedastic variances. However, the efficiency is not as high as that of the generalized least squares or the generalized two-stage least squares estimator calculated using the knowledge of the true variances. Hence the use of the term partial.     

Model reference adaptive systems applied to regression analyses

The adaptive estimation procedure of model reference adaptive systems is modified and applied to linear models. In general the principle can be used for almost any time series model. Because of the recursive nature of the resulting estimator, it is computationally appealing, especially when a time series is considered as a flow of data. In addition, the estimator turns out to have certain statistical optimality properties.
In the linear regression setting, Ridge estimators turn out to constitute a subclass of the adaptive estimators considered, whereas for unknown measurement variance, the resulting estimators are related to J ames -S tkin type estimators, and have better properties than the latter. The estimator is shown to be strongly consistent and to converge in law to a normal variate under the standard assumptions of linear models. Further it is shown to be admissible and minimax in restricted parameter spaces. The connection between K alman filters and the classical least-squares estimator is also pointed out.     

On classes of estimators of the variance function of a linear estimator

Summary The variance function of a linear estimator can be expressed into a quadratic form. The present paper presents classes of estimators of this quadratic form along the lines implicitly suggested byHorvitz andThompson [1952] while formulating the classes of linear estimators. Accordingly it is noted that there exist nine principal classes of estimators out of which one principal class is examined in detail. Furthermore to illustrate the theory an example is considered where the expression for a unique estimator variance of the best estimator in theT ₁ class is derived.     

A robust scale estimator based on the shortest half

A new robust estimator of scale is considered, which is proportional to the length of the shortest half of the sample. The estimator is compared to the interquartile range and the median absolute deviation, that are also based on order statistics. All three estimators have the same influence function, but their breakdown points differ. It also turns out that one needs a finite-sample correction factor which depends on mod(sample size, 4) to achieve approximate unbiasedness at normal distributions.     

Almost unbiased product-type estimator

In sample survey methods the use of product estimators was suggested byMurthy [1964] andSrivastava [1966] and were found to serve good purpose provided the two variables viz. the main variable under study and the auxiliary variable have a very high negative correlation between them. The product estimators suggested by them are biased. In the present paper the author has obtained unbiased product estimators (to the first degree of approximation) with the help of the technique developed byQuenouille [1956] and has established that this new estimator is better than the other product estimator in the mean square error sense.     

An efficient nonparametric estimator for models with nonlinear dependence

We provide a convenient econometric framework for the analysis of nonlinear dependence in financial applications. We introduce models with constrained nonparametric dependence, which specify the conditional distribution or the copula in terms of a one-dimensional functional parameter. Our approach is intermediate between standard parametric specifications (which are in general too restrictive) and the fully unrestricted approach (which suffers from the curse of dimensionality). We introduce a nonparametric estimator defined by minimizing a chi-square distance between the constrained densities in the family and an unconstrained kernel estimator of the density. We derive the nonparametric efficiency bound for linear forms and show that the minimum chi-square estimator is nonparametrically efficient for linear forms.     

The Heckman Correction for Sample Selection and Its Critique

This paper gives a short overview of Monte Carlo studies on the usefulness of Heckman's (1976, 1979) two-step estimator for estimating selection models. Such models occur frequently in empirical work, especially in microeconometrics when estimating wage equations or consumer expenditures.
It is shown that exploratory work to check for collinearity problems is strongly recommended before deciding on which estimator to apply. In the absence of collinearity problems, the full-information maximum likelihood estimator is preferable to the limited-information two-step method of Heckman, although the latter also gives reasonable results. If, however, collinearity problems prevail, subsample OLS (or the Two-Part Model) is the most robust amongst the simple-to-calculate estimators.     

A consistent estimator in general functional errors-in-variables models

The problem of estimation in nonlinear functional errors-in-variables model is considered. A modified least squares estimator is studied, its consistency and asymptotic normality is established. Simulation results are also presented showing the performance of the estimator in comparison with the naive ordinary least squares estimator. Received: June 1999     

An efficient estimator using auxiliary information

The use of ratio and product methods of estimation using auxiliary information for estimating the mean of a finite population is well known.Srivastava [1967] andReddy [1973] proposed ratio-cum-product type estimators. This paper proposes a transformed estimator which is even more efficient than these estimators for a wide range of the value of the correlation coefficient between the main and auxiliary variables.     

A comparison of the Box-Cox maximum likelihood estimator and the non-linear two-stage least squares estimator

This paper investigates the limiting behaviour of the ‘maximum likelihood estimator’(MLE) based on normality, as well as the nonlinear two-stage least squares estimator (NL2S), for the i.i.d. and regression models in which the Box-Cox transformation is applied to the dependent variable. Since the transformed variable cannot in general be normally distributed, the untransformed variable is assumed to have a two-parameter gamma distribution. Tables of probability limits and asymptotic variance demonstrate that, in this case, the inconsistency of the ‘normal MLE’ is often quite pronounced, while the NL2S is consistent and typically well behaved.     

Estimation of a nonlinear panel data model with semiparametric individual effects

This paper investigates identification and estimation of a class of nonlinear panel data, single-index models. The model allows for unknown time-specific link functions, and semiparametric specification of the individual-specific effects. We develop an estimator for the parameters of interest, and propose a powerful new kernel-based modified backfitting algorithm to compute the estimator. We derive uniform rates of convergence results for the estimators of the link functions, and show the estimators of the finite-dimensional parameters are root-N$N$ consistent with a Gaussian limiting distribution. We study the small sample properties of the estimator via Monte Carlo techniques.     

Survey statisticians celebrate golden jubilee year 2003 of the linear regression estimator

In the present investigation, a general set-up for inference from survey data that covers the estimation of variance of estimators of totals and distribution functions has been considered, using known first and second order moments of auxiliary information at the estimation stage. The traditional linear regression estimator of population total owed to Hansen et al. Sample survey methods and theory. vol. 1 & 2, New York, Wiley (1953) is shown to be unique in its class of estimators, and celebrates Golden Jubilee Year-2003 for its outstanding performance in the literature by following Singh Advanced sampling theory with applications: How Michael selected Amy, vols 1 & 2, Kluwer, The Netherlands, pp 1–1247 2003. This particular paper has been designed to repair the methodology of Rao J. Off Stat 10(2):153–165 (1994) and hence that of Singh Ann Ins Stat Math 53(2):404–417 (2001). Although there is no need of simulation study to demonstrate the superiority of the proposed technique, because the theoretical results are crystal clear, but a small scale level simulation study have been designed to show the performance of the proposed estimators over the existing estimators in the literature.     

Improving on two-stage estimators for scale families

Summary Consider the problem of finding an estimator for a scale parameter such that its risk function is bounded by a preassigned constant. As a solution of the problem, two-stage estimators based on only the second sample have been proposed. The paper shows that these estimators can be improved by combining the first and the second sample.