MSE-improvement of the least squares estimator by dropping variables

It is well known that dropping variables in regression analysis decreases the variance of the least squares (LS) estimator of the remaining parameters. However, after elimination estimates of these parameters are biased, if the full model is correct. In his recent paper, Boscher (1991) showed that the LS-estimator in the special case of a mean shift model (cf. Cook and Weisberg, 1982) which assumes no “outliers” can be considered in the framework of a linear regression model where some variables are deleted. He derived conditions under which this estimator outperforms the LS-estimator of the full model in terms of the mean squared error (MSE)-matrix criterion. We demonstrate that this approach can be extended to the general set-up of dropping variables. Necessary and sufficient conditions for the MSE-matrix superiority of the LS-estimator in the reduced model over that in the full model are derived. We also provide a uniformly most powerful F-statistic for testing the MSE-improvement.     

An exchange algorithm for computing the least quartile difference estimator

We propose an exchange algorithm (EA) for computing the least quartile difference estimate in a multiple linear regression model. Empirical results suggest that the EA is faster and more accurate than the usual p-subset algorithm.     

The asymptotic behaviour of the estimated generalized least squares method in the linear regression model

Abstract  In the linear regression model the generalized least squares (GLS) method is only applicable if the covariance matrix of the errors is known but for a scalar factor. Otherwise an estimator for this matrix has to be used. Then we speak of the estimated generalized least squares (EGLS) method. In this paper the asymptotic behaviour of both methods is compared. Results are applied to some standard models commonly used in econometrics     

Least squares estimator for regression models with some deterministic time varying parameters

Here we study the least squares estimates in some regression models. We assume that the evolution of the parameter is linearly explosive (i.e. polynomial), or stable (i.e. sinusoidal). We prove the strong consistency, and establish the rate of convergence.     

Partial least squares structural equation modeling in HRM research

Abstract

Partial least squares structural equation modeling (PLS-SEM) has become a key multivariate analysis technique that human resource management (HRM) researchers frequently use. While most disciplines undertake regular critical reflections on the use of important methods to ensure rigorous research and publication practices, the use of PLS-SEM in HRM has not been analyzed so far. To address this gap in HRM literature, this paper presents a critical review of PLS-SEM use in 77 HRM studies published over a 30-year period in leading journals. By contrasting the review results with state-of-the-art guidelines for use of the method, we identify several areas that offer room of improvement when applying PLS-SEM in HRM studies. Our findings offer important guidance for future use of the PLS-SEM method in HRM and related fields.     

Consistency of elementwise-weighted total least squares estimator in a multivariate errors-in-variables model <Emphasis Type="Bold">AX=B</Emphasis>

A multivariate measurement error model AXB is considered. The errors in [A,B] are rowwise independent, but within each row the errors may be correlated. Some of the columns are observed without errors, and in addition the error covariance matrices may differ from row to row. The total covariance structure of the errors is supposed to be known up to a scalar factor. The fully weighted total least squares estimator of X is studied, which in the case of normal errors coincides with the maximum likelihood estimator. We give mild conditions for weak and strong consistency of the estimator, when the number of rows in A increases. The results generalize the conditions of Gallo given for a univariate homoscedastic model (where B is a vector), and extend the conditions of Gleser given for the multivariate homoscedastic model. We derive the objective function for the estimator and propose an iteratively reweighted numerical procedure.Acknowledgements.A. Kukush is supported by a postdoctoral research fellowship of the Belgian office for Scientific, Technical and Cultural Affairs, promoting Scientific and Technical Collaboration with Central and Eastern Europe. S. Van Huffel is a full professor with the Katholieke Universiteit Leuven. This paper presents research results of the Belgian Programme on Interuniversity Poles of Attraction (IUAP Phase V-22), initiated by the Belgian State, Prime Ministers Office-Federal Office for Scientific, Technical and Cultural Affairs, of the Concerted Research Action (GOA) projects of the Flemish Government MEFISTO-666 (Mathematical Engineering for Information and Communication Systems Technology), of the IDO/99/03 project (K.U. Leuven) Predictive computer models for medical classification problems using patient data and expert knowledge, of the FWO projects G.0200.00, G.0078.01 and G.0270.02. The scientific responsibility is assumed by its authors. The authors would like to thank Maria Luisa Rastello and Amedeo Premoli for bringing the EW-TLS problem to their attention. The authors are grateful to two anonymous referees for the valuable comments.     

On the performance of the ordinary least squares method under an error component model

Starting from the one-dimensional results by Wang et al (1994) we consider the performance of the ordinary least squares estimator in comparison to the best linear unbiased estimator under an error component model with random effects in units and time. Upper bounds are derived for the first-order approximation to the difference between both estimators and for the spectral norm of the difference between their dispersion matrices.     

A comparison of the Box-Cox maximum likelihood estimator and the non-linear two-stage least squares estimator

This paper investigates the limiting behaviour of the ‘maximum likelihood estimator’(MLE) based on normality, as well as the nonlinear two-stage least squares estimator (NL2S), for the i.i.d. and regression models in which the Box-Cox transformation is applied to the dependent variable. Since the transformed variable cannot in general be normally distributed, the untransformed variable is assumed to have a two-parameter gamma distribution. Tables of probability limits and asymptotic variance demonstrate that, in this case, the inconsistency of the ‘normal MLE’ is often quite pronounced, while the NL2S is consistent and typically well behaved.     

Nonparametric regression function estimation using interaction least squares splines and comlexity regularization

Let (X, Y) be a pair of random variables withsupp(X)⊆[0,1] ^l andEY ²<∞. Letm ^* be the best approximation of the regression function of (X, Y) by sums of functions of at mostd variables (1≤d≤l). Estimation ofm ^* from i.i.d. data is considered. For the estimation interaction least squares splines, which are defined as sums of polynomial tensor product splines of at mostd variables, are used. The knot sequences of the tensor product splines are chosen equidistant. Complexity regularization is used to choose the number of the knots and the degree of the splines automatically using only the given data. Without any additional condition on the distribution of (X, Y) the weak and strongL ₂-consistency of the estimate is shown. Furthermore, for everyp≥1 and every distribution of (X, Y) withsupp(X)⊆[0,1] ^l ,y bounded andm ^* p-smooth, the integrated squared error of the estimate achieves up to a logarithmic factor the (optimal) rate      

The exact moments of the least squares estimator for the autoregressive model

Exact mean and variance of the least squares estimate of the stationary first-order autoregressive coefficient, i.e., β in y_t=α+βx_t+u_t are evaluated algebraically as well as numerically. It turns out that the least squares estimate is seriously biased for the sample of two-digits sizes typically dealt with in econometrics if the mean of the process is unknown, i.e., if the equation has a non-zero intercept (α≠0). Kendall's approximation to the mean and Barlett's approximation to the variance are shown to be fairly good. Also, our numerical results confirm Orcutt and Winokur's (Econometrica, Vol. 37) based on Monte Carlo experiments.     

Out-of-sample forecasts of China's economic growth and inflation using rolling weighted least squares

Macroeconomic forecasting in China is essential for the government to take proper policy decisions on government expenditure and money supply, among other matters. The existing literature on forecasting Chinas macroeconomic variables is unclear on the crucial issue of how to choose an optimal window to estimate parameters with rolling out-of-sample forecasts. This study fills this gap in forecasting economic growth and inflation in China, by using the rolling weighted least squares (WLS) with the practically feasible cross-validation (CV) procedure of Hong et al. (2018) to choose an optimal estimation window. We undertake an empirical analysis of monthly data on up to 30 candidate indicators (mainly asset prices) for a span of 17 years (2000–2017). It is documented that the forecasting performance of rolling estimation is sensitive to the selection of rolling windows. The empirical analysis shows that the rolling WLS with the CV-based rolling window outperforms other rolling methods on univariate regressions in most cases. One possible explanation for this is that these macroeconomic variables often suffer from structural changes due to changes in institutional reforms, policies, crises, and other factors. Furthermore, we find that, in most cases, asset prices are key variables for forecasting macroeconomic variables, especially output growth rate.     

Consistency and asymptotic normality of least squares estimators in generalized STAR models

Space–time autoregressive (STAR) models, introduced by Cliff and Ord [Spatial autocorrelation (1973) Pioneer, London] are successfully applied in many areas of science, particularly when there is prior information about spatial dependence. These models have significantly fewer parameters than vector autoregressive models, where all information about spatial and time dependence is deduced from the data. A more flexible class of models, generalized STAR models, has been introduced in Borovkova et al. [Proc. 17th Int. Workshop Stat. Model. (2002), Chania, Greece] where the model parameters are allowed to vary per location. This paper establishes strong consistency and asymptotic normality of the least squares estimator in generalized STAR models. These results are obtained under minimal conditions on the sequence of innovations, which are assumed to form a martingale difference array. We investigate the quality of the normal approximation for finite samples by means of a numerical simulation study, and apply a generalized STAR model to a multivariate time series of monthly tea production in west Java, Indonesia.     

Using partial least squares in operations management research: A practical guideline and summary of past research

The partial least squares (PLS) approach to structural equation modeling (SEM) has been widely adopted in business research fields such as information systems, consumer behavior, and marketing. The use of PLS in the field of operations management is also growing. However, questions still exist among some operations management researchers regarding whether and how PLS should be used. To address these questions, our study provides a practical guideline for using PLS and uses examples from the operations management literature to demonstrate how the specific points in this guideline can be applied. In addition, our study reviews and summarizes the use of PLS in the recent operations management literature according to our guideline. The main contribution of this study is to present a practical guideline for evaluating and using PLS that is tailored to the operations management field.     

Approximating the distribution of the two-stage least squares estimator when the concentration parameter is small

This paper presents a new approximation to the exact sampling distribution of the instrumental variables estimator in simultaneous equations models. It differs from many of the approximations currently available, Edgeworth expansions for example, in that it is specifically designed to work well when the concentration parameter is small. The approximation is remarkable in that simultaneously: (i) it has an extremely simple final form; (ii) in situations for which it is designed it is typically much more accurate than is the large sample normal approximation; and (iii) it is able to capture most of those stylized facts that characterize lack of identification and weak instrument scenarios. The development leading to the approximation is also novel in that it introduces techniques of some independent interest not seen in this literature hitherto.     

Functional Principal Component Regression and Functional Partial Least‐squares Regression: An Overview and a Comparative Study

Functional data analysis is a field of growing importance in Statistics. In particular, the functional linear model with scalar response is surely the model that has attracted more attention in both theoretical and applied research. Two of the most important methodologies used to estimate the parameters of the functional linear model with scalar response are functional principal component regression and functional partial least‐squares regression. We provide an overview of estimation methods based on these methodologies and discuss their advantages and disadvantages. We emphasise that the role played by the functional principal components and by the functional partial least‐squares components that are used in estimation appears to be very important to estimate the functional slope of the model. A functional version of the best subset selection strategy usual in multiple linear regression is also analysed. Finally, we present an extensive comparative simulation study to compare the performance of all the considered methodologies that may help practitioners in the use of the functional linear model with scalar response.     

基于行业集中度对我国现代服务业集聚的定量分析

本文基于行业集中度和中国统计年鉴2005年-2010年的各地区按行业分职工人数的统计数据,选取七大代表性的现代服务业,进行计算和分析,得出信息传输、计算机服务和软件业、房地产业、租赁和商务服务业和科研、综合技术服务业的产业集聚程度高,集聚优势明显,而金融业、教育业、文化、体育和娱乐业的产业集聚程度低,并给出一些对策。     

Parameter estimation for the drift of a time inhomogeneous jump diffusion process

This work deals with parameter estimation for the drift of jump diffusion processes which are driven by a Lévy process and whose drift term is linear in the parameter. In contrast to the commonly used maximum likelihood estimator, our proposed estimator has the practical advantage that its calculation does not require the evaluation of the continuous part of the sample path. In the important case of an Ornstein‐Uhlenbeck‐type jump diffusion, which is a widely used model, we prove consistency and asymptotic normality.     

Re-examining 50-year-old OLS estimates of the Klein–Goldberger model

This paper examines the ordinary least squares estimates of the Klein–Goldberger model by Fox ( Journal of Political Economy , 64 , 1956, 128). Because Klein and Goldberger published the data set with the model, it is possible to re-examine Fox's results years later, and investigate the accuracy with which these estimates were calculated. The examination reported in this paper was conducted by making independent estimates using three different modern econometric software packages. This examination reveals that the Fox estimates for a number of the equations of this model are replicable, to the two or three digits reported by Fox. Fox's results for other equations cannot be replicated. Not all the reasons for this lack of replicability can be determined, but in several cases the computational methods used by Fox and his assistants have been found to be faulty by modern computational standards.