A local maximum likelihood estimator for Poisson regression

A local maximum likelihood estimator based on Poisson regression is presented as well as its bias, variance and asymptotic distribution. This semiparametric estimator is intended to be an alternative to the Poisson, negative binomial and zero-inflated Poisson regression models that does not depend on regularity conditions and model specification accuracy. Some simulation results are presented. The use of the local maximum likelihood procedure is illustrated on one example from the literature. This procedure is found to perform well. This research was partially supported by Calouste Gulbenkian Foundation and PRODEP III.     

Forecasting football match results in national league competitions using score-driven time series models

We develop a new dynamic multivariate model for the analysis and forecasting of football match results in national league competitions. The proposed dynamic model is based on the score of the predictive observation mass function for a high-dimensional panel of weekly match results. Our main interest is in forecasting whether the match result is a win, a loss or a draw for each team. The dynamic model for delivering such forecasts can be based on three different dependent variables: the pairwise count of the number of goals, the difference between the numbers of goals, or the category of the match result (win, loss, draw). The different dependent variables require different distributional assumptions. Furthermore, different dynamic model specifications can be considered for generating the forecasts. We investigate empirically which dependent variable and which dynamic model specification yield the best forecasting results. We validate the precision of the resulting forecasts and the success of the forecasts in a betting simulation in an extensive forecasting study for match results from six large European football competitions. Finally, we conclude that the dynamic model for pairwise counts delivers the most precise forecasts while the dynamic model for the difference between counts is most successful for betting, but that both outperform benchmark and other competing models.     

Tuning parameter selection in penalized generalized linear models for discrete data

In recent years, we have seen an increased interest in the penalized likelihood methodology, which can be efficiently used for shrinkage and selection purposes. This strategy can also result in unbiased, sparse, and continuous estimators. However, the performance of the penalized likelihood approach depends on the proper choice of the regularization parameter. Therefore, it is important to select it appropriately. To this end, the generalized cross‐validation method is commonly used. In this article, we firstly propose new estimates of the norm of the error in the generalized linear models framework, through the use of Kantorovich inequalities. Then these estimates are used in order to derive a tuning parameter selector in penalized generalized linear models. The proposed method does not depend on resampling as the standard methods and therefore results in a considerable gain in computational time while producing improved results. A thorough simulation study is conducted to support theoretical findings; and a comparison of the penalized methods with the L₁, the hard thresholding, and the smoothly clipped absolute deviation penalty functions is performed, for the cases of penalized Logistic regression and penalized Poisson regression. A real data example is being analyzed, and a discussion follows. © 2014 The Authors. Statistica Neerlandica © 2014 VVS.     

Conditional empirical likelihood estimation and inference for quantile regression models

This paper considers two empirical likelihood-based estimation, inference, and specification testing methods for quantile regression models. First, we apply the method of conditional empirical likelihood (CEL) by Kitamura et al. [2004. Empirical likelihood-based inference in conditional moment restriction models. Econometrica 72, 1667–1714] and Zhang and Gijbels [2003. Sieve empirical likelihood and extensions of the generalized least squares. Scandinavian Journal of Statistics 30, 1–24] to quantile regression models. Second, to avoid practical problems of the CEL method induced by the discontinuity in parameters of CEL, we propose a smoothed counterpart of CEL, called smoothed conditional empirical likelihood (SCEL). We derive asymptotic properties of the CEL and SCEL estimators, parameter hypothesis tests, and model specification tests. Important features are (i) the CEL and SCEL estimators are asymptotically efficient and do not require preliminary weight estimation; (ii) by inverting the CEL and SCEL ratio parameter hypothesis tests, asymptotically valid confidence intervals can be obtained without estimating the asymptotic variances of the estimators; and (iii) in contrast to CEL, the SCEL method can be implemented by some standard Newton-type optimization. Simulation results demonstrate that the SCEL method in particular compares favorably with existing alternatives.     

The multi-state latent factor intensity model for credit rating transitions

A new empirical reduced-form model for credit rating transitions is introduced. It is a parametric intensity-based duration model with multiple states and driven by exogenous covariates and latent dynamic factors. The model has a generalized semi-Markov structure designed to accommodate many of the stylized facts of credit rating migrations. Parameter estimation is based on Monte Carlo maximum likelihood methods for which the details are discussed in this paper. A simulation experiment is carried out to show the effectiveness of the estimation procedure. An empirical application is presented for transitions in a 7 grade rating system. The model includes a common dynamic component that can be interpreted as the credit cycle. Asymmetric effects of this cycle across rating grades and additional semi-Markov dynamics are found to be statistically significant. Finally, we investigate whether the common factor model suffices to capture systematic risk in rating transition data by introducing multiple factors in the model.     

Reparameterized inverse gamma regression models with varying precision

In this article, we propose a mean linear regression model where the response variable is inverse gamma distributed using a new parameterization of this distribution that is indexed by mean and precision parameters. The main advantage of our new parametrization is the straightforward interpretation of the regression coefficients in terms of the expectation of the positive response variable, as usual in the context of generalized linear models. The variance function of the proposed model has a quadratic form. The inverse gamma distribution is a member of the exponential family of distributions and has some distributions commonly used for parametric models in survival analysis as special cases. We compare the proposed model to several alternatives and illustrate its advantages and usefulness. With a generalized linear model approach that takes advantage of exponential family properties, we discuss model estimation (by maximum likelihood), black further inferential quantities and diagnostic tools. A Monte Carlo experiment is conducted to evaluate the performances of these estimators in finite samples with a discussion of the obtained results. A real application using minerals data set collected by Department of Mines of the University of Atacama, Chile, is considered to demonstrate the practical potential of the proposed model.     

Startup team contributions and new firm creation: the role of founding team experience

The likelihood of nascent entrepreneurs making the transition from a new venture idea to a profitable business is argued to be contingent on the breadth of the resources available within the startup team. Team industry and startup experience are deemed to influence the entrepreneurs’ ability to profitably establish the venture in the market via the mobilization of team resources. Using a sample of nascent entrepreneurs in the USA, we show that team resource heterogeneity has a positive impact on profitable firm creation. Moreover, this positive effect is greater as the team has more experience in the industry in which the new business will compete.     

Bayesian approach to LR assessment in case of rare type match

The likelihood ratio (LR) is largely used to evaluate the relative weight of forensic data regarding two hypotheses, and for its assessment, Bayesian methods are widespread in the forensic field. However, the Bayesian ‘recipe’ for the LR presented in most of the literature consists of plugging‐in Bayesian estimates of the involved nuisance parameters into a frequentist‐defined LR: frequentist and Bayesian methods are thus mixed, giving rise to solutions obtained by hybrid reasoning. This paper provides the derivation of a proper Bayesian approach to assess LRs for the ‘rare type match problem’, the situation in which the expert wants to evaluate a match between the DNA profile of a suspect and that of a trace from the crime scene, and this profile has never been observed before in the database of reference. LR assessment using the two most popular Bayesian models (beta‐binomial and Dirichlet‐multinomial) is discussed and compared with corresponding plug‐in versions.     

Small‐sample testing inference in symmetric and log‐symmetric linear regression models

This paper deals with the issue of testing hypotheses in symmetric and log‐symmetric linear regression models in small and moderate‐sized samples. We focus on four tests, namely, the Wald, likelihood ratio, score, and gradient tests. These tests rely on asymptotic results and are unreliable when the sample size is not large enough to guarantee a good agreement between the exact distribution of the test statistic and the corresponding chi‐squared asymptotic distribution. Bartlett and Bartlett‐type corrections typically attenuate the size distortion of the tests. These corrections are available in the literature for the likelihood ratio and score tests in symmetric linear regression models. Here, we derive a Bartlett‐type correction for the gradient test. We show that the corrections are also valid for the log‐symmetric linear regression models. We numerically compare the various tests and bootstrapped tests, through simulations. Our results suggest that the corrected and bootstrapped tests exhibit type I probability error closer to the chosen nominal level with virtually no power loss. The analytically corrected tests as well as the bootstrapped tests, including the Bartlett‐corrected gradient test derived in this paper, perform with the advantage of not requiring computationally intensive calculations. We present a real data application to illustrate the usefulness of the modified tests.     

Assessing the Empirical Relevance of Labour Frictions to Business Cycle Fluctuations

This paper describes a dynamic stochastic general equilibrium model augmented with labour frictions, namely: indivisible labour, predetermined employment and adjustment costs. This improves the fit to the data as shown by a higher log marginal likelihood and closer match to key business cycle statistics. The labour frictions introduced are relevant for model dynamics and economic policy: the effect of total factor productivity shocks on most macroeconomic variables is substantially mitigated; fiscal policy leads to a greater crowding out of private sector activity and monetary policy has a lower impact on output. Labour frictions also provide a better match to impulse response functions from vector autoregressive models.     

Match‐Fixing in a Monopoly Betting Market

A monopolist bookmaker may set betting odds on a fairly even contest to induce match‐fixing by an influential corrupt punter. His loss to the corrupt punter is more than made up for by enticing enough ordinary punters to bet on the losing team. This result is in sharp contrast to competitive bookmaking, where even contests have been shown to be immune to fixing. The analysis also reveals a surprising result that the incidence of match‐fixing can dramatically fall when match‐fixing opportunities rise. This is shown by comparing two scenarios—when only one team is corruptible and when both are corruptible. For both teams corruptible, the bookmaker is uncertain about to which team the influential punter will have access, so carefully maneuvering the odds to induce match‐fixing is too costly.     

Relevance weighted likelihood for dependent data

The relevance-weighted likelihood function weights individual contributions to the likelihood according to their relevance for the inferential problem of interest. Consistency and asymptotic normality of the weighted maximum likelihood estimator were previously proved for independent sequences of random variables. We extend these results to apply to dependent sequences, and, in so doing, provide a unified approach to a number of diverse problems in dependent data. In particular, we provide a heretofore unknown approach for dealing with heterogeneity in adaptive designs, and unify the smoothing approach that appears in many foundational papers for independent data. Applications are given in clinical trials, psychophysics experiments, time series models, transition models, and nonparametric regression. Received: April 2000     

Strong Consistency of the Maximum Likelihood Estimator in Generalized Linear and Nonlinear Mixed-Effects Models

Generalized linear and nonlinear mixed-effects models are used extensively in biomedical, social, and agricultural sciences. The statistical analysis of these models is based on the asymptotic properties of the maximum likelihood estimator. However, it is usually assumed that the maximum likelihood estimator is consistent, without providing a proof. A rigorous proof of the consistency by verifying conditions from existing results can be very difficult due to the integrated likelihood. In this paper, we present some easily verifiable conditions for the strong consistency of the maximum likelihood estimator in generalized linear and nonlinear mixed-effects models. Based on this result, we prove that the maximum likelihood estimator is consistent for some frequently used models such as mixed-effects logistic regression models and growth curve models.     

Workgroup emotional intelligence: Scale development and relationship to team process effectiveness and goal focus

Over the last decade, ambitious claims have been made in the management literature about the contribution of emotional intelligence to success and performance. Writers in this genre have predicted that individuals with high emotional intelligence perform better in all aspects of management. This paper outlines the development of a new emotional intelligence measure, the Workgroup Emotional Intelligence Profile, Version 3 (WEIP-3), which was designed specifically to profile the emotional intelligence of individuals in work teams. We applied the scale in a study of the link between emotional intelligence and two measures of team performance: team process effectiveness and team goal focus. The results suggest that the average level of emotional intelligence of team members, as measured by the WEIP-3, is reflected in the initial performance of teams. In our study, low emotional intelligence teams initially performed at a lower level than the high emotional intelligence teams. Over time, however, teams with low average emotional intelligence raised their performance to match that of teams with high emotional intelligence.     

Numerical Maximisation of Likelihood: A Neglected Alternative to EM?

There is by now a long tradition of using the EM algorithm to find maximum‐likelihood estimates (MLEs) when the data are incomplete in any of a wide range of ways, even when the observed‐data likelihood can easily be evaluated and numerical maximisation of that likelihood is available as a conceptually simple route to the MLEs. It is rare in the literature to see numerical maximisation employed if EM is possible. But with excellent general‐purpose numerical optimisers now available free, there is no longer any reason, as a matter of course, to avoid direct numerical maximisation of likelihood. In this tutorial, I present seven examples of models in which numerical maximisation of likelihood appears to have some advantages over the use of EM as a route to MLEs. The mathematical and coding effort is minimal, as there is no need to derive and code the E and M steps, only a likelihood evaluator. In all the examples, the unconstrained optimiser nlm available in R is used, and transformations are used to impose constraints on parameters. I suggest therefore that the following question be asked of proposed new applications of EM: Can the MLEs be found more simply and directly by using a general‐purpose numerical optimiser?     

On the analysis of multivariate growth curves

Growth curve data arise when repeated measurements are observed on a number of individuals with an ordered dimension for occasions. Such data appear frequently in almost all fields in which statistical models are used, for instance in medicine, agriculture and engineering. In medicine, for example, more than one variable is often measured on each occasion. However, analyses are usually based on exploration of repeated measurements of only one variable. The consequence is that the information contained in the between-variables correlation structure will be discarded.  In this study we propose a multivariate model based on the random coefficient regression model for the analysis of growth curve data. Closed-form expressions for the model parameters are derived under the maximum likelihood (ML) and the restricted maximum likelihood (REML) framework. It is shown that in certain situations estimated variances of growth curve parameters are greater for REML. Also a method is proposed for testing general linear hypotheses. One numerical example is provided to illustrate the methods discussed. Received: 22 February 1999     

A Selective Overview and Comparison of Robust Mixture Regression Estimators

Mixture regression models have been widely used in business, marketing and social sciences to model mixed regression relationships arising from a clustered and thus heterogeneous population. The unknown mixture regression parameters are usually estimated by maximum likelihood estimators using the expectation–maximisation algorithm based on the normality assumption of component error density. However, it is well known that the normality-based maximum likelihood estimation is very sensitive to outliers or heavy-tailed error distributions. This paper aims to give a selective overview of the recently proposed robust mixture regression methods and compare their performance using simulation studies.     

A likelihood ratio test for stationarity of rating transitions

We study the time-stationarity of rating transitions, modelled by a time-continuous discrete-state Markov process and derive a likelihood ratio test. For multiple Markov processes from a multiplicative intensity model, maximum likelihood parameter estimates can be written as martingale transform of the processes, counting transitions between the rating states, so that the profile partial likelihood ratio is asymptotically χ²${\chi }^2$-distributed. An application to an internal rating data set reveals highly significant instationarity.     

Team leader experience in improvement teams: A social networks perspective

In this research, we disentangle the relationship between several key aspects of a team leader's experience and the likelihood of improvement project success. Using the lens of socio-technical systems, we argue that the effect of team leader experience derives from the social system as well as the technical system. The aspects of team leader experience we examine include team leader social capital (a part of the social system) and team leader experience leading projects of the same type (a part of the technical system).We examine four different, yet related, dimensions of a team leader's social capital, which we motivate based on the social networks literature. One dimension, team leader familiarity, suggests that social capital is created when team leaders have experience working with current team members on prior improvement projects, and that such social capital increases the likelihood of improvement project success. We develop three additional dimensions, using social network analysis (SNA), to capture the idea that the improvement team leader's social capital extends beyond the current team to include everyone the leader has previously worked with on improvement projects. Contrasting our SNA-based dimensions with team leader familiarity enables us to better understand the impact of a team leader's social capital both inside and beyond the team. We also examine the effect of a team leader's experience leading prior projects of the same type, and consider the extent to which organizational experience may moderate the impact of both team leader social capital and same-type project experience.Based on analysis of archival data of six sigma projects spanning six years from a Fortune 500 consumer products manufacturer, we find that two of our SNA-based dimensions of team leader social capital, as well as experience leading projects of the same type, increase the likelihood of project success. In addition, we show that organizational experience moderates the relationship between team leader same-type project experience and project success. However, this is not the case for the relationship between the dimensions of team leader social capital and project success. These results provide insights regarding how dimensions of team leader experience and organizational experience collectively impact the operational performance of improvement teams.     

Computing marginal likelihoods from a single MCMC output

In this article, we propose new Monte Carlo methods for computing a single marginal likelihood or several marginal likelihoods for the purpose of Bayesian model comparisons. The methods are motivated by Bayesian variable selection, in which the marginal likelihoods for all subset variable models are required to compute. The proposed estimates use only a single Markov chain Monte Carlo (MCMC) output from the joint posterior distribution and it does not require the specific structure or the form of the MCMC sampling algorithm that is used to generate the MCMC sample to be known. The theoretical properties of the proposed method are examined in detail. The applicability and usefulness of the proposed method are demonstrated via ordinal data probit regression models. A real dataset involving ordinal outcomes is used to further illustrate the proposed methodology.