Minimax-regret treatment choice with missing outcome data

I use the minimax-regret criterion to study choice between two treatments when some outcomes in the study population are unobservable and the distribution of missing data is unknown. I first assume that observable features of the study population are known and derive the treatment rule that minimizes maximum regret over all possible distributions of missing data. When no treatment is dominant, this rule allocates positive fractions of persons to both treatments. I then assume that the data are a random sample of the study population and show that in some instances, treatment rules that estimate certain point-identified population means by sample averages are finite-sample minimax regret.     

Semiparametric regression models and sensitivity analysis of longitudinal data with nonrandom dropouts

We propose a family of regression models to adjust for nonrandom dropouts in the analysis of longitudinal outcomes with fully observed covariates. The approach conceptually focuses on generalized linear models with random effects. A novel formulation of a shared random effects model is presented and shown to provide a dropout selection parameter with a meaningful interpretation. The proposed semiparametric and parametric models are made part of a sensitivity analysis to delineate the range of inferences consistent with observed data. Concerns about model identifiability are addressed by fixing some model parameters to construct functional estimators that are used as the basis of a global sensitivity test for parameter contrasts. Our simulation studies demonstrate a large reduction of bias for the semiparametric model relatively to the parametric model at times where the dropout rate is high or the dropout model is misspecified. The methodology's practical utility is illustrated in a data analysis.     

Robust firm pricing with panel data

Firms often have imperfect information about demand for their products. We develop an integrated econometric and theoretical framework to model firm demand assessment and subsequent pricing decisions with limited information. We introduce a panel data discrete choice model whose realistic assumptions about consumer behavior deliver partially identified preferences and thus generate ambiguity in the firm pricing problem. We use the minimax-regret criterion as a decision-making rule for firms facing this ambiguity. We illustrate the framework’s benefits relative to the most common discrete choice analysis approach through simulations and empirical examples with field data.     

An alternative procedure for imputing missing data based on principal components analysis

This work entailed tackling the significant problem of missing data which was solved by identifying a new substitution procedure, following an empirical approach based on the analysis of the information contained in the entire set of data collected. This procedures offers a number of advantages compared to other techniques commonly mentioned in the statistical–methodological literature.     

Confirmatory factor analysis with missing data in a small sample: cognitive reserve in people with Down Syndrome

Quality & Quantity - The presence of missing data and small sample sizes are very common in social and health sciences. Concurrently to present a methodology to solve the small sample size and...     

Monotone missing data and pattern-mixture models

It is shown that the classical taxonomy of missing data models, namely missing completely at random, missing at random and informative missingness, which has been developed almost exclusively within a selection modelling framework, can also be applied to pattern-mixture models. In particular, intuitively appealing identifying restrictions are proposed for a pattern-mixture MAR mechanism.     

Some model-restricted shrinkage estimators for contingency tables with missing data

For contingency tables with extensive missing data, the unrestricted MLE under the saturated model, computed by the EM algorithm, is generally unsatisfactory. In this case, it may be better to fit a simpler model by imposing some restrictions on the parameter space. Perlman and Wu (1999) propose lattice conditional independence (LCI) models for contingency tables with arbitrary missing data patterns. When this LCI model fits well, the restricted MLE under the LCI model is more accurate than the unrestricted MLE under the saturated model, but not in general. Here we propose certain empirical Bayes (EB) estimators that adaptively combine the best features of the restricted and unrestricted MLEs. These EB estimators appear to be especially useful when the observed data is sparse, even in cases where the suitability of the LCI model is uncertain. We also study a restricted EM algorithm (called the ER algorithm) with similar desirable features. Received: July 1999     

Inverse-probability-weighted logrank test for stratified survival data with missing measurements

The stratified logrank test can be used to compare survival distributions of several groups of patients, while adjusting for the effect of some discrete variable that may be predictive of the survival outcome. In practice, it can happen that this discrete variable is missing for some patients. An inverse-probability-weighted version of the stratified logrank statistic is introduced to tackle this issue. Its asymptotic distribution is derived under the null hypothesis of equality of the survival distributions. A simulation study is conducted to assess behavior of the proposed test statistic in finite samples. An analysis of a medical dataset illustrates the methodology.     

Maximum likelihood estimation for dynamic factor models with missing data

This paper concerns estimating parameters in a high-dimensional dynamic factor model by the method of maximum likelihood. To accommodate missing data in the analysis, we propose a new model representation for the dynamic factor model. It allows the Kalman filter and related smoothing methods to evaluate the likelihood function and to produce optimal factor estimates in a computationally efficient way when missing data is present. The implementation details of our methods for signal extraction and maximum likelihood estimation are discussed. The computational gains of the new devices are presented based on simulated data sets with varying numbers of missing entries.     

Testing the adequacy of varying coefficient models with missing responses at random

In this paper, we investigate checking the adequacy of varying coefficient models with response missing at random. In doing so, we first construct two completed data sets based on imputation and marginal inverse probability weighted methods, respectively. The empirical process-based tests by using these two completed data sets are suggested and the asymptotic properties of the test statistics under the null and local alternative hypotheses are studied. Because the limiting null distribution is intractable, a Monte Carlo approach is applied to approximate the distribution to determine critical values. Simulation studies are carried out to examine the performance of our method, and a real data set from an environmental study is analyzed for illustration.     

Robust influence diagnostics for generalized linear models with continuous responses

This article introduces two parametric robust diagnostic methods for detecting influential observations in the setting of generalized linear models with continuous responses. The legitimacy of the two proposed methods requires no knowledge of the true underlying distributions so long as their second moments exist. The performance of the two proposed influence diagnostic tools is investigated through limited simulation studies and the analyses of an illustration.     

Repeated measures and longitudinal data analysis using higher‐order entropies

This paper implements the generalized maximum entropy (GME) method in longitudinal data setup to investigate the regression para meters and correlation among the repeated measurements. We derive the GME system using Shannon classical entropy as well as some higher‐order entropies assuming an autoregressive correlation structure. This method is illustrated using two simulated examples to study the effect of changing the support range and compare the performance of the GME approach with the classical estimation methods.     

GMM redundancy results for general missing data problems

We consider questions of efficiency and redundancy in the GMM estimation problem in which we have two sets of moment conditions, where two sets of parameters enter into one set of moment conditions, while only one set of parameters enters into the other. We then apply these results to a selectivity problem in which the first set of moment conditions is for the model of interest, and the second set of moment conditions is for the selection process. We use these results to explain the counterintuitive result in the literature that, under an ignorability assumption that justifies GMM with weighted moment conditions, weighting using estimated probabilities of selection is better than weighting using the true probabilities. We also consider estimation under an exogeneity of selection assumption such that both the unweighted and the weighted moment conditions are valid, and we show that when weighting is not needed for consistency, it is also not useful for efficiency.     

Linear mixed-effects model for longitudinal complex data with diversified characteristics

The increasing richness of data encourages a comprehensive understanding of economic and financial activities, where variables of interest may include not only scalar (point-like) indicators, but also functional (curve-like) and compositional (pie-like) ones. In many research topics, the variables are also chronologically collected across individuals, which falls into the paradigm of longitudinal analysis. The complicated nature of data, however, increases the difficulty of modeling these variables under the classic longitudinal framework. In this study, we investigate the linear mixed-effects model (LMM) for such complex data. Different types of variables are first consistently represented using the corresponding basis expansions so that the classic LMM can then be conducted on them, which generalizes the theoretical framework of LMM to complex data analysis. A number of simulation studies indicate the feasibility and effectiveness of the proposed model. We further illustrate its practical utility in a real data study on Chinese stock market and show that the proposed method can enhance the performance and interpretability of the regression for complex data with diversified characteristics.     

Asymptotic normality of M-estimators in a semiparametric model with longitudinal data

Suppose that the longitudinal observations (Y _ij , X _ij , t _ij ) for i = 1, . . . ,n; j = 1, . . . ,m _i are modeled by the semiparamtric model where β ₀ is a k × 1 vector of unknown parameters, g(·) is an unknown estimated function and e _ij are unobserved disturbances. This article consider M-type regressions which include mean, median and quantile regressions. The M-estimator of the slope parameter β ₀ is obtained through piecewise local polynomial approximation of the nonparametric component. The local M-estimator of g(·) is also obtained by replacing β ₀ in model with its M-estimator and using local linear approximation. The asymptotic distribution of the estimator of β ₀ is derived. The asymptotic distributions of the local M-estimators of g(·) at both interior and boundary points are also established. Various applications of our main results are given. The research is supported in part by National Natural Science Foundation of China (Grant No. 10671089).     

Attrition in longitudinal panel data and the empirical analysis of dynamic labour market behaviour

In the empirical analysis of unemployment durations and job durations, it is generally assumed that the stochastic processes underlying labour market behaviour and the behaviour concerning participation in a panel survey are independent. However, there are reasons to believe that the probability of dropping out of the panel is related to the rate at which a (different) job is found. If there is such a relation, and if it is ignored, then the estimator of the rate at which individuals become employed or change jobs will generally be inconsistent. In this paper we analyse the relation between the duration spent in a particular labour market state and the duration of panel survey participation, by explicitly modelling and estimating the joint distribution of both durations. The emphasis will be on models allowing for stochastically related unobserved determinants of both types of duration. We estimate models both for unemployment durations and for job durations.     

Pseudo empirical likelihood method in the presence of missing data

In this paper, we propose an estimator for the population mean when some observations on the study and auxiliary variables are missing from the sample. The proposed estimator is valid for any unequal probability sampling design, and is based upon the pseudo empirical likelihood method. The proposed estimator is compared with other estimators in a simulation study.     

Inverse probability weighted estimation for general missing data problems

I study inverse probability weighted M-estimation under a general missing data scheme. Examples include M-estimation with missing data due to a censored survival time, propensity score estimation of the average treatment effect in the linear exponential family, and variable probability sampling with observed retention frequencies. I extend an important result known to hold in special cases: estimating the selection probabilities is generally more efficient than if the known selection probabilities could be used in estimation. For the treatment effect case, the setup allows a general characterization of a “double robustness” result due to Scharfstein et al. [1999. Rejoinder. Journal of the American Statistical Association 94, 1135–1146].