The effect of a Durbin–Watson pretest on confidence intervals in regression

Consider a linear regression model and suppose that our aim is to find a confidence interval for a specified linear combination of the regression parameters. In practice, it is common to perform a Durbin–Watson pretest of the null hypothesis of zero first‐order autocorrelation of the random errors against the alternative hypothesis of positive first‐order autocorrelation. If this null hypothesis is accepted then the confidence interval centered on the ordinary least squares estimator is used; otherwise the confidence interval centered on the feasible generalized least squares estimator is used. For any given design matrix and parameter of interest, we compare the confidence interval resulting from this two‐stage procedure and the confidence interval that is always centered on the feasible generalized least squares estimator, as follows. First, we compare the coverage probability functions of these confidence intervals. Second, we compute the scaled expected length of the confidence interval resulting from the two‐stage procedure, where the scaling is with respect to the expected length of the confidence interval centered on the feasible generalized least squares estimator, with the same minimum coverage probability. These comparisons are used to choose the better confidence interval, prior to any examination of the observed response vector.     

Confidence intervals for maximal reliability in tau‐equivalent models

Subjective probabilities play an important role in marketing research, for example where individuals rate the likelihood that they will purchase a new developed product. The tau‐equivalent model can describe the joint behaviour of multiple test items measuring the same subjective probability. In this paper we stress the use of confidence intervals to assess reliability, as this allows for a more critical assessment of the items as measurement instruments. To improve the reliability one can use a weighted sum as the outcome of the test rather than an unweighted sum. In principle, the weights may be chosen so as to obtain maximal reliability. We propose two new confidence intervals for the maximal reliability in the tau‐equivalent model and we compare these two new intervals with intervals derived earlier in Yuan and Bentler (Psychometrika, 67 , 2002, 251) and Raykov and Penev (Multivariate Behavioral Research, 41 , 2006, 15). The comparison involves coverage curves, a methodology that is new in the field of reliability. The existing Yuan–Bentler and Raykov–Penev intervals are shown to overestimate the maximal reliability, whereas one of our proposed intervals, the stable interval, performs very well. This stable interval hardly shows any bias, and has a coverage for the true value which is approximately equal to the confidence level.     

Generalized confidence intervals for process capability indices in the one-way random model

The method of generalized confidence intervals is proposed as an alternative method for constructing confidence intervals for process capability indices under the one-way random model for balanced as well as unbalanced data. The generalized lower confidence limits and the coverage probabilities for three commonly used capability indices were studied via simulation, separately for balanced and unbalanced cases. Simulation results showed that the generalized confidence interval procedure is quite satisfactory both in the balanced and unbalanced cases. Examples are provided to illustrate the results.     

Conditional assessment of the impact of a Hausman pretest on confidence intervals

In the analysis of clustered and longitudinal data, which includes a covariate that varies both between and within clusters, a Hausman pretest is commonly used to decide whether subsequent inference is made using the linear random intercept model or the fixed effects model. We assess the effect of this pretest on the coverage probability and expected length of a confidence interval for the slope, conditional on the observed values of the covariate. This assessment has the advantages that it (i) relates to the values of this covariate at hand, (ii) is valid irrespective of how this covariate is generated, (iii) uses exact finite sample results, and (iv) results in an assessment that is determined by the values of this covariate and only two unknown parameters. For two real data sets, our conditional analysis shows that the confidence interval constructed after a Hausman pretest should not be used.     

Confidence Intervals for the Area Under the Receiver Operating Characteristic Curve in the Presence of Ignorable Missing Data

Receiver operating characteristic curves are widely used as a measure of accuracy of diagnostic tests and can be summarised using the area under the receiver operating characteristic curve (AUC). Often, it is useful to construct a confidence interval for the AUC; however, because there are a number of different proposed methods to measure variance of the AUC, there are thus many different resulting methods for constructing these intervals. In this article, we compare different methods of constructing Wald‐type confidence interval in the presence of missing data where the missingness mechanism is ignorable. We find that constructing confidence intervals using multiple imputation based on logistic regression gives the most robust coverage probability and the choice of confidence interval method is less important. However, when missingness rate is less severe (e.g. less than 70%), we recommend using Newcombe's Wald method for constructing confidence intervals along with multiple imputation using predictive mean matching.     

Confidence Distribution,the Frequentist Distribution Estimator of a Parameter: A Review

In frequentist inference, we commonly use a single point (point estimator) or an interval (confidence interval/“interval estimator”) to estimate a parameter of interest. A very simple question is: Can we also use a distribution function (“distribution estimator”) to estimate a parameter of interest in frequentist inference in the style of a Bayesian posterior? The answer is affirmative, and confidence distribution is a natural choice of such a “distribution estimator”. The concept of a confidence distribution has a long history, and its interpretation has long been fused with fiducial inference. Historically, it has been misconstrued as a fiducial concept, and has not been fully developed in the frequentist framework. In recent years, confidence distribution has attracted a surge of renewed attention, and several developments have highlighted its promising potential as an effective inferential tool. This article reviews recent developments of confidence distributions, along with a modern definition and interpretation of the concept. It includes distributional inference based on confidence distributions and its extensions, optimality issues and their applications. Based on the new developments, the concept of a confidence distribution subsumes and unifies a wide range of examples, from regular parametric (fiducial distribution) examples to bootstrap distributions, significance (p‐value) functions, normalized likelihood functions, and, in some cases, Bayesian priors and posteriors. The discussion is entirely within the school of frequentist inference, with emphasis on applications providing useful statistical inference tools for problems where frequentist methods with good properties were previously unavailable or could not be easily obtained. Although it also draws attention to some of the differences and similarities among frequentist, fiducial and Bayesian approaches, the review is not intended to re‐open the philosophical debate that has lasted more than two hundred years. On the contrary, it is hoped that the article will help bridge the gaps between these different statistical procedures.     

Maximum likelihood estimation of a binomial proportion using one‐sample misclassified binary data

In this article, we construct two likelihood‐based confidence intervals (CIs) for a binomial proportion parameter using a double‐sampling scheme with misclassified binary data. We utilize an easy‐to‐implement closed‐form algorithm to obtain maximum likelihood estimators of the model parameters by maximizing the full‐likelihood function. The two CIs are a naïve Wald interval and a modified Wald interval. Using simulations, we assess and compare the coverage probabilities and average widths of our two CIs. Finally, we conclude that the modified Wald interval, unlike the naïve Wald interval, produces close‐to‐nominal CIs under various simulations and, thus, is preferred in practice. Utilizing the expressions derived, we also illustrate our two CIs for a binomial proportion parameter using real‐data example.     

Asymptotic infimum coverage probability for interval estimation of proportions

In this paper, we discuss asymptotic infimum coverage probability (ICP) of eight widely used confidence intervals for proportions, including the Agresti–Coull (A–C) interval (Am Stat 52:119–126, 1998) and the Clopper–Pearson (C–P) interval (Biometrika 26:404–413, 1934). For the A–C interval, a sharp upper bound for its asymptotic ICP is derived. It is less than nominal for the commonly applied nominal values of 0.99, 0.95 and 0.9 and is equal to zero when the nominal level is below 0.4802. The \(1-\alpha \) C–P interval is known to be conservative. However, we show through a brief numerical study that the C–P interval with a given average coverage probability \(1-\gamma \) typically has a similar or larger ICP and a smaller average expected length than the corresponding A–C interval, and its ICP approaches to \(1-\gamma \) when the sample size goes large. All mathematical proofs and R-codes for computation in the paper are given in Supplementary Materials.     

Empirical likelihood inference for semi-parametric varying-coefficient partially linear EV models

In this paper, we apply empirical likelihood method to study the semi-parametric varying-coefficient partially linear errors-in-variables models. Empirical log-likelihood ratio statistic for the unknown parameter β, which is of primary interest, is suggested. We show that the proposed statistic is asymptotically standard chi-square distribution under some suitable conditions, and hence it can be used to construct the confidence region for the parameter β. Some simulations indicate that, in terms of coverage probabilities and average lengths of the confidence intervals, the proposed method performs better than the least-squares method. We also give the maximum empirical likelihood estimator (MELE) for the unknown parameter β, and prove the MELE is asymptotically normal under some suitable conditions.     

Estimated Precision for Predictions from Generalized Linear Models in Sociological Research

In this paper I present a general method forconstructing confidence intervals for predictionsfrom the generalized linear model in sociologicalresearch. I demonstrate that the method used forconstructing confidence intervals for predictions inclassical linear models is indeed a special case ofthe method for generalized linear models. I examinefour such models – the binary logit, the binaryprobit, the ordinal logit, and the Poissonregression model – to construct confidence intervalsfor predicted values in the form of probability,odds, Z score, or event count. The estimatedconfidence interval for an event prediction, whenapplied judiciously, can give the researcher usefulinformation and an estimated measure of precisionfor the prediction so that interpretation ofestimates from the generalized linear model becomeseasier.     

Highest posterior mass prediction intervals for binomial and poisson distributions

The problems of constructing prediction intervals (PIs) for the binomial and Poisson distributions are considered. New highest posterior mass (HPM) PIs based on fiducial approach are proposed. Other fiducial PIs, an exact PI and approximate PIs are reviewed and compared with the HPM-PIs. Exact coverage studies and expected widths of prediction intervals show that the new prediction intervals are less conservative than other fiducial PIs and comparable with the approximate one based on the joint sampling approach for the binomial case. For the Poisson case, the HPM-PIs are better than the other PIs in terms of coverage probabilities and precision. The methods are illustrated using some practical examples.     

Generalized confidence intervals for the process capability index C pm

Process capability indices have been proposed to the manufacturing industry for measuring process reproduction capability. The C _pm index takes into account the degree of process targeting (centering), which essentially measures process performance based on average process loss. To properly and accurately estimate the capability index, numerous conventional approaches have been proposed to obtain lower limits of the classical confidence intervals (CLCLs) for providing process capability information. In particular, lower confidence limits (LCLs) not only provide critical information regarding process performance but are used to determine if an improvement was made in reducing the nonconforming percent and the process expected loss. However, the conventional approach lacks for exact confidence intervals for C _pm involving unknown parameters which is a notable shortcoming. To remedy this, the method of generalized confidence intervals (GCIs) is proposed as an extension of classical confidence intervals (CCIs). For evaluating practical applications, two lower limits of generalized confidence intervals (GLCLs) for C _pm using generalized pivotal quantities (GPQs) are considered, (i) to assess the minimum performance of one manufacturing process/one supplier, and (ii) to assess the smallest performance of several manufacturing processes/several suppliers for equal as well as unequal process variances.     

Estimation in generalized bivariate Birnbaum–Saunders models

In this paper, we propose two moment-type estimation methods for the parameters of the generalized bivariate Birnbaum–Saunders distribution by taking advantage of some properties of the distribution. The proposed moment-type estimators are easy to compute and always exist uniquely. We derive the asymptotic distributions of these estimators and carry out a simulation study to evaluate the performance of all these estimators. The probability coverages of confidence intervals are also discussed. Finally, two examples are used to illustrate the proposed methods.     

An approximation method to derive confidence intervals for quantiles with some applications

Standard jackknife confidence intervals for a quantile Q _y (β) are usually preferred to confidence intervals based on analytical variance estimators due to their operational simplicity. However, the standard jackknife confidence intervals can give undesirable coverage probabilities for small samples sizes and large or small values of β. In this paper confidence intervals for a population quantile based on several existing estimators of a quantile are derived. These intervals are based on an approximation for the cumulative distribution function of a studentized quantile estimator. Confidence intervals are empirically evaluated by using real data and some applications are illustrated. Results derived from simulation studies show that proposed confidence intervals are narrower than confidence intervals based on the standard jackknife technique, which assumes normal approximation. Proposed confidence intervals also achieve coverage probabilities above to their nominal level. This study indicates that the proposed method can be an alternative to the asymptotic confidence intervals, which can be unknown in practice, and the standard jackknife confidence intervals, which can have poor coverage probabilities and give wider intervals.     

Purchasing Power Parity and the Taylor Rule

It is well known that there is a large degree of uncertainty around Rogoff's consensus half‐life of the real exchange rate. To obtain a more efficient estimator, we develop a system method that combines the Taylor rule and a standard exchange rate model to estimate half‐lives. Further, we propose a median unbiased estimator for the system method based on the generalized method of moments with non‐parametric grid bootstrap confidence intervals. Applying the method to real exchange rates of 18 developed countries against the US dollar, we find that most half‐life estimates from the single equation method fall in the range of 3–5 years, with wide confidence intervals that extend to positive infinity. In contrast, the system method yields median‐unbiased estimates that are typically shorter than 1 year, with much sharper 95% confidence intervals. Our Monte Carlo simulation results are consistent with an interpretation of these results that the true half‐lives are short but long half‐life estimates from single‐equation methods are caused by the high degree of uncertainty of these methods. Copyright © 2014 John Wiley & Sons, Ltd.     

The Coverage Properties of Confidence Regions After Model Selection

It is very common in applied frequentist ("classical") statistics to carry out a preliminary statistical (i.e. data-based) model selection by, for example, using preliminary hypothesis tests or minimizing AIC. This is usually followed by the inference of interest, using the same data, based on the assumption that the selected model had been given to us  a priori . This assumption is false and it can lead to an inaccurate and misleading inference. We consider the important case that the inference of interest is a confidence region. We review the literature that shows that the resulting confidence regions typically have very poor coverage properties. We also briefly review the closely related literature that describes the coverage properties of prediction intervals after preliminary statistical model selection. A possible motivation for preliminary statistical model selection is a wish to utilize uncertain prior information in the inference of interest. We review the literature in which the aim is to utilize uncertain prior information directly in the construction of confidence regions, without requiring the intermediate step of a preliminary statistical model selection. We also point out this aim as a future direction for research.     

Approximate confidence and tolerance limits for the discrete Pareto distribution for characterizing extremes in count data

Statistical tolerance intervals for discrete distributions are widely employed for assessing the magnitude of discrete characteristics of interest in applications like quality control, environmental monitoring, and the validation of medical devices. For such data problems, characterizing extreme counts or outliers is also of considerable interest. These applications typically use traditional discrete distributions, like the Poisson, binomial, and negative binomial. The discrete Pareto distribution is an alternative yet flexible model for count data that are heavily right‐skewed. Our contribution is the development of statistical tolerance limits for the discrete Pareto distribution as a strategy for characterizing the extremeness of observed counts in the tail. We discuss the coverage probabilities of our procedure in the broader context of known coverage issues for statistical intervals for discrete distributions. We address this issue by applying a bootstrap calibration to the confidence level of the asymptotic confidence interval for the discrete Pareto distribution's parameter. We illustrate our procedure on a dataset involving cyst formation in mice kidneys.     

Are robust estimation methods useful in the structural errors-in-variables model?

Summary In this paper it is investigated whether robust estimation procedures for the parameters of a regression model are also applicable when the observations are generated by the errors-in-variables model. Specifically, attention is paid to bounded-influence estimators, i.e. estimators that are constructed in such a way that the influence of a single observation on the outcome of the estimator is bounded. Both the classical errors-in-variables model and models with contaminated observational errors are considered.The authors are indebted to a referee for his valuable comments on an earlier version of this paper.     

New classes of improved confidence intervals for the variance of a normal distribution

Two new classes of improved confidence intervals for the variance of a normal distribution with unknown mean are constructed. The first one is a class of smooth intervals. Within this class, a subclass of generalized Bayes intervals is found which contains, in particular, the Brewster and Zidek-type interval as a member. The intervals of the second class, though non-smooth, have a very simple and explicit functional form. The Stein-type interval is a member of this class and is shown to be empirical Bayes. The construction extends Maruyama’s (Metrika 48:209–214, 1998) point estimation technique to the interval estimation problem.     

Confidence intervals for two-dimensional data with circular tolerances in a gauge R&R study

In this paper, we discuss our application of the Bootstrap method to construct the confidence interval of the diameter for two-dimensional data with circular tolerances in a gauge repeatability and reproducibility study. Factors simulated to validate performance include: the variance component, and sample size. The simulation results show that the Bootstrap method can cover the stated nominal coefficient in most scenarios. There exists a positive correlation between width of confidence intervals and variance components; the width of confidence intervals for diameters is increased when the variance components ([^(s)]_x², [^(s)]_y² or [^(s)]_xy²){(\hat{{\sigma}}_x^2, \hat{{\sigma}}_y^2\,{\rm or}\,\hat{{\sigma}}_{xy}^2)} are increased. The coverage proportion is not significantly affected by variance-components. Also, the width of confidence interval for the diameter and coverage proportion is not significantly affected by sample size. One real example based on a nested design is used to demonstrate the application of the proposed method.