Characterizations of probability distributions via bivariate regression of record values

Bairamov et al. (Aust N Z J Stat 47:543–547, 2005) characterize the exponential distribution in terms of the regression of a function of a record value with its adjacent record values as covariates. We extend these results to the case of non-adjacent covariates. We also consider a more general setting involving monotone transformations. As special cases, we present characterizations involving weighted arithmetic, geometric, and harmonic means.     

Fisher information in record data

We present some general results on Fisher information (FI) contained in upper (or lower) record values and associated record times generated from a sequence of i.i.d. continuous variables. For the record data obtained from a random sample of fixed size, we establish an interesting relationship between its FI content and the FI in the data consisting of sequential maxima. We also consider the record data from an inverse sampling plan (Samaniego and Whitaker, 1986). We apply the general results to evaluate the FI in upper as well as lower records data from the exponential distribution for both sampling plans. Further, we discuss the implication of our results to statistical inference from these record data. Received: December 2001 Acknowledgements. This research was supported by Fondo Nacional de Desarrollo Cientifico y Tecnologico (FONDECYT) grants 7990089 and 1010222 of Chile. We would like to thank the Department of Statistics at the University of Concepción for its hospitality during the stay of H. N. Nagaraja in Chile in March of 2000, when the initial work was done. We are grateful to the two referees for various comments that let to improvements in the paper.     

Shannon information in record data

In this article we present results on the Shannon information (SI) contained in upper (lower) record values and associated record times in a sequence of i.i.d continuous variables. We then establish an interesting relationship between the SI content of a random sample of fixed size, and the SI in the data consisting of sequential maxima. We also consider the information contained in the record data from an inverse sampling plan (ISP).     

On the nearness of record values to order statistics from Pitman’s measure of closeness

In the two-sample prediction problem, record values from the present sample may be used as predictors of order statistics from a future sample. In this paper, we investigate the nearness of record statistics (upper and lower) to order statistics from a location-scale family of distributions in the sense of Pitman closeness and discuss the corresponding monotonicity properties. We then determine the closest record value to a specific order statistic from a future sample. Even though in general it depends on the parent distribution, exact and explicit expressions are derived for the required probabilities in the case of exponential and uniform distributions, and some computational results are presented as well. Finally, we consider the mean squared error criterion and examine the corresponding results in the exponential case.     

Moment inequalities for order statistics with applications to characterizations of distributions

General inequalities of Hölder type between moments of order statistics and moments of record values respectively are derived. Special choices of the involved sample sizes and ranks and discussions of when equality is attained in these inequalities yield several characterizations of well known distributions, such as the uniform, polynomial, Pareto, reflected Pareto, exponential, Weibull distribution and some others.     

Characterizations of bivariate distributions using concomitants of record values

In this paper, we consider a family of bivariate distributions which is a generalization of the Morgenstern family of bivariate distributions. We have derived some properties of concomitants of record values which characterize this generalized class of distributions. The role of concomitants of record values in the unique determination of the parent bivariate distribution has been established. We have also derived properties of concomitants of record values which characterize each of the following families viz Morgenstern family, bivariate Pareto family and a generalized Gumbel’s family of bivariate distributions. Some applications of the characterization results are discussed and important conclusions based on the characterization results are drawn.     

A note on estimation based on record data

In data-processing standpoint, an efficient algorithm for identifying the minimum value among a set of measurements are record statistics. From a sequence of n independent identically distributed continuous random variables only about log(n) records are expected, so we expect to have little data, hence any prior information is welcome (Houchens, Record value theory and inference, Ph.D. thesis, University of California, Riverside, 1984). In this paper, non-Bayesian and Bayesian estimates are derived for the two parameters of the Exponential distribution based on record statistics with respect to the squared error and Linear-Exponential loss functions and then compared with together. The admissibility of some estimators is discussed.     

On characterizations of distributions by expected values of order statistics and record values with gap

In this paper, we obtain some recurrence relationships for conditional expectations of nonadjacent order statistics and record values when the distribution function is absolutely continuous, and we prove that the distribution function is uniquely determined by the distribution of conditioned record values and by the expected values of these records. Further, different distributions are characterized by these relationships.     

On the Fisher information in record values

In this article, we establish some general results concerning the comparison of the amount of the Fisher information contained in n record values with the Fisher information contained in n iid observations from the original distribution. Some common distributions are classified according to this criterion. We also propose some methods of estimation based on record values. The results may be of interest in some life testing problems. Received: September 1999     

Conditional distributions of generalized order statistics and some characterizations

Generalized order statistics have been introduced in Kamps (1995a). They enable a unified approach to several models of ordered random variables, e.g. (ordinary) order statistics, record values, sequential order statistics, record values from non-identical distributions. The purpose of this paper is to develop conditional distributions of one generalized order statistic given another and to characterize the underlying continuous distribution by different conditional expectations. Well-known results for ordinary order statistics and record values are extended to generalized order statistics. Received: July 1997     

Een toepassing van "importance sampling"

Summary  This paper describes an experiment with "importance sampling", to show how much reduction of the computation time and sample size can be achieved in comparison with the usual Monte Carlo method. A comparison is made between each of the three methods of "importance sampling" and the usual Monte Carlo method by the determination of the expression

Of the three methods A, B and C the first one uses the shifted exponential distribution, the second one uses the gamma distribution, and the third one uses the exponential distribution with modified parameter. These three methods have all smaller variances, ranges and sample sizes than the usual Monte Carlo method. Their order of preference is A, B, C. With respect to computing time only the method A is significantly better. So only the method A is an improvement in respect of both the sample size and the computing time.     

Inference for the two-parameter bathtub-shaped distribution based on record data

Here we consider the record data from the two-parameter of bathtub-shaped distribution. First, we develop simplified forms for the single moments, variances and covariance of records. These distributional properties are quite useful in obtaining the best linear unbiased estimators of the location and scale parameters which can be included in the model. The estimation of the unknown shape parameters and prediction of the future unobserved records based on some observed ones are discussed. Frequentist and Bayesian analyses are adopted for conducting the estimation and prediction problems. The likelihood method, moment based method, bootstrap methods as well as the Bayesian sampling techniques are applied for the inference problems. The point predictors and credible intervals of future record values based on an informative set of records can be developed. Monte Carlo simulations are performed to compare the so developed methods and one real data set is analyzed for illustrative purposes.     

Decision theoretic estimation using record statistics

We consider the problem of estimating the scale parameter θ of the shifted exponential distribution with unknown shift based on a set of observed records drawn from a sequential sample of independent and identically distributed random variables. Under a large class of bowl-shaped loss functions, the best affine equivariant estimator (BAEE) of θ is shown to be inadmissible. Two dominating procedures are proposed. A numerical study is performed to show the extent of risk reduction that the improved estimators provide over the BAEE.     

Een toepassing van “importance sampling”

Summary This paper describes an experiment with “importance sampling”, to show how much reduction of the computation time and sample size can be achieved in comparison with the usual Monte Carlo method. A comparison is made between each of the three methods of “importance sampling” and the usual Monte Carlo method by the determination of the expression Of the three methods A, B and C the first one uses the shifted exponential distribution, the second one uses the gamma distribution, and the third one uses the exponential distribution with modified parameter. These three methods have all smaller variances, ranges and sample sizes than the usual Monte Carlo method. Their order of preference is A, B, C. With respect to computing time only the method A is significantly better. So only the method A is an improvement in respect of both the sample size and the computing time.     

The rate of convergence in law of the maximum of an exponential sample

Summary  We derive a uniform rate of convergence of (1– n^-1x)ⁿ to e^-x(x < 0). It provides a uniform rate of convergence for the distribution of the largest order statistic in a sample from an exponential distribution to the "double exponential" extreme value distribution. It likewise provides a rate of convergence for the distribution of the smallest order statistic from a uniform distribution.     

Precedence-type tests based on record values

Precedence-type tests based on order statistics are simple and efficient nonparametric tests that are very useful in the context of life-testing, and they have been studied quite extensively in the literature; see Balakrishnan and Ng (Precedence-type tests and applications. Wiley, Hoboken, 2006). In this paper, we consider precedence-type tests based on record values and develop specifically record precedence test, record maximal precedence test and record-rank-sum test. We derive their exact null distributions and tabulate some critical values. Then, under the general Lehmann alternative, we derive the exact power functions of these tests and discuss their power under the location-shift alternative. We also establish that the record precedence test is the uniformly most powerful test for testing against the one-parameter family of Lehmann alternatives. Finally, we discuss the situation when we have insufficient number of records to apply the record precedence test and then make some concluding remarks.     

Record values of the Lomax distribution

In this paper, firstly an introduction to the idea of record values for a sequence of independent and identically (Lomax or Pareto II) distributed random variables is given. Some of the distributional properties of these record values and moments up to second order are derived. These moments clearly depend on the location, scale and shape parameter of the Lomax distribution and two types of estlmators of these parameters, based on a series of observed record values are presented.     

An information theoretic argument for the validity of the exponential model

Based on the Cramér-Rao inequality (in the multiparameter case) the lower bound of Fisher information matrix is achieved if and only if the underlying distribution is ther-parameter exponential family. This family and the lower bound of Fisher information matrix are characterized when some constraints in the form of expected values of some statistics are available. If we combine the previous results we can find the class of parametric functions and the corresponding UMVU estimators via Cramér-Rao inequality.     

Efficiency of iterated WLS in the linear model with completely unknown heteroskedasticity

Iterated weighted least squares (IWLS) is investigated for estimating the regression coefficients in a linear model with symmetrically distributed errors. The variances of the errors are not specified; it is not assumed that they are unknown functions of the explanatory variables nor that they are given in some parametric way.
IWLS is carried out in a random number of steps, of which the first one is OLS. In each step the error variance at time t is estimated with a weighted sum of m squared residuals in the neighbourhood of t and the coefficients are estimated using WLS. Furthermore an estimate of the co-variance matrix is obtained. If this estimate is minimal in some way the iteration process is stopped.
Asymptotic properties of IWLS are derived for increasing sample size n . Some particular cases show that the asymptotic efficiency can be increased by allowing more than two steps. Even asymptotic efficiency with respect to WLS with the true error variances can be obtained if m is not fixed but tends to infinity with n and if the heteroskedasticity is smooth.     

The misclassification error of the maximum likelihood procedure when deciding among a finite choice of distributions

Suppose we have a sample randomly drawn from one of a given number of distributions. We wish to select the distribution based on the optimal maximum likelihood procedure. In this note, various tight estimates are derived under general conditions for the probability of making the wrong selection. The estimates are also extended to the case of many exponential families, where the general conditions fail. Some of the estimates are illustrated by means of simulation. The practical use of the estimates is discussed.