A generalized maximum likelihood characterization of the normal distribution

LetP be a probability measure on ℝ andI _x be the set of alln-dimensional rectangles containingx. If for allx ∈ ℝⁿ and θ ∈ ℝ the inequality holds,P is a normal distributioin with mean 0 or the unit mass at 0. The result generalizes Teicher’s (1961) maximum likelihood characterization of the normal density to a characterization ofN(0, σ²) amongall distributions (including those without density). The m.l. principle used is that of Scholz (1980).     

Berry–Esseen bounds for density estimates under NA assumption

Let {X _j } be a strictly stationary sequence of negatively associated random variables with the marginal probability density function f(x). The recursive kernel estimators of f(x) are defined by

Consistent estimation in the presence of incidental parameters

Summary Let (X,A) be a measurable space andP _ϑη |A (ϑη) ∈ Θ x H, ∥A, (θ, η) ∈ Θ×H, a parametrized family of probability measures (for short:p-measures). This paper is concerned with the problem of consistently estimatingθ from realizations governed by , where η^u ∈ H, v ∈ ℕ, are unknown.     

Boundedly complete families which are not complete

Summary Completeness of a family of probability distributions implies its bounded completeness but not conversely. An example of a family which is boundedly complete but not complete was presented by Lehmann and Scheffe [5]. This appears to be the only such example quoted in the statistical literature. The purpose of this note is to provide further examples of this type. It is shown that any given family of power series distributions can be used to construct a class containing infinitely many boundedly complete, but not complete, families. Furthermore, it is shown that the family of continuous distributions , is boundedly complete, but not complete, whereU denotes the uniform distribution on [a, b] and {P _ϑ,ϑ ∈ IR}, is a translation family generated by a distributionP ₀ with mean value zero, which is continuous with respect to the Lebesgue measure.     

Asymptotically optimal nonparametric one- and two-way analysis of variance tests for the log linear model under censoring

We considerr ×c populations with failure ratesλ _ij(t) satisfying the condition

Distributions determined by conditioning on a pair of order statistics

LetX ₁,X ₂, ...,X _n (n≥3) be a random sample on a random variableX with distribution functionF having a unique continuous inverseF ⁻¹ over (a,b), −∞≤a<b≤∞ the support ofF. LetX _1:n <X _2:n <...<X _n:n be the corresponding order statistics. Letg be a nonconstant continuous function over (a,b). Then for some functionG over (a, b) and for some positive integersr ands, 1<r+1<s≤n

Consistency of a nonparametric estimation of a density functional

LetX be a random variable with distribution functionF and density functionf. Let ? and ψ be known measurable functions defined on the real lineR and the closed interval [0, 1], respectively. This paper proposes a smooth nonparametric estimate of the density functional \(\theta = \int\limits_R \phi (x) \psi \left[ {F (x)} \right]f^2 (x) dx\) based on a random sampleX ₁, ...,X _n fromF using a kernel functionk. The proposed estimate is given by \(\hat \theta = (n^2 a_n )^{ - 1} \mathop \sum \limits_{i = 1}^n \mathop \sum \limits_{j = 1}^n \phi (X_i ) \psi \left[ {\hat F (X_i )} \right]k\left[ {(X_i - X_j )/a_n } \right]\) , where \(\hat F(x) = n^{ - 1} \mathop \sum \limits_{i = 1}^n K\left[ {(x - X_i )/a_n } \right]\) with \(K (w) = \int\limits_{ - \infty }^w {k (u) } du\) . The estimate \(\hat \theta \) is shown to be consistent both in the weak and strong sense and is used to estimate the asymptotic relative efficiency of various nonparametric tests, with particular reference to those using the Chernoff-Savage statistic.     

A note on minimum variance

Summary Minimizing is discussed under the unbiasedness condition: and the condition (A):f _i (x) (i=1, ..., p) are linearly independent , and .     

A note on generalized wald’s method

Let {v _n(θ)} be a sequence of statistics such that whenθ =θ ₀,v _n(θ ₀) N _p(0,Σ), whereΣ is of rankp andθ εR ^d. Suppose that underθ =θ ₀, {Σ _n} is a sequence of consistent estimators ofΣ. Wald (1943) shows thatv _n ^T (θ ₀)Σ _n ⁻¹ v _n(θ ₀) x ²(p). It often happens thatv _n(θ ₀) N _p(0,Σ) holds butΣ is singular. Moore (1977) states that under certain assumptionsv _n ^T (θ ₀)Σ _n ⁻ v _n(θ ₀) x ²(k), wherek = rank (Σ) andΣ _n ⁻ is a generalized inverse ofΣ _n. However, Moore’s result as stated is incorrect. It needs the additional assumption that rank (Σ _n) =k forn sufficiently large. In this article, we show that Moore’s result (as corrected) holds under somewhat different, but easier to verify, assumptions. Research partly supported by the U.S. Army Research Office through the Mathematical Sciences Institute at Cornell University.     

On functionals of order statistics

Summary Let g_n be real functions,U _ni, 1in, the ordered sample ofn independentU(0,1) distributed random variables, andc _ni(), 1in, 01 be (known) real numbers,n=1, 2, ... The random quantity , 01, is studied. Based on a method proposed byShorack [1972] the main result is the weak convergence of to Gaussian processes, where , 01. The convergence is with respect to theSkorokhod [1956]-topologiesM ₂,M ₁ onD (I) and the -topology onC(I), depending on the conditions imposed on thec _ni().     

Reproducibility in the one-parameter exponential family

Summary LetX ₁, ...,X _n be i.i.d. random variables with common distribution an element of a linear one-parameter exponential family indexed by a natural parameter . It is proved that the distribution of is an element ofF, for all andn=1, 2, ... if and only ifF is a family of scale transformed Poisson distributions.     

The average number of events per time unit and its estimation

Let ζ _t be the number of events which will be observed in the time interval [0;t] and define as the average number of events per time unit if this limit exists. In the case of i.i.d. waiting-times between the events,E[ζ _t ] is the renewal function and it follows from well-known results of renewal theory thatA exists and is equal to 1/τ, if τ>0 is the expectation of the waiting-times. This holds true also when τ = ∞.A may be estimate by ζ _t /t or where is the mean of the firstn waiting-timesX ₁,X ₂, ...,X _n . Both estimators converage with probability 1 to 1/τ if theX _i are i.i.d.; but the expectation of may be infinite for alln and also if it is finite, is in general a positively biased estimator ofA. For a stationary renewal process, ζ _t /t is unbiased for eacht; if theX _i are i.i.d. with densityf(x), then ζ _t /t has this property only iff(x) is of the exponential type and only for this type the numbers of events in consecutive time intervals [0,t], [t, 2t], ... are i.i.d. random variables for arbitraryt > 0.     

Almost sure central limit theorem for the products of <Emphasis Type="Italic">U</Emphasis>-statistics

Let (X _n ) be a sequence of i.i.d random variables and U _n a U-statistic corresponding to a symmetric kernel function h, where h ₁(x ₁) = Eh(x ₁, X ₂, X ₃, . . . , X _m ), μ = E(h(X ₁, X ₂, . . . , X _m )) and ? ₁ = Var(h ₁(X ₁)). Denote \({\gamma=\sqrt{\varsigma_{1}}/\mu}\), the coefficient of variation. Assume that P(h(X ₁, X ₂, . . . , X _m ) > 0) = 1, ? ₁ > 0 and E|h(X ₁, X ₂, . . . , X _m )|³ < ∞. We give herein the conditions under which

$\lim_{N\rightarrow\infty}\frac{1}{\log N}\sum_{n=1}^{N}\frac{1}{n}g\left(\left(\prod_{k=m}^{n}\frac{U_{k}}{\mu}\right)^{\frac{1}{m\gamma\sqrt{n}}}\right) =\int\limits_{-\infty}^{\infty}g(x)dF(x)\quad {\rm a.s.}$

for a certain family of unbounded measurable functions g, where F(·) is the distribution function of the random variable \({\exp(\sqrt{2} \xi)}\) and ξ is a standard normal random variable.

     

Contributions to nonparametric generalized failure rate function estimation

For a specified distribution functionG with densityg, and unknown distribution functionF with densityf, the generalized failure rate function (x)=f(x)/gG ^–1 F(x) may be estimated by replacingf andF byf _n and , wheref _n is an empirical density function based on a sample of sizen from the distribution functionF, and . Under regularity conditions we show and, under additional restrictions whereC is a subset ofR and _n. Moreover, asymptotic normality is derived and the Berry-Esséen type bound is shown to be related to a theorem which concerns the sum of i.i.d. random variables. The order boundO(n^–1/2+c _n ^1/2 ) is established under mild conditions, wherec _n is a sequence of positive constants related tof _n and tending to 0 asn.Research was supported in part by the Army, Navy and Air Force under Office of Naval Research contract No. N00014-76-C-0608. AMS 1970 subject classifications. Primary 62G05. Secondary 60F15.