Stability of characterizations of normal distributions based on the conditional expected values of the sample skewness and the sample kurtosis

Characterizations of normal distributions given by Nguyen and Dinh (1998) based on conditional expected values of the sample skewness and the sample kurtosis, given the sample mean and the sample variance, are shown to be stable. Received: September 1998     

On distances and goodness-of-fit tests for detecting multimodal distributions

Various distances between distributions and between densities are considered. The corresponding goodness-of-fit tests derived from them are examined for their abilities to detect multimodal alternatives. It is found that many well known techniques fail to detect such alternatives, while others do better in terms of their power results. These are mainly the tests derived from the variational metric which are based on spacings and gaps.     

Extended Neyman smooth goodness-of-fit tests,applied to competing heavy-tailed distributions

A simplified version of the Neyman (1937) “Smooth” goodness-of-fit test is extended to account for the presence of estimated model parameters, thereby removing overfitting bias. Using a Lagrange Multiplier approach rather than the Likelihood Ratio statistic proposed by Neyman greatly simplifies the calculations. Polynomials, splines, and the step function of Pearson’s test are compared as alternative perturbations to the theoretical uniform distribution. The extended tests have negligible size distortion and more power than standard tests. The tests are applied to competing symmetric leptokurtic distributions with US stock return data. These are generally rejected, primarily because of the presence of skewness.     

KMT-type inequalities and goodness-of-fit tests

The implications of the probability inequality of Komløs, Major and Tusnády (1975) for the theory of goodness-of-fit tests, especially tests based on stochastic integrals with respect to the basic martingale in the random censoring model, are discussed. Choices of the integrand of the stochastic integral which yield highly efficient generalized rank and supremum type tests are given for the simple as well as the composite null hypothesis.     

Asymptotic properties of MLE and UMVUE in one-parameter truncated distributions

Consider one-parameter families of continuous distributions whose range depend on an unknown parameter. In case a single sufficient and complete statistic exists, we obtain the limiting distributions of MLE and UMVUE. Both distributions are different transformations of a standard exponential variable.     

Characterizations of the Pareto and related distributions

In this note, a class of Pareto distributions is characterized based on the Shannon entropy of k-record statistics. As a consequence of that characterizations of the uniform and exponential distributions are given. Received: October 1999     

Exact confidence sets and goodness-of-fit methods for stable distributions

Usual inference methods for stable distributions are typically based on limit distributions. But asymptotic approximations can easily be unreliable in such cases, for standard regularity conditions may not apply or may hold only weakly. This paper proposes finite-sample tests and confidence sets for tail thickness and asymmetry parameters (α$\alpha$ and β$\beta$) of stable distributions. The confidence sets are built by inverting exact goodness-of-fit tests for hypotheses which assign specific values to these parameters. We propose extensions of the Kolmogorov–Smirnov, Shapiro–Wilk and Filliben criteria, as well as the quantile-based statistics proposed by McCulloch (1986) in order to better capture tail behavior. The suggested criteria compare empirical goodness-of-fit or quantile-based measures with their hypothesized values. Since the distributions involved are quite complex and non-standard, the relevant hypothetical measures are approximated by simulation, and p$p$-values are obtained using Monte Carlo (MC) test techniques. The properties of the proposed procedures are investigated by simulation. In contrast with conventional wisdom, we find reliable results with sample sizes as small as 25. The proposed methodology is applied to daily electricity price data in the US over the period 2001–2006. The results show clearly that heavy kurtosis and asymmetry are prevalent in these series.     

Determining the optimal process means under mixture normal distributions

In this paper, we consider that the working environment has certain states, and in every state, the parameters of quality characteristics are different. Thus, if we set the characteristics parameters in a specified state, these parameters will change to another state. To describe this situation, we use a mixture of normal distributions, which comprise a flexible and powerful statistical-based modeling tool in practice. Under the step loss function and the piecewise linear loss function, we select the optimal means for the proposed manufacturing process.     

Characterizations of probability distributions via bivariate regression of record values

Bairamov et al. (Aust N Z J Stat 47:543–547, 2005) characterize the exponential distribution in terms of the regression of a function of a record value with its adjacent record values as covariates. We extend these results to the case of non-adjacent covariates. We also consider a more general setting involving monotone transformations. As special cases, we present characterizations involving weighted arithmetic, geometric, and harmonic means.     

Distribution-free specification tests of conditional models

This article proposes a class of asymptotically distribution-free specification tests for parametric conditional distributions. These tests are based on a martingale transform of a proper sequential empirical process of conditionally transformed data. Standard continuous functionals of this martingale provide omnibus tests while linear combinations of the orthogonal components in its spectral representation form a basis for directional tests. Finally, Neyman-type smooth tests, a compromise between directional and omnibus tests, are discussed. As a special example we study in detail the construction of directional tests for the null hypothesis of conditional normality versus heteroskedastic contiguous alternatives. A small Monte Carlo study shows that our tests attain the nominal level already for small sample sizes.     

Parametric bootstrap tests for continuous and discrete distributions

Statistical procedures based on the estimated empirical process are well known for testing goodness of fit to parametric distribution families. These methods usually are not distribution free, so that the asymptotic critical values of test statistics depend on unknown parameters. This difficulty may be overcome by the utilization of parametric bootstrap procedures. The aim of this paper is to prove a weak approximation theorem for the bootstrapped estimated empirical process under very general conditions, which allow both the most important continuous and discrete distribution families, along with most parameter estimation methods. The emphasis is on families of discrete distributions, and simulation results for families of negative binomial distributions are also presented.     

Robustness checks and robustness tests in applied economics

A common exercise in empirical studies is a “robustness check”, where the researcher examines how certain “core” regression coefficient estimates behave when the regression specification is modified by adding or removing regressors. If the coefficients are plausible and robust, this is commonly interpreted as evidence of structural validity. Here, we study when and how one can infer structural validity from coefficient robustness and plausibility. As we show, there are numerous pitfalls, as commonly implemented robustness checks give neither necessary nor sufficient evidence for structural validity. Indeed, if not conducted properly, robustness checks can be completely uninformative or entirely misleading. We discuss how critical and non-critical core variables can be properly specified and how non-core variables for the comparison regression can be chosen to ensure that robustness checks are indeed structurally informative. We provide a straightforward new Hausman (1978) type test of robustness for the critical core coefficients, additional diagnostics that can help explain why robustness test rejection occurs, and a new estimator, the Feasible Optimally combined GLS (FOGLeSs) estimator, that makes relatively efficient use of the robustness check regressions. A new procedure for Matlab, testrob, embodies these methods.     

Bayesian modeling of joint and conditional distributions

In this paper, we study a Bayesian approach to flexible modeling of conditional distributions. The approach uses a flexible model for the joint distribution of the dependent and independent variables and then extracts the conditional distributions of interest from the estimated joint distribution. We use a finite mixture of multivariate normals (FMMN) to estimate the joint distribution. The conditional distributions can then be assessed analytically or through simulations. The discrete variables are handled through the use of latent variables. The estimation procedure employs an MCMC algorithm. We provide a characterization of the Kullback–Leibler closure of FMMN and show that the joint and conditional predictive densities implied by the FMMN model are consistent estimators for a large class of data generating processes with continuous and discrete observables. The method can be used as a robust regression model with discrete and continuous dependent and independent variables and as a Bayesian alternative to semi- and non-parametric models such as quantile and kernel regression. In experiments, the method compares favorably with classical nonparametric and alternative Bayesian methods.     

On some properties of the linear function Poisson binomial and negative binomial distributions

Summary A general model in fluctuations of sums of random variables leading, under certain assumptions, to each of the generalized and linear function Poisson, binomial and negative binomial distributions is presented. Moreover the generating functions and the factorial moments of the linear function Poisson, binomial and negative binomial distributions are obtained in close forms and certain distributional properties are discussed.     

Evaluating the accuracy of value-at-risk forecasts: New multilevel tests

We propose independence and conditional coverage tests which are aimed at evaluating the accuracy of Value-at-Risk (VaR) forecasts from the same model at different confidence levels. The proposed procedures are multilevel tests, i.e., joint tests of several quantiles corresponding to different confidence levels. In a comprehensive Monte Carlo exercise, we document the superiority of the proposed tests with respect to existing multilevel tests. In an empirical application, we illustrate the implementation of the tests using several VaR models and daily data for 15 MSCI world indices.     

Efficient estimation of general dynamic models with a continuum of moment conditions

There are two difficulties with the implementation of the characteristic function-based estimators. First, the optimal instrument yielding the ML efficiency depends on the unknown probability density function. Second, the need to use a large set of moment conditions leads to the singularity of the covariance matrix. We resolve the two problems in the framework of GMM with a continuum of moment conditions. A new optimal instrument relies on the double indexing and, as a result, has a simple exponential form. The singularity problem is addressed via a penalization term. We introduce HAC-type estimators for non-Markov models. A simulated method of moments is proposed for non-analytical cases.     

Prediction of <Emphasis Type="Italic">k</Emphasis>-records from a general class of distributions under balanced type loss functions

We study the problem of predicting future k-records based on k-record data for a large class of distributions, which includes several well-known distributions such as: Exponential, Weibull (one parameter), Pareto, Burr type XII, among others. With both Bayesian and non-Bayesian approaches being investigated here, we pay more attention to Bayesian predictors under balanced type loss functions as introduced by Jafari Jozani et al. (Stat Probab Lett 76:773–780, 2006a). The results are presented under the balanced versions of some well-known loss functions, namely squared error loss, Varian’s linear-exponential loss and absolute error loss or L ₁ loss functions. Some of the previous results in the literatures such as Ahmadi et al. (Commun Stat Theory Methods 34:795–805, 2005), and Raqab et al. (Statistics 41:105–108, 2007) can be achieved as special cases of our results. Partial support from Ordered and Spatial Data Center of Excellence of Ferdowsi University of Mashhad is acknowledged by J. Ahmadi. M. J. Jozani’s research supported partially by a grant of Statistical Research and Training Center. é. Marchand’s research supported by NSERC of Canada. A. Parsian’s research supported by a grant of the Research Council of the University of Tehran.     

Characterizations and Modelling of Multivariate Lack of Memory Property

In this article we establish characterizations of multivariate lack of memory property in terms of the hazard gradient (whenever exists), the survival function and the cumulative hazard function. Based on one of these characterizations we establish a method of generating bivariate lifetime distributions possessing bivariate lack of memory property (BLMP) with specified marginals. It is observed that the marginal distributions have to satisfy certain conditions to be stated. The method generates absolutely continuous bivariate distributions as well as those containing a singular component. Bivariate exponential distributions due to Proschan and Sullo (Reliability and biometry, pp 423–440, 1974), Freund (in J Am Stat Assoc 56:971–977, 1961), Block and Basu (J Am Stat Assoc 89:1091–1097, 1974) and Marshall and Olkin (J Am Math Assoc 62:30–44, 1967) are generated as particular cases among others using the proposed method. Some other distributions generated using the method may be of practical importance. Shock models leading to bivariate distributions possessing BLMP are given. Some closure properties of a class of univariate failure rate functions that can generate distributions possessing BLMP and of the class of bivariate survival functions having BLMP are studied.     

On characterizations of distributions by expected values of order statistics and record values with gap

In this paper, we obtain some recurrence relationships for conditional expectations of nonadjacent order statistics and record values when the distribution function is absolutely continuous, and we prove that the distribution function is uniquely determined by the distribution of conditioned record values and by the expected values of these records. Further, different distributions are characterized by these relationships.