Information Measures in Perspective

Information-theoretic methodologies are increasingly being used in various disciplines. Frequently an information measure is adapted for a problem, yet the perspective of information as the unifying notion is overlooked. We set forth this perspective through presenting information-theoretic methodologies for a set of problems in probability and statistics. Our focal measures are Shannon entropy and Kullback–Leibler information. The background topics for these measures include notions of uncertainty and information, their axiomatic foundation, interpretations, properties, and generalizations. Topics with broad methodological applications include discrepancy between distributions, derivation of probability models, dependence between variables, and Bayesian analysis. More specific methodological topics include model selection, limiting distributions, optimal prior distribution and design of experiment, modeling duration variables, order statistics, data disclosure, and relative importance of predictors. Illustrations range from very basic to highly technical ones that draw attention to subtle points.     

Information spillover across international real estate investment trusts: Evidence from an entropy-based network analysis

In this study, we unveil information spillover between international real estate markets using an entropy-based network approach for real estate investment trusts (REIT). Our novel approach is simple and yet flexible enough to accommodate the nature and extent of information spillover among several components of the global housing network. For a network of nine leading industrial economies, we unveil static and time-varying information spillover of REIT returns using total transfer entropy, pairwise net transfer entropy and directional (“From”, “To”) transfer entropy. Evidence suggests that the greatest pairwise transfer entropy is from the US to Australia, whereas France, the Netherlands, New Zealand and Singapore are the largest information recipients in the network. The time-varying evolution of total transfer entropy also exhibits a declining trend for the integration of global housing market during our sample period.     

An information theoretical algorithm for analyzing supersaturated designs for a binary response

A supersaturated design is a factorial design in which the number of effects to be estimated is greater than the number of runs. It is used in many experiments, for screening purpose, i.e., for studying a large number of factors and identifying the active ones. In this paper, we propose a method for screening out the important factors from a large set of potentially active variables through the symmetrical uncertainty measure combined with the information gain measure. We develop an information theoretical analysis method by using Shannon and some other entropy measures such as Rényi entropy, Havrda–Charvát entropy, and Tsallis entropy, on data and assuming generalized linear models for a Bernoulli response. This method is quite advantageous as it enables us to use supersaturated designs for analyzing data on generalized linear models. Empirical study demonstrates that this method performs well giving low Type I and Type II error rates for any entropy measure we use. Moreover, the proposed method is more efficient when compared to the existing ROC methodology of identifying the significant factors for a dichotomous response in terms of error rates.     

A residual inaccuracy measure based on the relevation transform

Inaccuracy and information measures based on the cumulative residual entropy are useful in various fields, and are attracting increasing attention in Probability Theory and Statistics. In this paper, we introduce and study an inaccuracy measure concerning the relevation transform of two nonnegative continuous random variables. We investigate various distributional properties and characterization results that are based on the mean residual lifetime and involve the generalized Pareto distribution. A connection with the proportional hazards model is also provided. We obtain comparison results involving the proposed inaccuracy measure and some existing inaccuracy measures. Some illustrative examples are finally given.     

Information measures for generalized gamma family

The objective of this paper is to integrate the generalized gamma (GG)$(\mathit{GG})$ distribution into the information theoretic literature. We study information properties of the GG$\mathit{GG}$ distribution and provide an assortment of information measures for the GG$\mathit{GG}$ family, which includes the exponential, gamma, Weibull, and generalized normal distributions as its subfamilies. The measures include entropy representations of the log-likelihood ratio, AIC, and BIC, discriminating information between GG$\mathit{GG}$ and its subfamilies, a minimum discriminating information function, power transformation information, and a maximum entropy index of fit to histogram. We provide the full parametric Bayesian inference for the discrimination information measures. We also provide Bayesian inference for the fit of GG$\mathit{GG}$ model to histogram, using a semi-parametric Bayesian procedure, referred to as the maximum entropy Dirichlet (MED). The GG$\mathit{GG}$ information measures are computed for duration of unemployment and duration of CEO tenure.     

Some Properties of Past Entropy and their Applications

In the context of information theory, measure of uncertainty in past lifetime distribution has been proposed by Di Crescenzo and Longobardi (J Appl Probab 39:434–440, 2002). In this paper, we study some ordering and aging properties in terms of past entropy (based on past lifetime) and develop some characterization results. Some discrete distribution results are also addressed here.     

Optimizing the Information Outsourcing Practices of Primary Care Medical Organizations Using Entropy and TOPSIS

As clinics strive to select information technology contractors that meet their particular outsourcing needs, the medical sector urgently needs evaluation criteria for outsourcing to information technology contractors to alleviate unnecessary risks and achieve an excellent performance. Therefore, this work presents an entropy combined technique for order preference by similarity to ideal solution (TOPSIS)-based decision-making method for clinics to objectively assess the quality of an information technology supplier when outsourcing their medical information needs, as an alternative to previous decision-making approaches based on subjective evaluations. Each sub-criterion for outsourcing vendors is evaluated using the Delphi method. Moreover, results of interviews with experts are integrated with the entropy method to calculate each criterion of an objective evaluation weight for medical information system (MIS) vendors. Furthermore, a TOPSIS-based survey is designed using comparison to effectively respond to MIS outsourcing demand scores for each item. Furthermore, the proposed entropy and TOPSIS-based decision-making method can provide administrators in hospital clinics with a decision-making and evaluation criteria that actively encourage the medical sector to outsource its information technology needs to contractors.     

Ordering univariate distributions by entropy and variance

This paper examines the role of variance and entropy in ordering distributions and random prospects. There is no universal relation between entropy and variance orderings of distributions. But we place their relationship in the context of a stronger ordering relation known as dispersion ordering. Further, some conditions are identified under which variance and entropy order similarly when continuous variables are transformed. We also analyze parametric changes which do not disturb the agreement between these rankings. The results are conveniently tabulated in terms of distribution parameters.     

Physical distribution service performance and Internet retailer margins: The drop-shipping context

In this paper, we investigate the relationship between Internet retailer margins and retailer promises regarding product distribution service. We focus particularly on Internet retailing in a drop-ship context, because this model provides a purer separation of these activities and the related costs and constitutes a critical context for the empirical examination of the relationship between retailer margins and promises. Drawing upon retailer and consumer perspectives, we articulate and justify a set of propositions regarding the relationships among different Internet retailer margins and promised product distribution service performance. We examine a sample comprising over 2000 retail transactions with customers and find partial empirical support for the set of propositions. Specifically, the results show that product margins and the margins on shipping and handling are inversely proportional. We also find a direct relationship between promised product distribution service performance and shipping and handling margins even after key product characteristics known to influence the cost side of the margin equation are controlled for. These results confirm an intuitively logical view of the relationships among pricing and promised product distribution service performance. The study also offers insights for practitioners regarding the opportunity to enhance performance in this domain and demonstrates the benefit and power of employing objective measures drawn from the vast array of information captured via online transactions.     

Research on emergency dissemination models for social media based on information entropy

ABSTRACT

The emergency information dissemination model discussed in this paper describes the dissemination and broadcasting characteristics of emergency information on the internet. This model is helpful for predicting the occurrence of incidents and improving the emergency response. We construct an emergency information dissemination model based on the information entropy method. We verify the validity of the model by obtaining emergency data from Sina Blog regarding the Ya’an and Wenchuan earthquakes. We find that the level of information entropy significantly influences emergency information dissemination. From the perspective of information entropy, we can more effectively describe and understand information on the internet concerning emergency responses.     

甘肃省电子信息产业的困境与对策

在信息全球化的大背景下,重点分析了困扰甘肃省电子信息产业发展的问题,提出了改善甘肃省电子信息产业现状的对策。     

Financial information,green certification,government subsidies and green bond credit spreads–evidence from China

In the context of green bonds playing an increasingly vital role in the green financial market, this study selects 61 green bonds issued in China from 2016 to 2021 as samples to examine the factors influencing green bond credit, including financial information and ratings of issuers, green certification, and government subsidies. First and foremost, based on AHP and entropy method, the financial composite index is constructed to evaluate the issuers’ finance. Additionally, the differences in the cost of green bonds issued by state-owned enterprises (SOEs) and semi-enterprises are explored by adding the property rights variable. Empirical results indicate that the issuer’s rating could significantly affect the credit spread. In addition, the green bond credit spreads of SOEs are more competitive than those of semi-enterprises. When the issuer is a SOE, green bond credit spread has a remarkable negative correlation with finance information. Furthermore, green certification and government grants are not the main factors. Finally, the green bond market, crucial to controlling the green financial system, is presented with specific recommendations for its growth in this study.

     

基于信息熵理论的水利工程项目风险控制应用

应用信息熵理论计算出水利工程项目各风险因素之间的相对重要程度,从而采取有针对性地措施进行风险控制和防范,进而使资源充分利用,风险成本降低,效益最大化。     

A Paradigm for Masking (Camouflaging) Information

This is an expository paper. Here we propose a decision-theoretic framework for addressing aspects of the confidentiality of information problems in publicly released data. Our basic premise is that the problem needs to be conceptualized by looking at the actions of three agents: a data collector, a legitimate data user, and an intruder. Here we aim to prescribe the actions of the first agent who desires to provide useful information to the second agent, but must protect against possible misuse by the third. The first agent is under the constraint that the released data has to be public to all; this in some societies may not be the case.
A novel aspect of our paper is that all utilities—fundamental to decision making—are in terms of Shannon's information entropy. Thus what gets released is a distribution whose entropy maximizes the expected utility of the first agent. This means that the distribution that gets released will be different from that which generates the collected data. The discrepancy between the two distributions can be assessed via the Kullback–Leibler cross-entropy function. Our proposed strategy therefore boils down to the notion that it is the information content of the data, not the actual data, that gets masked. Current practice of "statistical disclosure limitation" masks the observed data via transformations or cell suppression. These transformations are guided by balancing what are known as "disclosure risks" and "data utility". The entropy indexed utility functions we propose are isomorphic to the above two entities. Thus our approach provides a formal link to that which is currently practiced in statistical disclosure limitation.     

Sorting urban development strategies in a federal system: An information theoretic approach

Changes in population for the nation's largest central cities are decomposed into their regional shift and city-suburban disparity components. These decompositions, performed within an information theoretic context, provide a basis for distinguishing urban development policy roles among the federal, state, and local governmental sectors.     

高新区功能转型中建设用地结构的演变特征——以济南高新区为例

功能转变是空间结构调整的先导。针对现有文献对高新区建设用地结构研究较为薄弱的现实,以济南市高新区核心区为例,分析了工业、居住、公共设施等主要建设用地的动态演变;引入信息熵和均衡度指标,综合测度了济南市高新区核心区建设用地结构整体演变的特征,以期为功能转型中高新区用地结构调整提供借鉴和指导。     

Demography and the demand for housing A reinterpretation of the Mankiw-Weil demand variable

This paper argues that the Mankiw-Weil forecast of a 47% decline in house prices over the period to 2007 is based on a serious misinterpretation of their demand variable. In a time-series context this variable, which comes from a cross-section regression of house values against the age of occupants, is a measure of the adult population, not the demand for housing services or the stock of houses. Econometric work suggests that in addition to adult population, real income, relative prices and real interest rates are important factors determining the aggregate demand for housing. To be credible, forecasts of house prices need to integrate information on demand with information on cost factors and the supply of new houses.     

Self-employment of immigrants and natives in Sweden – a multilevel analysis

Recent research suggests that self-employment among immigrants is due to a combination of multiple situational, cultural and institutional factors, all acting together. Using multilevel regression and unique data on the entire population of Sweden for the year 2007, this study attempts to quantify the relative importance for the self-employed of embeddedness in ethnic contexts (country of birth) and regional business and public regulatory frameworks (labour market areas). This information indicates whether the layers under consideration are valid constructs of the surroundings that influence individual self-employment. The results show that 10% (women) and 8% (men) of the total variation in individual differences in self-employment can be attributed to the country of birth. When labour market areas are included in the analyses, the share of the total variation increases to 14% for women and 12% for men. The results show that the ethnic context and the economic environment play a minor role in understanding individual differences in self-employment levels. The results can have important implications when planning interventions or other actions focusing on self-employment as public measures to promote self-employment often are based on geographic areas and ethnic contexts.     

De ontwikkeling van de inkomensongelijkheid gemeten volgens informatietheoretische maatstaven

Summary Some years ago Theil introduced new inequality measures, originating from information theory. He applied them 8.0. to income distributions in the United States. This inequality coefficient is - in contrast to Pareto's constant - based on the whole income distribution. Moreover, the inequality can be disaggregated into inequalities for groups of population. The numerical value of the inequality depends on the chosen class intervals; this may be inconvenient when making comparisons between countries, between different periods and the like. Hence we suggest an appropriate standardizing procedure. The inequality of income distributions has been calculated for the period 1950–1964 and a cornparison is made with Pmm's constant. The investigation relates to three groups of population: wage earners, self employed and others. A remark is made about between-province inequalities.     

SELECTED PAPERS FROM THE 1989 PACIFIC RIM COUNCIL ON URBAN DEVELOPMENT (PRCUD) CONFERENCE

This paper outlines three fundamental reasons underlying the need for more active communication between sectors (private, public and academic) and between urban centers in the Pacific Rim. First, the public and private sectors must, by virtue of their raisons d'etre, operate at close quarters. Secondly, the context in which urban development takes place is increasingly complex. This suggests a role for scholars in helping to inform the debate on urban development processes. Finally, many cities in the Pacific Rim region are increasingly bound to one another through flows of population, capital, information and trade. The key to understanding the evolution of individual urban areas within this region may well be through increased knowledge of the network as a whole.