Integrated analysis of content and construct validity of psychometric instruments

Establishing adequacy of psychometric properties of an instrument involves acquisition and evaluation of evidence based on item content and internal structure. Content validity evidence consists of subject matter experts providing quantitative ratings of the extent to which items are a representative sample of targeted domain. Evidence of internal structure includes factor analytic studies and examination of item interrelationships based on item responses from participants. Although subject matter expert ratings and participant response data are traditionally analyzed separately, each serves to inform the other in important ways. We propose integrating subject matter experts’ and participants’ data seamlessly to establish a unified model of validity evidence. The approach is applied to an instrument designed to measure nursing home culture change (i.e., resident-centered care). The proposed method has been demonstrated to be useful with a posterior distribution resulting in stable estimates of psychometric parameters superior to traditional analytic approaches. To illustrate the efficacy of the methodology, we present a simulation study and discuss its place in psychometric methods.     

Examining the Ethical Behavior of Ontario Chartered Accountants: A Longitudinal Review of the Disciplinary Process

The governing bodies of the Chartered Accountant (CA) profession and business schools go to great lengths to ensure accounting professionals are equipped with a skill set that meets technical, professional, ethical, and other general requirements. In spite of a strict code of ethics, violations of the professional conduct rules leading to disciplinary action are a reality. Using the total CA membership (N = 36,465) of Ontario, Canada, this study makes a 27‐year retrospective assessment of the frequency of disciplinary cases, the characteristics of offenders, the disciplinary process, and the sanctions imposed. Results indicate that: (i) approximately 1.38 percent of the members have been charged with violations of the Rules of Professional Conduct by the Institute of Chartered Accountants over that period; (ii) most were sole proprietors engaged in public accounting; (iii) on average, men make up 76 percent of the CA membership, outnumbering women by three to one (3:1); yet, men were 16 times more likely than women to be charged; (iv) the majority of the offences occurred while members with public accounting licenses were conducting external audits; and (v) sanctions ranged from a “rap on the knuckles” admonishment to expulsion from the CA profession. This study is exploring the CA disciplinary process as observed through disciplinary notices and suggests improvements to the system.     

Impacts of news media coverage on Canadian medical crowdfunding campaigns

While donation-based crowdfunding for health-related purposes raises hundreds of millions of dollars yearly, most campaigns fail to meet their fundraising goals. Crowdfunding campaigners are advised to seek traditional news media coverage of their campaigns to increase donor interest and fundraising success. In this study, we seek to better understand what happens to donor behavior via donation-based crowdfunding campaigns after they receive news media coverage. While research has focused on the impact of social media sharing on donation-based crowdfunding, academic analyses of the impact of news media coverage is largely speculative. We searched the Newsstream and Factiva databases for Canadian news coverage of domestic donation-based health-related crowdfunding campaigns. This news coverage was paired with the crowdfunding campaign reported on in the story. Campaign text and daily fundraising totals and donor amounts were recorded for the 7 days before and after publication of the news article. The authors identified emergent patterns in this data around the amplification of personal information from the crowdfunding campaign to a wider audience and inclusion of new personal details. This process identified 17 relevant pairs of news stories and crowdfunding campaigns over a review period of just under 5 months in 2021–22. These campaigns raised a total of CAD$443,134 (median CAD$20,030) out of a total goal of CAD$772,500 (median CAD$40,000) or 57.4% of the requested funds. Median campaign donations and donor numbers increased for the 3 days following publication of the news article. Our exploratory analysis shows a relationship between crowdfunding campaigns that receive news media coverage and the numbers of donations and total amount donated shortly after this coverage. Campaigners may feel pressure to participate in news media coverage in order to reach their fundraising goals. Media coverage has implications for campaign recipient privacy and the equitable distribution of health-related funding. This exploratory analysis establishes the need for additional research on this topic.