A common base for quality control criteria in quantitative and qualitative research

In the social sciences, several scientific paradigms are mutually isolated owing to their use of specific sets of methodological criteria and quality control procedures. In this article, the central hypothesis, to be tested by conceptual analysis and logical reasoning, is that recommended procedures for quality control in quantitative as well as qualitative research can be derived from a common base of regulative ideas. By ‘qualitative’, we mean the complex of ethnographic, anthropological, symbolic interactionist, ethnoscience and related approaches. A second goal is to demonstrate the use of regulative ideas as a parsimonious and fruitful base for a comparative analysis of methodological canons. Although our focus is on the comparison of quantitative and qualitative (or: naturalistic) research, we also pay attention to policy research as opposed to fundamental research.     

Accreditation and standards-driven program evaluation: implications for program quality assurance and stakeholder professional development

This study evaluates a language education program and assesses the influence of this program evaluation on program performance and stakeholder professional development. The research design makes use of mixed paradigms and methods. Positivism is followed to verify the extent to which the program meets predetermined quality standards through quantitative evaluation research, questionnaires and document and record analysis. In contrast, the qualitative paradigm is followed to uncover program evaluation impact on program components and stakeholders through qualitative evaluation and interviews. The study concludes the program maintains satisfactory overall performance with some components performing better than others. Likewise, evaluation of program evaluation improves program elements and faculty and program administration professional skills. The study therefore recommends program evaluation as an effective program improvement strategy. Program evaluation is also an effective professional development strategy that provides program administration, staff and faculty members with onsite opportunities to develop their professional skills. Moreover, evaluation of program evaluation should be an integral part of program evaluation to help program stakeholders not only do but also use evaluation alongside decreasing resistance to imposed review and reform.     

Revisiting the Quantitative-Qualitative Debate: Implications for Mixed-Methods Research

Health care research includes many studies that combine quantitative and qualitative methods. In this paper, we revisit the quantitative-qualitative debate and review the arguments for and against using mixed-methods. In addition, we discuss the implications stemming from our view, that the paradigms upon which the methods are based have a different view of reality and therefore a different view of the phenomenon under study. Because the two paradigms do not study the same phenomena, quantitative and qualitative methods cannot be combined for cross-validation or triangulation purposes. However, they can be combined for complementary purposes. Future standards for mixed-methods research should clearly reflect this recommendation.     

Use of hypotheses for analysis of variance models: challenging the current practice

In social science research, hypotheses about group means are commonly tested using analysis of variance. While deemed to be formulated as specifically as possible to test social science theory, they are often defined in general terms. In this article we use two studies to explore the current practice concerning group mean hypotheses. The first study consists of a content analysis of published articles where the reconstructed reality of hypotheses use is explored. The second study is a qualitative interview study with researchers, adding information about daily practice. We argue that, at present, hypotheses are not used to their utmost potential and that progress can be made by using informative hypotheses instead of the current non-informative hypotheses. Informative hypotheses capitalize on knowledge that researchers already possess and enable them to focus in their proceeding projects. The substantive focus of our work is the case of applied psychology.     

The classical myth of Ulysses versus Palamedes: an early metaphor for the qualitative/quantitative debate?

This essay examines the classical myth of the confrontation between Palamedes (pro-quantitative) and Ulysses (pro-qualitative). This para-mythical transposition is used as an interpretative metaphor for the methodological debate regarding the use of qualitative or quantitative paradigms of research in the fields of social sciences and education. Although the debate about paradigms has come to a halt over recent years, it may be appropriate to rekindle it now, with less rancour than before, in order to move towards a fertile dialogue without striving to reach any kind of consensus.     

Transferability and Naturalistic Generalization: New Generalizability Concepts for Social Science or Old Wine in New Bottles?

Interpretative qualitative social science has attempted to distinguish itself from quantitative social science by rejecting traditional or ‘received’ notions of generalization. Traditional concepts of scientific generalization it is claimed are based on a misguided objectivism as to the mechanisms operating in the social world, and particularly the ability of statements to capture such mechanisms in any abstract sense. Instead they propose new versions of the generalizability concept e.g. ‘transferability’, which relies on the context dependent judgement of ‘fit’ between two or more cases instances made by a researcher. This paper argues that the transferability concept, as outlined and argued by interpretativist methodologists, is thoroughly coextensive with notions of generalizability formalized for natural science and naturalistic social science by philosophers and methodologists of science. Therefore, it may be concluded that the interpretativist claim to a break with received scientific traditions is a premature one, at least with regard to the issue of generalization.     

Social Change: Measurement and Theory*

Societal change, which takes a variety of directions and forms and in no way can be assimilated or reduced to a single dimension, is often accompanied by a perception of insufficient understanding and lack of control. There is a frustrated need for mastering complexity and instability, separating the voluntary from the involuntary, the intended from the unintended, opportunities from risks, getting to the real causes and dominating the uncertain implications of social change. Social change catches us unprepared and confused. In this context statistics are generally considered a fundamental instrument of knowledge, but also part of the problem! In the public debate and in the specialized literature, the ability to measure social phenomena through current statistics and indicators is increasingly questioned. Data-it is claimed-are lacking, particularly longitudinal data; their quality (accuracy, relevance, timeliness, comparability, etc.) should be improved; indicators do not provide early warning signals, policy performance evaluation, and a precise indication of outcomes. Statistics cannot be used as a reliable and timely basis for decision making by individuals, organizations, governments, and for understanding these decisions. In some cases, statistics have been accused of giving a misleading and false picture of reality: do we measure the real extent of social exclusion and unemployment? Do we fully capture the quality of life and the degradation of the environment? Mismeasurement has been deemed by some commentators as being responsible for the wrong focus in inflation and stabilization policies, science and technology, unemployment and poverty. The productivity paradox, the informal economy, failure to measure welfare and the quality of urban life are instances where statistics do not seem to provide complete and satisfactory answers to the demand for information and knowledge. Our paper illustrates how, quite independently of measurement techniques and data production processes, the inadequacy of the conceptual framework may explain mismeasurement in relation to complex (multidimensional) and dynamic social phenomena. It is then to social theories, explanations and interpretations that statisticians need to turn, in order to come to grips with the new challenges in social measurement. We will develop this thesis looking at a few cases where measurement issues can be connected to both theoretical and empirical difficulties. The statistical gap which reveals itself in the mismeasurement or difficult measurement of social phenomena is closely interconnected with the social science gap. Only close collaboration between statisticians and social scientists can bring about continuous advancement in social science and quality improvement in social statistics.     

Pluralism at Risk? Heterodox Economic Approaches and the Evaluation of Economic Research in Italy

We analyze Italy's recent research evaluation exercise (VTR) as a salient example in discussing some internationally relevant issues emerging from the evaluation of research in economics. We claim that evaluation and its criteria, together with its linkage to research institutions' financing, are likely to affect the direction of research in a problematic way. As the Italian case documents, it is specifically economists who adopt unorthodox paradigms or pursue less diffused topics of research that should be concerned about research evaluation and its criteria. After outlining the recent practice of economic research in Italy and highlighting the relevant scope for pluralism that traditionally characterizes it, we analyze the publications submitted for evaluation to the VTR. By comparing these publications to all the entries in the EconLit database authored by economists located in Italy, we find a risk that the adopted ranking criteria may lead to disregarding historical methods in favor of quantitative and econometric methods, and heterodox schools in favor of mainstream approaches. Finally, by summarizing the current debate in Italy, we claim that evaluation should not be refused by heterodox economists, but rather that a reflection on the criteria of evaluation should be put forward at an international level in order to establish fair competition among research paradigms, thus, preserving pluralism in the discipline.     

Contextual content analysis

This article suggests one way to systematically code textual data for research. The approach utilizes computer content analysis to examine patterns of emphasized ideas in text as well as the social context or underlying perspective reflected in the text. A conceptual dictionary is used to organize word meanings. An extensive profile of word meanings is used to characterize and discriminate social contexts. Social contexts are analyzed in relation to four reference dimensions (traditional, practical, emotional and analytic) which are used in the social science literature. The approach is illustrated with five widely varying texts, analyzed with selected comparative data. This approach has been useful in many social science investigations to system-atically score open-ended textual information. Scores can be incorporated into quantitative analysis with other data, used as a guide to qualitative studies, and to help integrate strengths of quantitative and qualitative approaches to research.     

Leadership Education Across Disciplines: The Social Science Perspective

The current article makes a distinction between pedagogical delivery and “disciplinary foundations” in our approaches to leadership studies. Although the liberal arts are helpful in the delivery of leadership content in the classroom, it is argued that the content, at its core, remains a social science enterprise. Therefore, leadership programs should help students understand how leadership works as a social phenomenon. The current article shows how the McDonough curriculum moves students beyond leadership training (with its focus on skill building), using a social science–based working definition of leadership. Leadership education provides the opportunity to organize the curriculum using the social science lenses. By moving the focus away from the leader and examining instead the complex interaction of multiple components, a deeper understanding of how leadership works under different contexts, influenced by a variety of societal norms and values can be obtained.     

Energy-Transition Education in a Power Systems Journey: Making the Invisible Visible and Actionable

We describe an approach to educating for systemic change in energy systems by integrating technical knowledge of solutions with reflection on paradigms and norms, facilitated by experiential and art-based forms of learning. The course, “Power Systems Journey: Making the Invisible Visible and Actionable,” is part of the University of Minnesota interdisciplinary grand-challenge curriculum. Students take on the challenge of public science communication about how to change the electric-grid system (from power generation to consumption) as part of an energy transition to respond to climate change. The course integrates electrical engineering, history of science and technology, systems thinking, design thinking, paradigms, art, humanities, science communication, storytelling, experiential learning, and the creation of GIS story-maps and museum exhibits. The design context and elements of the course are described and include: the grand challenge of the energy transition itself, the context of energy-transition education, the nature of the grand-challenge curriculum, the collaborative and teaching philosophy, the role of students, the interdisciplinary course framework, the special focus on the role of arts and humanities in energy education, and the course-curricular structure, which uses the “Earth Systems Journey” curriculum model. The centerpiece of the article describes the “Power Systems Journey” experience in narrative form to match the pedagogical approach of the course using artwork examples from students as they investigated the grid. The article concludes with reflections from students and teachers on what the course offers and where to go from here.     

Assessing the social impact of charitable organizations—four alternative approaches

• There is increased societal pressure on charities to improve performance. The questions that they must ask are: (1) Who is our audience? (2) What evaluation measures are important to the organization? and (3) What evaluation measures are best for the organization? There are a number of different approaches available for assessing performance, ranging from social accounting to more informal qualitative assessments of whether the organization's mission is being achieved. This paper draws on the industry and academic discussion of evaluations of nonprofit organizations to develop a four‐category typology of alternative approaches for audiences. It then identifies the benefits and limitations of each. The goal is to identify the steps that charities should use to determine which approach is most suited to their specific circumstances. It is proposed that a collaborative development of evaluation criteria, of whichever type, may be most appropriate as will draw together the experiences and resources of multiple parties, and may have broader appeal than evaluations proposed by individual nonprofits.

Copyright © 2010 John Wiley & Sons, Ltd.     

对克劳斯比的研究与发现

文章概述了美国质量专家克劳斯比的质量生涯,分析了他事业成功的原因,提出质量科学学术范式之一是：不同学术观点的并存、讨论和争辩是正常的;要容纳并且欢迎来自不同专业、不同经历的探索者共同研究和开发。     

Lessons from The Cultural and Political Economy of Recovery

This essay reviews four of the central themes in Emily Chamily‐Wright's The Cultural and Political Economy of Recovery. These themes include: (1) the cultural toolkit, (2) the use of qualitative methods in social science research, (3) polycentricism and disaster recovery, and (4) entrepreneurship in non‐priced environments. Our purpose is twofold. First, to make clear Chamlee‐Wright's contributions to our understanding of disaster recovery. Second, to demonstrate how these themes provide an opportunity for interdisciplinary exchange by blending insights from across the social sciences.     

Changing the mindset: the training myth and the need for world-class performance

Abstract Using data from Canada, the Czech Republic, Hong Kong and Indonesia, this paper tests the concept that training should be viewed as only one (perhaps small) factor in the drive towards world-class productivity. Rather, it is a combination of social science and physical science factors that must be managed, if productivity is to improve. This gap analysis technique focuses on reactive and proactive job analyses to develop programmes of workplace change. Even when utilized in widely varying cultures, the model yields comparable results.     

Advancing purchasing as a design science: Publication guidelines to shift towards more relevant purchasing research

Due to rapidly changing business environments, purchasing and supply management (PSM) organisations are constantly confronted with new problems impacting organisational performance. PSM research can address these problems through design science research. Design science is also regarded as the science of the artificial. Design science research is a methodology that aims to systematically generate knowledge for the design, synthesis, testing, and evaluation of human-made artefacts (e.g., tools, interventions, policies) that solve practical problems. PSM artefacts such as the purchasing portfolio matrix invented by Kraljic (1983) represent a valuable opportunity to solve problems in the PSM discipline. However, our artificial-intelligence (AI)-based analysis of the discipline's flagship journal, the Journal of Purchasing and Supply Management (JPSM), indicates that design-oriented publications in PSM are underrepresented, accounting for less than 4% of the total publications. We argue that existing PSM research should be complemented with more design-oriented research, and address the following research question: How can PSM scholars publish more design-oriented research? Our objectives are to (1) provide arguments for advancing PSM as a design science, (2) nurture a better understanding of design science research as a methodology, and (3) propose publication guidelines that enable researchers to present design-oriented research in a management journal.     

论人力资本的生成途径及其运营机制

本文认为21世纪的竞争,将是人才的竞争、科技的竞争,为此,我们必须树立以人为本的思想观念,重视人力资源开发工作。而人力资本作为一种"活"的资本形式,与物质资本有着许多质的差异,其运营也必然有所不同。理论和实践已经证明,人力资本是经济发展的根本源泉,人力资本的有效运营是推动企业快速发展的重要手段。企业要追求最高的投资绩效,必须将人力资本运营放在企业管理的核心位置。     

会计中心形成与转移的二维论

会计中心的形成是科技经济发展到一定程度的必然结果,在会计中心发生转移前,其发展往往固定在一定地域之内,侧重会计发展“量”的积累;会计中心的转移则反应了科技经济和生产力的阶段性提升,是会计发展“质”的飞跃,表现为地域上的迁移。同时,会计中心的横向形成过程包含在纵向转移过程中,构成一个完整的动态体系。本文采用二维论的视角,以生产力与生产关系、量变与质变关系为框架,用经济学相关理论,以史证的方式构建会计中心形成与转移的体系结构,探寻其潜在发展规律。     

Excel spreadsheet as a tool for social narrative analysis

Qualitative research is an open field where different researchers from several disciplines deal with social meanings and with the issue of understanding. During the last two decades, the use of computers and software has extended to become a relevant part of our daily landscape and also a basic device of social research, even in relation to a qualitative approach. There are many applications of qualitative research software specially designed by a diversity of firms and institutions producing different levels of sophisticated tools that can be used in the social research process. This paper presents a protocol for using an Excel spreadsheet as a tool for analyzing social discourses. We will show how to work with the documents produced in the empirical data collection and the criteria to structure the components of the application and its main representations. Finally, we offer a methodology for developing a personalized application in order to orient social design as a powerful and reflexive tool that contribute to a social thinking immersed in continuous improvement.     

高速公路项目PPP模式的物有所值决策研究

为大力发展PPP模式在高速公路项目领域的应用,采用物有所值评价方法分析PPP模式在该类项目中是否适用是决策阶段不可或缺的部分。通过实地项目调研及文献研究,归纳总结高速公路PPP项目的政府与社会资本合作模式,确立相应的物有所值定性评价指标体系,采用模糊综合评价法进行定性评价,结合定性评价和定量评价论证高速公路PPP项目的可行性,选取ZN高速公路PPP项目为案例论证该项目的物有所值,为我国PPP项目建设的物有所值评价提供一定借鉴意义。