Theory and applications of the Delphi technique: A bibliography (1975–1994)

Delphi is a popular, long-range, qualitative forecasting technique that has been extensively applied to a wide variety of problems in different domains. Since the method was conceived in the early 1950s at the Rand Corporation, different variations of Delphi have evolved in an effort to meet the unique forecasting needs of different decision makers. This bibliographic study surveys the literature on the methodology and applications of Delphi over a period of two decades (1975–1994). A total of 463 papers were identified out of which 254 papers treat Delphi as a primary subject while the remaining 209 papers treat Delphi as a secondary subject. The study concludes with a brief commentary on the Delphi technique that may be useful for researchers and practitioners in qualitative forecasting.     

A dissensus based online Delphi approach: An explorative research tool

This paper presents an adapted Delphi methodology that is, contrary to the classical Delphi design is not aiming to minimize expert estimation variance, but to maximize the range of expert opinions inputted sequentially into an online system. After discussing the traditional Delphi approach and its dissensus based derivatives, the author opens the case for a dissensus Delphi based explorative research tool with special consideration of the Delphi aim, the expert sample and the Delphi design. The proposed online Delphi process is then presented conceptually. Next, the proposed tool is demonstrated based on a prototype, exploring the barrier factors to the adoption of mobile data services. A discussion on the theoretical design and practical R&D experience of the dissensus based online Delphi approach concludes the paper.     

A methodology for science and technology planning based upon economic scenarios and Delphi techniques : The case of Mexican agroindustry

A methodology for S & T planning using Delphi panels, matrix analysis, and linear programming techniques is described. It is applied to Mexican agroindustry, thus defining priority areas, overall strategies, and policy instruments. The implications of this methodology for planning processes in underdeveloped countries are discussed.     

Stability and agreement criteria for the termination of Delphi studies

This paper addresses the question of the methodology of testing for stability between successive Delphi rounds and the necessity of doing so prior to the analysis of the level or type of consensus. Following a discussion of a hierarchical set of a criteria for determining the termination of such studies, the paper reviews some of the more common treatments of the subject in the literature. It is finally proposed that a χ² test be used to test the stability of responses between rounds. The method is demonstrated by a numerical example.     

Current validity of the Delphi method in social sciences

The Delphi method is a popular technique for forecasting and an aid in decision-making based on the opinions of experts, which has been in existence for over half a century. This work evaluates its methodology and reviews its validity in the present day, especially in the area of Social Sciences. Three recent applications in this field are also explained, professional in nature, which have some characteristics that are not frequent with respect to other Delphi studies published. The main aim of two of these studies was to provide input for economic or statistical quantitative models, using the judgement of expert groups, while the third study aimed to analyse a complex social reality by means of a Policy Delphi in order to obtain reliable information before taking a policy decision. These applications highlight how this technique may be adapted to different social realities and requirements, making a positive contribution to social progress, provided it is applied with the necessary methodological rigour and with a good knowledge of the social medium in which it is being applied. Finally, there is an explanation of a number of lessons learned from the theory and aforementioned experiences, which may contribute to the successful outcome of a Delphi exercise.     

Participants' response to the Delphi method: An attitudinal perspective

The processes involved in an individual's response to the Delphi method are conditioned by a number of psychological affects. This paper examines aspects of two of these processes: the basis for changing opinions, and the factors related to continued participation in subsequent Delphi rounds. The attitudinal perspective is shown to be promising in explaining an individual panelist's response in the Delphi method. Cognitive dissonance apparently has a significant role to play in bolstering the assimilation of nonconforming respondents. This is, however, complicated by the respondents' perception of the credibility of the feedback received. Careful choice of panels may reduce dropouts, presumably by selecting those with a high degree of ego involvement. Nonetheless, elements of cognitive dissonance apparently lead certain panelists to abandon the Delphi process. It is evident that numerous parallels exist between psychological explanations of attitude change and the behavior of Delphi panelists.     

Identification of future fields of standardisation: An explorative application of the Delphi methodology

This paper investigates the application of the Delphi methodology for the identification of future fields of standardisation complemented by a methodological extension by using various science and technology indicators. By the term standardisation, we broadly mean the process of developing and implementing technical standards within a standardisation body. Underlining the explorative nature of this paper, we describe the process of identifying future fields of standardisation.To provide a systematic forecasting view on complex science and technology fields, a combination of quantitative indicator-based analyses and qualitative in-depth Delphi surveys is choosen. Firstly, statistical analyses of suitable indicators are used to identify dynamic developments in such fields. Secondly, to identify detailed challenges for future standardisation, qualitative Delphi surveys are conducted. To collect and evaluate relevant issues the respective expert communities were included. They were identified by using information derived from the science and technology databases used.The paper concludes with the assessment of the chosen approach and give practical insights for its feasibility based on a review of the existing literature on the Delphi methodology. In addition, an outlook for further improvements and other possible fields of application is given.     

Foresight with Delphi Surveys in Japan

Foresight activities are conducted in many countries, but the Japanese were the most active in this field for many years. Most of their activities are based on the Delphi methodology. They published their first Delphi study in 1971 and repeated studies every five years. There is more knowledge available on more than 30 years of foresight with the Delphi approach in Japan. This provides an excellent opportunity to examine the established foresight system with the use of some examples. The forecast of the fax machine as an example of success, and the earthquake warning as a failure are illustrated in more detail, and the question is raised why—in spite of this mixed picture—foresight with the Delphi method is regarded as useful in Japan.     

Foresight with Delphi Surveys in Japan

Foresight activities are conducted in many countries, but the Japanese were the most active in this field for many years. Most of their activities are based on the Delphi methodology. They published their first Delphi study in 1971 and repeated studies every five years. There is more knowledge available on more than 30 years of foresight with the Delphi approach in Japan. This provides an excellent opportunity to examine the established foresight system with the use of some examples. The forecast of the fax machine as an example of success, and the earthquake warning as a failure are illustrated in more detail, and the question is raised why—in spite of this mixed picture—foresight with the Delphi method is regarded as useful in Japan.     

Regulatory foresight: Methodologies and selected applications

This paper on regulatory foresight addresses approaches which allow future fields for regulatory action to be identified. We follow a rather wide perception of regulation and include standards and standardisation as elements of the regulatory framework. The paper presents three methodologies appropriate for performing regulatory foresight. First, an approach is presented which makes use of science and technology indicators and enables the identification of possible fields which may cause challenges for the regulatory framework and the regulatory bodies. Second, survey approaches are displayed which enable regulatory bodies to identify future needs for regulations. Finally, the usability of the Delphi methodology is discussed and results of a Delphi survey in the telecommunication area are presented. The paper concludes with a comparative analysis of the three methodological approaches regarding their effectiveness to conduct regulatory foresight.     

Systemic analysis of UK foresight results: Joint application of integrated management model and roadmapping

This paper proposes a new systems approach to foresight studies. The paper will first indicate the complex and conflicting nature of long-term decision-making process. Then, the need for systems approach will be highlighted by the analysis of 1995 UK Delphi survey results and the scenarios of 2000 UK foresight scenarios. The paper proposes two methodologies, namely Integrated Management Model (IMM) and Roadmapping, in order to overcome challenges introduced by the multidimensional characteristics and complex nature of foresight studies. Based on systemic approach, IMM offers a useful way of developing long-term normative policies and strategies and their transformations into actions by considering necessary changes in organizational structures and behaviors. In addition, roadmapping is used to capture, manipulate and manage information to decrease complexity in the foresight by constructing roadmaps. In the paper, IMM and roadmapping are employed first to analyze UK foresight results and then to develop a new methodology to formulate Delphi events and scenarios for the successful implementation of foresight. This paper also promotes the integrated use of foresight techniques such as scenarios and Delphi rather than one for another.     

Is diversity in Delphi panelist groups useful? Evidence from a French forecasting exercise on the future of nuclear energy

This paper further enhances the analytical power of Delphi methodology by identifying the advantages, disadvantages and challenges presented by increasing diversity among panel groups. Using Delphi survey data on the future of nuclear energy in France, we analyze the origins of the variety of judgments within and between two panels: one of experts and one of laypeople. We investigate the determinants of the stability of those opinions both in one given round and over several rounds of opinion-formation. We reach an apparently paradoxical conclusion: that non-expert judgment is less stable, but not necessarily less accurate, than that of experts, judgments on the part of experts sometimes being clouded by self-interest. Apart from highlighting some factors underlying the controversy over nuclear power, our paper calls for greater participatory democracy in Delphi panels, but also demonstrates the limits of such an extension.     

An analysis of prior delphi applications and some observations on its future applicability

Since the inception of the Delphi method, it has experienced increased application. Despite its spreading utilization, very little is known about its past applications and its actual value. This article reports on the results of an international research project concerning the Delphi method. The research project focused primarily upon an analysis of the purposes for which the Delphi method has been used and its degree of successfulness, the extent of its use in various substantive fields, the future of the Delphi method, its relationship with other methodologies and the types of organizations financing Delphi studies.     

Drawing up the official adjustment rules for damage assessment in agricultural insurance: Results of a Delphi survey for fruit crops in Spain

This paper presents the results of an innovative use of the Delphi technique to obtain quantitative information for the evaluation of the Official Adjustment Rules for Damage Assessment in agricultural insurance. An efficient insurance system must guarantee that loss adjustment is performed fairly and transparently, so that the continual review and modification of adjustment rules becomes especially important. The present study develops and applies a methodology based on the subjective information compiled by experts to evaluate the modification of the Specific Loss Adjustment Rule for Fruit Crops under real market conditions.The results show that the method employed comes forward as a valid option to provide reliable information, as well as other economic and social advantages, in the absence of alternative statistical sources. The validity of the study has been proved by its utility, as the results were extremely useful for drawing up a new Official Adjustment Rule. This application opens up an interesting field of development for this technique, which will enable the proposed methodology to be applied to similar studies in the context of agricultural insurance loss adjustment.     

Public sector use of the Delphi technique

The Delphi Technique is gaining extensive use as a multipurpose tool by government planners and policy makers. This paper begins by briefly discussing the historical development of Delphi and some of its advantages and disadvantages. A considerable number of Delphis conducted in the public sector for the purposes of forecasting, communication, budgeting, and goal setting are then reviewed. Additionally, three prior reviews of Delphi use in the field of education are discussed. In reviewing these studies every attempt was made to detail the research intentions, special features and modifications, cautions, and benefits of each study. These characteristics are provided in tabular form in the summary section as a ready reference for the potential Delphi user. It is recommended that one should take full advantage of what has been learned from earlier research before undertaking a new Delphi.     

The decision Delphi

If Delphi is used as a prognostic tool in the social sciences, it runs the danger of producing a self-fulfilling prophecy. In a Delphi application conducted at the Austrian Academy of Sciences about the present situation and future developments of the scientific-technical information and documentation system in Austria, an attempt was made to apply this principle intentionally.A group of actual decision makers in this field were included in a Delphi panel and were therefore confronted with problems and possible future developments in a field which is considerably influenced by their own actions. The Delphi method was therefore used to structure the decision-making process and to help to “create” the future in reality rather than just predicting it. In this way, an attempt was made to transfer an important field of socioeconomic development from a pattern of accidental development through uncoordinated decisions toward a pattern of broad discussion among all involved social groups and thus toward goal-oriented and well-considered management.It seems that this study represents a further variant of the well-known Delphi technique, a variant which has fundamental differences from the classical and the policy Delphi. For a Delphi application of this type the expression “Decision Delphi” is suggested.     

A Delphi technology forecasting approach using a semi-Markov concept

This paper suggests a technology forecasting approach based on a semi-Markov model, which appropriately describes the probabilistic nature of a sequential technology development process. This approach focuses primarily on the utilization of the information that has been skipped in conventional Delphi survey data. That is, through a simple statistic, the interrelationships among sequential technology developments can be extracted in a formal structure of a semi-Markov model from the original Delphi panel's estimates. A simulation technique is developed to forecast the development process by utilizing the information on such interrelationships. This technique provides a flexible and useful tool for R&D planners or project managers, especially in postanalysis of Delphi forecasting. To make good use of the approach, a computer-based interactive Delphi data analysis system (IDEAS) is implemented in IBM PC.     

Political risk analysis for Canada and Mexico

A new methodology for political risk analysis was developed and applied to Canada and Mexico. The ideas of an interdisciplinary team of corporate and country experts were obtained in mid-1982 via a two-round Delphi inquiry on socioeconomic change and a survey on business contingencies in Canada and Mexico. The information provided by the panelists was used to describe possible future conditions in Canada and Mexico in the context of alternative U.S. and international conditions.     

‘Technology foresight towards 2020 in China’: the practice and its impacts

Technology foresight has attracted increasing attention from government and academia as well as industry since the 1990s. However, the impact of technology foresight on national strategic decision-making varies from country to country. This paper aims to introduce the ‘Technology Foresight towards 2020’ exercise in China, which has been conducted by a research group in the Chinese Academy of Sciences. The paper consists of five parts: (1) introduction; (2) the framework for technology foresight towards 2020 in China; (3) the methodology including scenario building for identifying technology demands and the method for processing and analysing the data from a Delphi survey; (4) the major results of a Delphi survey in the following four research fields: Information technology, Biotechnology, Energy technology, Material science and technology; and (5) the impact of the research on decision-making concerning science and technology development in China.     

Delphi as a tool for identifying future appropriate technologies in India

The concept of appropriate technologies with particular reference to developing countries like India is discussed. It is suggested that appropriate technologies should: (1) include the entire range of technologies from very primitive to very modern, (2) be available when required, and (3) have the maximum impact on the largest fraction of the poorest sections of the population, especially through increasing employment. The problem of identifying appropriate technologies that would meet these criteria has also been discussed. In this article we have attempted to use the Delphi technique of technology forecasting for identifying future appropriate technologies in the areas of food, health, and energy using respondents in India. Subsequently, we have analyzed our results in terms of the criteria previously assigned to appropriate technologies and have thereby evaluated our experiment.It is concluded that the Delphi is an adequate first step in identification of such technologies; however, it must be followed by more rigorous techniques (possibly quantitative) for assigning further priorities within the technologies identified by the Delphi. This will help in arriving at suitable policy decisions and allocation of funds to a few of the most important areas.Finally, two alternate scenarios have been presented (using the Delphi results as well as our own perceptions and observations of the Indian society), depending on whether appropriate technologies and policies are adopted.