Learning ahead of time: how evaluation of foresight may add to increased trust,organizational learning and future oriented policy and strategy

Evaluation of futures research (foresight) consists of three elements: quality, success, and impact of a study. Futures research ought to be methodologically and professionally sound, should to a certain extent be accurate, and should have a degree of impact on strategic decision making and policy-making. However, in the case of futures studies, the one does not automatically lead to the other. Quality of method does not ensure success, just as quality and success do not guarantee impact. This article explores the new paths for understanding evaluating of futures studies that are provided by the various articles in this special issue and sets out an agenda for next steps with regard to evaluation of futures research. The more structural and systematic evaluation can result in an increased level of trust in futures research, which may in turn lead to more future oriented strategy, policy and decision making. Therefore, evaluation should be seen as more than a burden of accountability – albeit important as accountability is – but as an investment in the credibility and impact of the profession. It may set in motion a cycle of mutual learning that will not only improve the capacity of futures-researchers but will also enhance the capacity and likeliness of decision-makers to apply insight from futures research.     

Futures studies as social science: An analytic scheme and a case study

Several authors in the futures studies field have in their efforts to improve quality argued that better methods must be developed, which makes sense. But the theoretical awareness in the substantive questions upon which the studies are based is probably more important.

In that light, the primary objective of this article is to formulate a method of how fundamental social issues (views on society and humanity) are addressed in a future study, apply it to one empirical case (telecommunications company Ericsson) and thereafter analyze the method's strengths and weaknesses.

The study shows that the method gained a satisfactory foothold in the material and it has an appropriate depth in relation to desired efficiency. This work has shown that the analytical method is relevant and adequate to understand and describe the orientation and contents of futures studies. Therewith, the study has generated greater awareness of fundamental assumptions in future studies that can contribute to enhancing their quality.     

Experiences of the development and use of scenarios for evaluating Swedish environmental quality objectives

This paper presents and evaluates a method for encouraging long-term thinking and for considering a variety of scenarios in environmental policy processes. The Swedish environmental policy is based on 16 environmental quality objectives (EQOs) that national authorities are obliged to observe. These objectives are reviewed annually and evaluated in depth every four years. Here we describe and explore a futures study project for introducing more long-term thinking into work on the EQOs, which we tested in the in-depth evaluation in 2008. We found it difficult to design a collective scenario for a case with a wide variety of objectives and individuals with different backgrounds. However, this difficulty makes it even more important to incorporate futures studies into the work of the relevant authorities. Scenario work is often subcontracted, leading to a constant lack of futures studies expertise and thinking within authorities. Despite the difficulties, we found that experts within the authorities did begin to recognise the opportunities provided by futures studies. The project revealed an interest and need for futures studies within the authorities in charge of Swedish environmental quality objectives and our findings show that the authorities need to build up their own skills in futures studies.     

Thermodynamics, entropy and disorder in futures studies

The conceptual bases of futures studies are constrained by physical reality only to the extent that we construct these according to our best understanding of physical principles. This places a burden on futures practitioners to ensure that engagement and use of these principles is sufficiently robust to protect the plausibility of their work. The second law of thermodynamics is widely recognised as having fundamental implications for the nature of our physical reality. It is also widely misinterpreted, leading to distorted understanding of this reality. Thermodynamic principles are frequently referred to in the futures literature, and are sometimes fundamental to the futures thinking underlying the work. Reflecting the widespread misunderstanding of the second law, usage in the futures literature is usually problematic. This has implications for the value of the work, and also for the credibility of the field. In this article, the problem is demonstrated, and an updated interpretation of the second law is introduced. The origin of the problem is examined from historical and scientific perspectives within the thermodynamics field. The updated interpretation's implications are examined in the context of futures and other transdisciplinary perspectives.     

Futures studies and the policy sciences

Part of the current evaluation of the work of the Swedish Secretariat for Futures Studies focuses on the practicality and legitimacy of futures studies in relation to the policy sciences. Two crucial issues are focused on, first the justification and relevance of futures studies methodological approaches and their rigorous application to areas of public policy importance and second, the measures by which futures studies can be evaluated in the light of different time frames. Although there are differences between the policy sciences and futures studies approaches which require further analysis, there nevertheless is a symbiotic relationship between the two. The legitimacy of futures studies as a relevant public policy exercise should not be at issue.     

Measuring service fairness and its impact on service quality and satisfaction: a study of Indian Banking Services

As very few studies have investigated banking services from fairness perspective and none of the studies have attempted to measure service fairness in Indian retail banking services context, the paper seeks to investigate service fairness in Indian retail banking services context. It attempts to validate the existing four-dimensional service fairness scale and investigates its applicability in the retail banking industry. The conceptual model depicting the relationship between service fairness, service quality and customer satisfaction was tested using SEM. The results established reliability and validity of the scale and the impact of service fairness on service quality and customer satisfaction. The impact of individual fairness dimensions on these two customer evaluation variables is also studied. The paper discusses important implications of the findings and presents valuable insights for the practitioners as well as academia.     

Explain systemic risk of commodity futures market by dynamic network

Since inflation of commodities is becoming more and more severe recently caused by many macro events, such as COVID-19 and Russian-Ukrainian conflict, systemic risk of commodity futures market is getting more attention from academic and industrial areas. Instead of using external factors to explain this risk as previous researches, we explain it by internal topology and structures of commodity futures market. This method helps us understand its key driving factors and their different impact to Chinese and international commodity futures markets.     

Environmental outlooks: How they frame futures and long term uncertainty

Futures studies intend to structure our knowledge and our judgement about the future by handling facts and values in a certain way. In other words, futures studies frame futures. These frames might be powerful, triggering social action and societal transformation, yet they risk to be criticised and provoke scepticism. The environmental field has a long tradition in futures studies: environmental outlooks. Some of these outlooks, e.g. those published by the IPCC are among the most prominent examples of outlooks that provoke scientific, social and political debate, create commotion and provoke action. Part of these discussions deal with how outlooks frame the future and how they handle the uncertainty inevitably linked to framing futures. The way these challenges are dealt with may affect the overall assessment of an environmental outlook. This article attempts to identify the way environmental outlooks frame futures. We do not strive for exhaustiveness, but deliberately restrict to an in-depth analysis of a handful of recent environmental outlooks. We conclude that environmental outlooks reflect a lack of clarity and argumentation upon how they frame futures and how they deal with uncertainty. This epistemological and methodological ambiguity risk to affect the outlooks’ credibility and impact.     

Index futures and positive feedback trading: evidence from major stock exchanges

This paper tests the hypothesis that the introduction of index futures has increased positive feedback trading in the spot markets of six industrialized nations. The analysis is based on a model that assumes two different groups of investors, i.e., risk averse expected utility maximizing investors and positive feedback traders. There is evidence consistent with positive feedback trading before the introduction of index futures across all markets under investigation. In the period following the introduction of index futures, there is no evidence supporting the hypothesis that positive feedback trading drives short-term dynamics of stock returns. The possibility that this is due to possible migration of feedback traders from the spot to the futures markets is also tested. The results show no evidence of positive feedback trading in the futures markets. Overall, the findings support the view that futures markets help stabilize the underlying spot markets by reducing the impact of feedback traders and thus attracting more rational investors who make the markets more informationally efficient and thus providing investors with superior ways of managing risk.     

Student ratings of teaching effectiveness: What the research reveals

Over the years, evaluation of teaching effectiveness has been a significant issue facing faculty and administrators of accounting programs. This paper examines prior research on the validity and reliability of the most commonly used evaluation method, student ratings. The reviews purpose is to provide accounting educators with an understanding of the major research findings as well as their implications. The extent to which these findings can be generalized to an accounting program setting is a question that should be addressed by future research studies.     

Towards an Integral renewal of systems methodology for futures studies

This article considers the use of systems methodology in futures studies and foresight, in relation to Slaughter's call for Integral methodological renewal in futures studies. The diversified methodologies that have developed within the systems practice field over the past 25 years are examined for their potential to address concerns about the field's reduction of interior realities to epiphenomena of systemic processes, articulated by Habermas in the 1970s, and more recently by Wilber from the perspective of his Integral Methodological Pluralism. It is argued, though, that Integral methodology requires more than methodological pluralism: some understanding of the structures of consciousness within which methodologies are conceived and applied is needed. Drawing on the work of Dr. Susanne Cook-Greuter, capacity to understand “system” itself is explored, looking at the way that humans make sense of reality and the stages through which this sense-making develops. It is argued that systems methods and tools used with sufficient practitioner awareness of epistemological biases have an essential role to play in improving the quality of our futures perception and knowledge.     

Some reflections on the high expectations as formulated in the Internet Bubble era

Since the breakthrough of the Internet to the broader public in the 1990s, expectations of the converging information technology, telecommunication and media industries and technologies as a catalyst for economic growth and social welfare have been high. Futures scientists were involved in predicting the future of these technologies during the Internet bubble. In this paper, we use a meta-analysis approach to examine how well futures studies have been able to describe future reality. We limit our studies to futures research in the ICT and Internet domain that were published between 1995 and 2000. Because the number of relevant studies can hardly be called impressive, we selected a number of available futures studies that were conducted by official government bodies and individual companies, based on various approaches, ranging from technology forecasts [1] to highly creative visions [2], and from predictions [2] to essays [4]. These studies were carried out by Dutch as well as by international organizations. Based on a framework we developed for the analysis of business models, we wanted to see whether technological drivers, regulatory/policy issues and market development as well as competitive behavior, on the input side, and the way value for customers and providers is provided, on the output side, were discussed. Our analysis made it clear that, looking back with what we know now about business models, futures studies and recently developed tools like road mapping, developments in futures studies have made tremendous progress since the Internet Bubble. However, here is still room for more rigor when it comes to methodology and reporting. More recently, there has been a promising integration of scenario analysis and business model approaches that opens new avenues for futures studies.     

First steps: towards purposeful activities in scenario thinking and future studies

In this paper, we contribute to the understanding of the field of scenario development and future studies, which has been a key debate in Futures over the past three of four years. Our contribution is less on the philosophical issues surrounding future studies, but more on the hurdles faced by those interested in practising in the area of scenario planning and future studies. The issues presented and discussed in this article arise from a number of action learning research projects that we have conducted with small and medium sized enterprises (SMEs) in Scotland, who have embraced scenario development for the first time as part of their strategic management and learning process.Our contribution is targeted at identifying and understanding the hurdles to be overcome when (such) organisations consider adopting scenario development or future studies. The contribution is designed to first, help those in the field of scenario development and future studies be mindful of these hurdles and to build a trusting relationship between the scenario practioner and the client, and secondly, help those managers willing to engage in such activities to better understand the purpose of such work.First we identify three key hurdles: (a) organisational culture (i.e. tacit assumptions on scenario development and future studies); (b) “client” state of mind; (c) fear of engaging with the outside/fear of the future. We argue that these hurdles are a serious threat to the relevance and effectiveness of futures work. We argue that these hurdles need to be better understood as a basis for improving the impact and contribution that scenario development and future studies can make.Later in this article we propose a framework to help understand the purpose of scenario development or future studies work. This framework can be used at the outset of any engagement or study, to help the “client” to identify the purpose of such work and to understand its role and scope. We argue that this framework contributes to more purposeful, relevant and actionable scenario development and future studies in the future.Unless you changed something in the minds of managers, a scenario project had failed (Harvard Bus. Rev. 63(6) (1985) 139). Going one-step further, we would argue that unless something tangible happens as the result of the scenario development and future studies work, we have wasted our time.     

The reflective futures practitioner: Balancing salience,credibility and legitimacy in generating foresight knowledge with stakeholders

This paper explores how foresight researchers involved in environmental, nature and planning issues attempt to balance salience, credibility and legitimacy while generating knowledge in interaction with policy-makers and other social actors. Engaging stakeholders in foresight processes can increase the robustness of foresight knowledge, broaden the spectrum of issues addressed, and create ‘ownership’ of the process. While in foresight practices stakeholder participation becomes more and more popular to resort to as enabling factor for generating salient, legitimate and credible foresight knowledge, participation can also compromise these qualities. We analysed two foresight projects conducted at the PBL Netherlands Environmental Assessment Agency, one that developed future visions for Dutch nature policy and another that focused on future pathways for Dutch urban sustainable development policy. We illustrate that the dynamics of the research setting – changes in the socio-political context and the internal dynamics of the participatory efforts – complicated the balancing process. We conclude that one of the main challenges for futures practitioners is, therefore, to work within the dynamics of the research setting, and to position themselves strategically in this setting; by acting as ‘reflective futures practitioners’.     

Computational cognitive assistants for futures studies: Toward vision based simulation

Many foresight researchers believe that quantitative simulations have a very restricted contribution in futures studies due to their simplicity and lack of creativity. While qualitative methods, taking advantage of the human cognitive system, have a great potential in addressing a wide range of problems in futures studies, this potential is mostly due to the human visual logic that can handle the task of imagining future scenarios much better than mathematical logic.On the other hand, computational methods benefit from the advantages of silicon-based systems namely speed, large memory, rapid networking, and communication. Hence, it would be extremely beneficial to come up with a solution that combines the positive sides of both qualitative and computational approaches. Cognitive artificial agents are computational units that make use of the human cognitive system. Their interaction with foresight and futures researchers can result in promising solutions for the problems addressed in futures studies. In addition, these agents can serve as a great source of inspiration for taking the first step towards vision based computers that can simulate humans’ imaginations of the future.This paper reviews some of the previous attempts in this field and finally sheds light on the main issues where methods in futures studies can play a key role in the future of Human Computer Interaction systems. Our suggested architecture for a future studies interactions-based system along with its justifications and specifications is provided in the form of a request for proposal.     

Futures Commitments and Exchange Rate Volatility

It is commonly suggested that certain groups of futures traders, such as speculators and small traders, exacerbate cash market volatility. Empirical research on the subject has been conducted in context of the relationship between price volatility and futures volume or open interest and fails to satisfactorily resolve such an issue. This paper examines the relationship between exchange rate variability and futures trading activity in the context of disaggregated open interest. The data and techniques employed allow for more specific inferences regarding which group of traders contribute to exchange volatility. The results suggest that while 'typical' levels of futures commitments are not destabilizing, surges in the level of commitments of large speculators and small traders causes exchange rate volatility. The actual release of the commitment-of-traders data, however, has no impact on spot prices.     

An empirical analysis of implicit delivery options in the treasury bond futures contract

Assuming perfect, frictionless and efficient markets, this paper develops a framework to estimate the composite value of the quality, wild card and end-of-month options implicit in the T-bond futures contract. The value of delivery options is shown to be the excess of forward price of the cheapest bond over its conversion factor times the exercise price of futures contract. Empirical results indicate that the option values over the last quarter of the nearby contract are on average less than 0.5 percent of the mean futures price, which is substantially lower than the value reported by previous studies. Further scrutiny reveals that although the empirical estimates are contaminated by non-synchronous bond data, they are consistent with certain known theoretical properties of option values.     

Critical and strategic factors for scenario development and discontinuity tracing

This paper discusses the contribution of critical and strategic factors to three open questions in scenario development and futures research: discontinuities, multi-dimensionality in scenarios, and communicating and learning about change and complexity. It is observed that discontinuities do not necessarily take the form of rapid breaks within one single field. The term “hidden discontinuity” is employed to describe developments that arise from (a) the combination of several trends that may each be unspectacular or (b) gradual, long-term processes. The second open question concerns the tension between the need to work in multi-dimensional spaces while also keeping complexity manageable and selecting “representative” futures. The third problem concerns difficulties to recognize, accept and communicate the above two effects (a) and (b). After discussing these questions, two examples of recent scenario studies are used to illustrate how the identification of critical factors can contribute to identifying meaningful discontinuities and meaningful subsets within the multidimensional space of possibilities, and to learning about the scale and scope dimensions of long-term change processes and the impact of the interplay between different fields.     

Emerging pathways for critical futures research: Changing contexts and impacts of social theory

There has always been a critical, emancipatory tradition within futures studies. Although those voices can still be heard, there has been a growing tendency for futures studies to be driven by more utilitarian needs in business and government. Whilst it is positive that futures thinking and research is increasingly valued within corporate and policy-making settings, much of that work appears to lack genuine plurality of worldviews and interests.The paper traces the changing contexts for futures research over the past 25 years. It argues that futures research needs to be viewed as part of the re-politicisation – in the Habermasian sense – of technocratic decision-making. It suggests that there are three particular reasons for revisiting the need for criticality in futures research: the increasing acknowledgement of systemic interrelatedness (ecological, social, economic), a growth in the forward-looking socio-economic paradigm that permeates both business and policy, and the challenge of theory development. Drawing on social theory and futures research, we suggest three pathways for revived critical futures research: socio-technical practices, future-oriented dialectics, and socio-economic imaginaries. As a result, the paper calls for development in futures studies that would dialectically integrate and overcome the dichotomy between instrumentalisation and (critical) theorising that can be currently understood as somewhat antagonistic. In order to find a balance between these antagonistic dimensions, futures research should be more engaged in enabling critique and revealing assumptions and interests.