Developing and applying a framework to evaluate participatory research for sustainability

The normative implications of participatory research imply ongoing social learning that ought to lead to personal and institutional transformation. Sustainability science also requires reflexive scientific practice in order to enable the co-generation of solutions that take account of uncertainty and multiple forms of knowledge. However, there is little published peer-reviewed material on how to assess to what degree the rhetoric regarding the benefits of participatory research are achieved in practice, particularly with regard to participatory research for sustainability. This paper outlines how linking the rationales for participatory research and for sustainability science to the principles of evaluation can deliver a conceptually coherent evaluation framework for assessment. The approach for evaluating participatory research in this context consists of framing the evaluation, i.e., setting boundaries on the subject within its social, political, environmental and institutional context and selecting appropriate criteria, methods and data sources. The application of the framework, using a summative evaluation of participatory research for sustainability in north-east Australia, illustrates its strengths and weaknesses, concluding with a consideration of its applicability to further participatory sustainability science.     

The impact and spin-off of participatory backcasting: From vision to niche

This paper reports on a study that has systematically investigated the follow-up and spin-off of participatory backcasting experiments in the Netherlands five to ten years after completion. A methodological framework for participatory backcasting is presented, after which a conceptual framework is developed to describe and evaluate the impact of backcasting experiments. Three cases are analysed: (1) Novel Protein Foods and meat alternatives; (2) Sustainable Household Nutrition; and (3) Multiple Sustainable Land-use in rural areas. The cases show that participatory backcasting can lead to substantial follow-up and spin-off, but that is not always the case. Substantial follow-up and spin-off after five to ten years is predominantly found at the level of niches, and can be seen as potential seeds for future system innovations. The emergence of follow-up and spin-off comes along with the diffusion of the visions generated in the backcasting experiment. The visions provide orientation (where to go) and guidance (what to do). Visions also show both stability and flexibility. Factors that influence the extent of impact and spin-off of backcasting are identified, with a focus on stakeholders, learning and visions. Finally, relevance for system innovation theory, governance and policy as well as research recommendations are briefly discussed.     

Dynamic sustainability assessment: The case of Russia in the period of transition (1985-2008)

Russia has experienced twenty years of economic and social change, which had a substantial impact on the regional and sectoral patterns of the development of its economy, infrastructure, the quality of the environment and the well-being of its people. The current economic revival offers new opportunities and presents new challenges for the sustainable development of Russia.The paper employs the UN Sustainable Development framework of indicators and assesses sustainability of Russia using multi-criteria evaluation methods, namely the uncertainty randomization multi-criteria evaluation method “Analysis and Synthesis of Parameters under Information Deficiency” (ASPID). The analysis covers economic, environmental and social trends in Russia's development in 1985-2008 and assesses sustainability of this development from the point of view of multiple criteria.The results show the potential of employment of multi-criteria methods for the sustainability assessment at the macro level and offer useful insights into multidimensional nature of sustainability and the role of priority setting in the evaluation process. Such an analysis reveals the degree of harmoniousness of sustainable development policy. It shows how different sets of priorities determine the outcome of multidimensional analysis of sustainability and could potentially help in assessing progress and designing new policy instruments. This paper is one of the first to apply multi-criteria methods to the macro sustainability analysis in the dynamic setting.     

Beyond welfare economics: some methodological issues

When one wishes to formulate, evaluate and implement public policies, the existence of a plurality of social actors, with interest in the policy being assessed, generates a conflictual situation. How such a conflict should be dealt with? This paper defends the thesis articulated in the following points: (1) Different metrics are linked to different objectives and values. To use only one measurement unit (on the grounds of the so-called commensurability principle) for incorporating a plurality of dimensions, objectives and values, implies reductionism necessarily. (2) Point (1) can be proven as a matter of formal logic by drawing on the work of Geach about moral philosophy. This theoretical demonstration is an original contribution of this article. Moreover, here the distinction between predicative and attributive adjectives is formalised and definitions are provided. Predicative adjectives are further distinguished into the new categories of absolute and relative ones. The new concepts of set commensurability and rod commensurability are introduced too. (3) Weak comparability of values, which is grounded on incommensurability, is proposed as the main methodological foundation of well-being evaluation. Incommensurability does not imply incomparability; on the contrary incommensurability is the only possible way to compare societal options under a plurality of policy objectives. Weak comparability can be implemented by using multicriteria evaluation, which is a formal framework for applied consequentialism under incommensurability.     

Participation and evaluation for sustainable river basin governance

This paper introduces a special section devoted to participation and evaluation for sustainable river basin governance. The departing point for this research was the recognition that although there is a relative agreement regarding the need to develop new multi-dimensional, inclusive and plural approaches to water resource management, there is still a deficiency of related methodologies and tools. This acknowledgement has motivated the undertaking of the ADVISOR — Integrated Evaluation for Sustainable River Basin Governance research project, which aimed at improving the understanding of evaluation processes, as part of river basin planning and management, and to test the use of specific tools to support the conduct of participatory processes. The paper starts with a discussion of the concept of integrated water resources management and an illustration of the water policies that have been adopted in different countries as a response to these trends. The conceptual framework that was developed in ADVISOR is then presented, as well as the main results from the ex-post analysis of the decision processes regarding five water related projects in different European countries. This analysis concluded that, in most situations, the decision-making processes fell short of including the interests, perceptions and values of affected parties. The remaining of the paper introduces the articles that form this special section, mostly devoted to the testing of new platforms for participation and deliberation. In the final section, a discussion on the assumptions and limitations of deliberative processes is presented, based on the results from the application of the different methods. Further research needs on the integration of different deliberative tools and on the integration of deliberation with decision processes are identified.     

The limits of policy: Public acceptance and the reform of science and technology governance

The adoption of a variety of new regulatory approaches and concepts, decision making processes and educational frames over the last three decades can be interpreted as an attempt to improve social acceptability of the process of science and technology governance. However, as argued in this paper, neither the introduction of non-standard scientific methodology and precautionary policy, nor participatory decision making, nor increased scientific-technological education are likely to significantly improve social acceptance of science and technology governance. Such reforms may shift the focus of ongoing policy debates, but do not lead to closure. In consequence, more research is needed on the complex relationship between acceptance, trust, information and participation, the implications of non-standard methodology in regulatory decision making, as well as the different interpretations that stakeholders may give to key regulatory concepts.     

治理网络视角下新兴技术治理的社会公众角色演变

新兴技术治理中社会公众的意见与建议、感情与情绪受到了越来越多的关注。社会公众的强烈反对与争议能够影响政策决策的执行，但社会公众在政策决策中的主要角色和作用仍然没有得到清晰阐释。为了提升新兴技术治理绩效，从网络视角切入，基于治理网络理论的3种公共行动分析方法，以转基因技术作为新兴技术研究对象，分析我国社会公众在新兴技术治理中的角色定位。研究发现，我国社会公众角色不够完善，仅发挥了监管者和促进者的作用。由此提出，分配新兴技术治理行动者的决策权、建立审议参与式的公众参与程序、培育社会公众主动参与的审议环境等相关政策建议。     

Ethics,human behavior and the methodology of social economics

Social economists differ among themselves but are united in rejecting the rational actor model. They insist that individuals are more than economic actors; they arepersons with ethical values who live in community. That agreement over fundamentals leads social economists to embrace a methodological approach that differs substantially from the mainstream of economics. They (sometimes explicitly but usually implicitly), engage in a special form of storytelling known in the philosophy of social science as pattern modeling. Instead of using a pre-existing theoretical framework, such as rational choice theory, to logically construct a story, this type of story is constructed empirically from the bottom up through the use of case studies. The article concludes with a specific consideration of Albert Hirschman's methodology to illustrate the storytelling approach of a first rate and well-recognized social economist.     

Ethics,human behavior and the methodology of social economics

Social economists differ among themselves but are united in rejecting the rational actor model. They insist that individuals are more than economic actors; they arepersons with ethical values who live in community. That agreement over fundamentals leads social economists to embrace a methodological approach that differs substantially from the mainstream of economics. They (sometimes explicitly but usually implicitly), engage in a special form of storytelling known in the philosophy of social science as pattern modeling. Instead of using a pre-existing theoretical framework, such as rational choice theory, to logically construct a story, this type of story is constructed empirically from the bottom up through the use of case studies. The article concludes with a specific consideration of Albert Hirschman's methodology to illustrate the storytelling approach of a first rate and well-recognized social economist.     

科学、价值与判断在环境影响评估架构中之整合

公共政策研拟，尤其是环境影响评估，不仅牵涉技术性科学层面，同时涵盖社会性价值评估与政策性决策判断。旨在探讨如何将科学、价值与判断等因素合理融合于环境影响评估作业过程中，并据此研拟一环境影响评估架构，作为中国台湾地区环保部门开发案审核依据之参考。本文所研拟之环境影响评估架构的理论基础包括社会选择理论、社会判断理论及多属性评估方法。通过社会选择理论分析环境政策制定的机制；通过社会判断理论解释科学与价值如何整合于政策制定及其可行性中；而通过多属性评估方法建立开发案评选的集体决策技术。以山坡地开发为例说明此架构在实践中的应用。     

Scoping river basin management issues with participatory modelling: The Baixo Guadiana experience

This paper details the design and implementation of a participatory modelling process in the Baixo Guadiana River Basin, in Portugal. A group of stakeholders was involved in a causal mapping exercise that lead to the development of a shared view of the problems, pressures and impacts characterizing the river basin. A simulation model was also developed to support experimentation with alternative management scenarios for the area. The paper looks critically at the evaluation of the participatory modelling outcomes, both at the individual and group levels, discussing the role of this approach in supporting the scoping stages of river basin planning and management processes. On the downside, the unstable group composition seems to have hindered the chances of producing a higher impact in the functioning of the group, and subsequently the capacity to sustain the level of collaboration required to achieve the strategic river basin objectives established during the participatory modelling process. The paper discusses the issue of group stability as well as some options to overcome the limitations of unstable participant groups. The strengths of participatory modelling, as underlined by the Baixo Guadiana experience, include the flexibility to adapt the method to different contexts and participatory designs and the capacity to structure the active involvement of stakeholders, providing an open and shared language for collaborative policy design, fostering learning and knowledge integration.     

A new fuzzy multi-criteria framework for measuring sustainability performance of a supply chain

Sustainable supply chain performance measurement is aimed at addressing environmental, social and economic aspects of sustainable supply chain management. It can be argued that it is not easy to reduce all dimensions of sustainable supply chain to a single unit. Then, the issue is that all valuations should somehow be reducible to a single one-dimensional standard. Multi-criteria evaluation introduces a framework to remedy this issue. As a consequence, multi-criteria evaluation seems to supply a proper and adequate assessment framework for sustainable supply chain assessment. In this study, a multi-criteria framework based on fuzzy entropy and fuzzy multi-attribute utility (FMAUT) is proposed in order to evaluate and compare the company performances in terms of sustainable supply chain. However, note that reducing all aspects of sustainable supply chain to a single unit using a multi-criteria framework may not be sufficient to satisfy all the needs of decision makers although it is used to evaluate sustainability performance of supply chains with respect to three aspects. Therefore, in this research, an alert management system is also developed to satisfy further requirements of users. The proposed frameworks are tested using data obtained from one of the middle sized Turkish grocery retailers.     

A rank order and efficiency evaluation of the EU regions in a social framework

In this paper, methods of multi-criteria efficiency evaluation are implemented for ranking the socio-economic systems of the EU regions. The socio-economic rank order problem is a multi-criteria non-convex optimization problem that was solved by the implementation of a new efficiency evaluation, AOWI (Absolute Optimal Weights Index). The rank order of the 268 NUTS-2 regions from the 27 European Union countries in the social framework obtained on the basis of 16 socio-economical indicators illustrates social divergence within the European Union and in the new European Union regions.     

The place of Austrian economics in contemporary entrepreneurship research

We review the place of Austrian economics in contemporary entrepreneurship and management research, focusing on the contributions of Israel Kirzner. We show that Kirzner’s central concept of entrepreneurial discovery has been vastly influential in theoretical and applied work on entrepreneurship, even though Kirzner’s larger research program has not been well understood. We also describe and assess a number of methodological, ontological, and cognitive critiques of the opportunity-discovery approach and review the most important alternatives, including the judgment-based view associated with Knight (1921) and more recent contributors. We conclude that the entrepreneurship and management literatures provide a useful example of how Austrian economics—Kirznerian economics in particular—can play an important role in shaping mainstream discussions, debates, and research programs in the social sciences.     

A network approach to studying research propammes: mobilizing and coordinating public responses to hiv/aids

Based on the anahsis ofthe Medical and Public Health Research programme (Commis- sion of the European Communities), the paper shows how new scientific communities are created in response to the HIV/AIDS problem. W e anahze how actors are mobilized (three mobilization modes: public impetus, scientists 'initiative, scientists' initiative with public networking) and how their work is coordinated. We defend the hypothesis that these new scientific communities are flexible cooperation networks. In the case of AIDS research, there are onb a limited number o f network types (the data collection structure, the forum, the thematic partition with harmonization o f research practices, the starred around a central facilip). The coordination of these scientific cooperative networks passes through fixed and circulating intermediaries. The management of these intermediaries is a major activity for involved actors. Thus, our aim is not to study the wider social context, but to analyze networking in response to policy, initiatives.     

Minutes of Spring Council Meeting, 1965, of the Catholic Economic Association

This research compares perceived organizational support to work–family balance measures and policies in various work environments to determine whether the organizational context can be a mediating variable or whether the social economy sector, with its mission and management approach (participatory decision-making) might have an influence on organizational support to work–family balance. We studied the social economy sector and compared findings with three other sectors in the public service that have a public service mission but not the same democratic or participatory management mode: a metropolitan police service, social work, and nursing, all in the same city. Our research identifies many significant differences between the four sectors, essentially owing to the characteristics of the social economy sector. In addition to our quantitative research, we conducted interviews (36) in the sector and results indicate that the specificity of the social economy sector, i.e. mission and management mode, explain the overriding concern for work–life balance in the social economy sector.     

The inherent dangers of using computable general equilibrium models as a single integrated modelling framework for sustainability impact assessment. A critical note on Böhringer and Löschel (2006)

The search for methods of assessment that best evaluate and integrate the trade-offs and interactions between the economic, environmental and social components of development has been receiving a new impetus due to the requirement that sustainability concerns be incorporated into the policy formulation process. A paper forthcoming in Ecological Economics [Böhringer, C., Löschel, A., in press. Computable general equilibrium models for sustainability impact assessment: status quo and prospects, Ecological Economics.] claims that Computable General Equilibrium (CGE) models may potentially represent the much needed “back-bone” tool to carry out reliable integrated quantitative Sustainability Impact Assessments (SIAs). While acknowledging the usefulness of CGE models for some dimensions of SIA, this commentary questions the legitimacy of employing this particular economic modelling tool as a single integrating modelling framework for a comprehensive evaluation of the multi-dimensional, dynamic and complex interactions between policy and sustainability. It discusses several inherent dangers associated with the advocated prospects for the CGE modelling approach to contribute to comprehensive and reliable sustainability impact assessments. The paper warns that this reductionist viewpoint may seriously infringe upon the basic values underpinning the SIA process, namely a transparent, heterogeneous, balanced, inter-disciplinary, consultative and participatory take to policy evaluation and building of the evidence-base.     

Integrating public demands into model-based design for multifunctional agriculture: An application to intensive Dutch dairy landscapes

The contribution of agriculture to the welfare of society is determined by its economic, social and environmental performance. Although theoretical discussions can be found in the literature, few reports exist that integrate the social demand for multifunctional agriculture in the evaluation of the sustainability and the global welfare of society. This paper presents a methodology that combines economic valuation, integrated modelling, stakeholder analysis, and multi-criteria evaluation. It consists of three steps to determine: (1) social demands for multifunctional agriculture; (2) feasible technical alternatives available from the supply part of the market; (3) the net utility of alternatives for society measured as the change in social net benefit, i.e. the sum of changes compared to the current situation expressed in utility of market and non-market net benefits. Market net benefits are represented by their monetary value. Quality Function Deployment combined with Analytic Network Process (QFD/ANP) were used to estimate the non-market net benefits. The methodology is applied to the case study of a dairy-farming based agricultural landscape in the Northern Friesian Woodlands, The Netherlands. Social net benefit depended on land use, i.e. pasture management regimes on each of the agricultural fields and on presence or absence of hedgerows around the fields. Changes in market net utility were expressed in terms of changes for farmers, consumers and government. Changes in non-market net utility were expressed in terms of changes in landscape quality, nature value and environmental health for Dutch society as a whole, as estimated from European public surveys (Eurobarometer). The complete solution space defined by the market and non-market net benefits of landscapes with alternative patterns of land use was estimated to offer insight in the trade-off between market and non-market performance and enable selection of ‘icon’ landscapes to target or avoid. Improvement of the current landscape towards the social optimum would involve changes in pasture management resulting in higher gross margin for farmers, slightly relaxing current environmental restrictions, which could be reached at lower levels of subsidies in agri-environmental programs. In addition to such overall optimum the results demonstrate the trade-off between market and non-market benefits and the characteristics of current, utopian and dystopian landscapes. The approach provides an alternative to current economic valuation methods which focus on assessment of economic value as an input to analysis. Here, economic value emerges as the trade-off between market and non-market functions which is an output of the analysis.     

Cost–benefit analysis – evaluation model of cloud computing deployment for use in companies

The use of cloud computing services appears to offer significant cost advantages. The most frequently mentioned advantages include investment and operating costs saving, high elasticity of services as well as increased flexibility of certain business processes. On the other hand, the adoption of cloud computing in enterprise environments is non-trivial. Understanding the organizational benefits and drawbacks is far from straightforward. The adoption of cloud computing results in a considerable amount of organizational change that will affect employees. The aim of this contribution is to conduct and describe the evaluation model of cloud computing that would be applicable in business practice for evaluating the effectiveness of such investments. The target users of this model are primarily people in companies with decision-making power in the investment field. The appropriate starting point based on the multi-criteria evaluation was the cost–benefit analysis (CBA) approach for cloud computing (CC). A multi-method approach (systematic literature review, analysis of real cloud computing services, expert interview, case study) was applied in order to develop and evaluate the formal model. We found that our model fits the practical requirements and supports decision-making in cloud computing.