A portfolio–evaluation framework for selecting R&D projects

This study aims to form the basis for constructing a framework for evaluating alternative portfolios of R&D projects. This study provides an extensive literature review on portfolio selection. Most of the existing studies deal with the portfolio selection problem by evaluating individual projects and then seeking ways to combine them for an R&D portfolio. However, the combination of individually good projects unnecessarily constitutes the optimal portfolio. In particular, this study discusses three portfolio effects: (1) the difference between the preference for the portfolio as a whole and the preference for the projects, (2) the interrelation among projects, (3) the size of portfolio selection problems. This study develops a three–phase framework for evaluating R&D portfolios and proposes a new taxonomy of the portfolio attributes (i.e. independent, interrelated, and synergistic). This study concludes with a discussion of future research, directed toward increasing the applicability of portfolio–selection approaches for managing R&D portfolios.     

R&D validation planning: a methodology to link technical validations to benefits measurement

An important activity in many R&D departments is the internal development of new process technologies and practices to assist in the marketing, design and manufacturing activities of the enterprise. An integral part of this R&D development is the planning and management of validations of potential technology projects. These validations are necessary to determine the technical, financial and organizational feasibility of the projects and to develop data for benefits measurement for further funding of selected projects. This paper describes a methodology for validation planning of new process technologies and practices. The methodology allows for the explicit linkage of a validation to the identification of its financial and strategic benefits. These often diverse measures of worth are integrated using a proven multi-attribute justification approach within the planning methodology. The methodology and the multi-attribute approach also support the comparison of dissimilar projects having different benefits. The methodology acts as an organizational planning tool integrating the needs of the diverse constituencies involved in R&D planning. It also acts as a tool to aid engineers and scientists identify and present the benefits of the proposed technology.     

Assessing collaborative, pre-competitive R&D projects: the case of the UK LINK scheme

The paper addresses the evaluation of outcomes of collaborative, pre-competitive R&D projects. It draws on some empirical analysis carried out on data and information gathered under the UK 'LINK' scheme, a programme supporting R&D collaborative projects and assessing collaboration outcomes. A new indicator of performance, based on the outputs of LINK projects, has been constructed. It provides a relative and quite consistent measure of performance for making comparisons among different LINK projects. However it does not correlate with the more subjective grade applied by LINK's own management. For further improving evaluating mechanisms, more attention should be paid to the benefits that universities and companies as well as governments are drawing from R&D collaborations.     

Stakeholder analysis for R&D project management

R&D projects affect the interests of different stakeholders in different ways. Understanding the stakeholders and analysing their interests helps in the better management of R&D projects. In this paper we discuss a methodology to systematically analyse the stakeholders of R&D projects. This methodology includes Freeman's (1984) three levels of analysis: rational, process and transactional. Based on these three levels, the stakeholder management capability of an R&D project is determined. The final stage is based on Mitchell et al . (1997) approach to analysing the dynamics of stakeholders. This methodology is illustrated using a New Zealand case relating to a road pricing R&D project.     

R&D management through network mapping: using the Internet to identify strategic network actors in cooperative research networks

Most R&D management techniques to date have emphasized the immediate organizational context or the internal structure and process of the R&D project. Recently however attempts have been made at situating R&D management in a wider context of inter‐organizational R&D activities. This paper presents the technique of R&D network mapping as a means of providing strategic intelligence to the R&D manager. The paper backgrounds this technique with a discussion of the general issue and significance of R&D networks. A methodology for R&D network mapping is then exemplified by outlining how a network database of cooperating projects and institutes in the telecom research sector was built by utilizing the World Wide Web. Finally a number of suggestions are made as to how and when network mapping should be applied in strategic R&D management.     

R&D projects in the science sector

The purpose of this research was to determine and analyse diversity in various features of R&D projects implemented in the science sector in Poland, financed mostly from public funds. More exactly, the following aspects of R&D projects implemented in the science sector in Poland were examined: the relation between the actually achieved and the initially set goal, the project management methodologies and project time management methods used, features of the project team, the relation between the plan and the actual project realisation and management difficulties encountered in practice. These aspects and their diversity were examined in the context of the whole country, of various fields of science and various research units implementing pure research (the ‘R’ area) or applied research and experimental development (the ‘D’ area). The research was conducted by means of survey methodology covering a sample of participants of R&D projects in the science sector in Poland. The results were analysed by means of statistical methods (which constitutes a clear novelty with respect to the existing literature on R&D projects) and statistically significant phenomena gave rise to several important conclusions on how R&D projects implemented in the science sector are managed and what their realisation looks like in various fields of science and various institutions, in a relatively new EU members state and a former communist country like Poland. These conclusions may be the basis for important hypotheses (which require further research) on the project management quality in the science sector in Poland and in similar countries, which is closely linked to the problem of public money allocation, its efficient spending and control. Also, practical suggestions on improvement measures in the science sector with respect to R&D projects, limited not only to countries like Poland, but of a more general nature, are formulated.     

Flexibility planning for managing R&D projects under risk

Incorporating managerial flexibility in an innovative R&D project is important, because managers face greater uncertainty in today's competitive and dynamic changing environment. It is essential to bring managerial flexibility into R&D project planning to decrease technical and market risks, while increasing potential market value. The objective of this paper is to develop a flexibility planning methodology based on real option analysis to improve managerial flexibility for R&D projects. The proposed methodology identifies potential risks that may occur during every R&D stage. It also recognizes a cascading option structure to resolve the identified risks, and evaluates and selects adequate options that maximize the potential value of the project. Instead of using a traditional option pricing method, a dynamic programming model that considers multidimensional product performance and market payoff is used to evaluate the R&D project value. Using the proposed methodology, managers can identify future scenarios as a function of their management actions. The proposed flexibility planning methodology can help managers improve managerial flexibility of R&D project and increase the success rate of product launch. A drug development project is used to illustrate the proposed methodology.     

System modeling of the R&D domain through the object–process methodology: a practical tool to help R&D satisfy its customers' needs

Research and Development is an intricate process involving a host of challenging technological frontiers. This paper presents a practical tool to help R&D personnel satisfy the needs of customers by a systematic evaluation of R&D performance. To establish a sound methodology for R&D performance evaluation, we employ the object-process analysis (OPA) part of the object–process methodology. Using OPA, we gradually expose the constituents of the R&D system, its environment and the interaction between them. Through this systematic top-down refinement, we provide a comprehensive generic view of the R&D domain. The framework presented in the paper allows the user to describe, order, and inter-relate the issues that R&D managers should consider when managing, evaluating and planning R&D. As the approach addresses structure and behaviour in a unified, integrated manner, the analysis provides insights into both the static and dynamic aspects of the R&D domain and establishes a solid basis for its enterprise modeling.     

Networks and the Decision to Persist with Underperforming R&D Projects

Drawing on aspiration level theory and the networks literature, this paper develops a model toward decision makers' persistence with underperforming R&D projects based on the perceived properties of their personal network. The assumption is that positive feedback from network partners motivates persistence, and that this effect is multiplied when the decision makers' network is larger and denser, when network ties are predominantly strong, and when communication frequency within the network is high. The model is tested by a field experiment and conjoint methodology. Analysis of 1632 persistence decisions nested within 51 scientists responsible for R&D projects reveals that more positive feedback enhances persistence of underperforming R&D projects, and that this effect becomes stronger with increasing network size, network density, and communication frequency. These findings extend the project management literature by focusing on the social environment of the decision maker as one so far neglected factor in empirical studies on persistence decisions. Moreover, this study is among the first to investigate contingency relationships between feedback received from network partners and network structure. Finally, while most studies have emphasized that individuals and organizations can profit from their engagements in social networks, this paper suggests a potential dark side of networks by showing that networks can encourage decision makers to persist with their investment in an underperforming—and potentially failing—project. These results can help project managers involved in networking activities to better understand the effects of these activities on their decision policies, and thus draw better and more accurate decisions. Second, this study provides insights into how organizational strategy with respect to dissemination of R&D results and involvement of the organization's R&D managers in the scientific community influences the persistence of underperforming R&D projects, and thereby the organization's R&D expenditures. This can assist top managers to design financial controls and allocate financial resources to managers of underperforming R&D projects in line with the organization's networking strategy.     

Project selection by scoring for a large R&D organisation in a developing country

A project selection method has been derived for the R&D Division of an electrical equipment manufacturer in a developing country. In the method, a scoring model is used to select and rank projects which have a wide range of objectives and characteristics. The criteria used for selection relate specifically to the organisation's needs and culture, and they are weighted according to their relative importance as perceived by executives. The results of the study indicate the research culture of the R&D Division and reflect its environment. As such the paper illustrates a methodology which can be universally applied to large R&D organisations in developing or developed countries.     

R&D Partnerships and Innovation Performance: Can There Be too Much of a Good Thing?

R&D collaboration facilitates the pooling of complementary skills, learning from the partner as well as the sharing of risks and costs. Research therefore stresses the positive relationship between collaborative R&D and innovation performance. Fewer studies address the potential drawbacks of collaborative R&D. Collaborative R&D comes at the cost of coordination and monitoring, requires knowledge disclosure, and involves the risk of opportunistic behavior by the partners. Thus, while for lower collaboration intensities the net gains can be high, costs may start to outweigh benefits if firms perform a higher share of their innovation projects collaboratively. For a sample of 2735 firms located in Germany and active in a broad range of manufacturing and service sectors, this study finds that increasing the share of collaborative R&D projects in total R&D projects is associated with a higher probability of product innovation and with a higher market success of new products. While this confirms previous findings on the gains for innovation performance, the results also show that collaboration has decreasing and even negative returns on product innovation if its intensity increases above a certain threshold. Thus, the relationship between collaboration intensity and innovation follows an inverted‐U shape and, on average, costs start to outweigh benefits if a firm pursues more than about two‐thirds of its R&D projects in collaboration. This result is robust to conditioning market success to the introduction of new products and to accounting for the selection into collaborating. This threshold is, however, contingent on firm characteristics. Smaller and younger as well as resource‐constrained firms benefit from relatively higher collaboration intensities. For firms with higher collaboration complexities in terms of different partners and different stages of the R&D process at which collaboration takes place, returns start to decrease already at lower collaboration intensities.     

R&D as an option on market introduction

Discounted cash flow methods for making R&D investment decisions cannot properly capture the option value in R&D. Since market and technology uncertainties change expectations about the viability of many new products, the value of projects is frequently adjusted during the R&D stages. Capturing the adjustment in expectations has an option value that may significantly differ from the Net Present Value of R&D projects. However, there are no historic time series for estimating the uncertainty of the value of R&D projects. As a result, the standard Black and Scholes model for financial option valuation needs to be adjusted. The aim of this paper is to report the application of a particular option pricing model for setting the budget of R&D projects. The option value of the model captures jumps or business shifts in market or technology conditions. The approach originates from applying current insight into the valuation of R&D projects to the field of multimedia research at Philips Corporate Research. This way, the gap between real option theory and R&D practice is further diminished.     

HETEROGENEITY OF FIRM CAPABILITIES AND COOPERATIVE RESEARCH AND DEVELOPMENT: AN EMPIRICAL EXAMINATION OF MOTIVES

This article proposes capability heterogeneity of R&D consortia participants as a condition to distinguish two competing motives for cooperative R&D: cost-sharing vs. skill-sharing. An analysis of 398 questionnaire responses from participants in Japanese government-sponsored R&D consortia finds that the relative importance of the cost-sharing motive in R&D consortia increases when participants’ capabilities are homogeneous or projects are large, while the relative importance of the skill-sharing motive in R&D consortia increases with heterogeneous capabilities. The skill-sharing motive is likely to increase a firm’s R&D spending, implying an additional consideration for management’s evaluation of cooperative R&D participation, as well as adding a new public policy implication of cooperative R&D. © 1997 by John Wiley & Sons, Ltd.     

The value of a ‘failed’ R&D project: an emerging evaluation framework for building innovative capabilities1

In literature and R&D organizations alike, project success consists in minimizing the deviations from set targets in terms of quality, cost and time. The main management task is to execute and monitor progress to reduce risks – assuming that project attributes are known, necessary resources can be estimated and a reasonable time table can be agreed upon. In such a context, evaluating project success is easy. However, in an innovative context, setting project targets initially is difficult and the contributions of the projects sometimes are of an unexpected nature. This paper investigates if projects can be evaluated in terms of how they contribute to the building of innovative capabilities of the firm instead of independently. Based on a case study at the Régie Autonome des Transports Parisians and the theoretical framework of innovation fields, a framework for evaluating projects from an additional perspective is proposed. Based on the following four criteria: financial resources, the development of a structured, refined and expanded strategic vision, developed competences (with related suppliers) and identification of knowledge gaps (occasionally with related partners for knowledge production), this framework shows how seemingly failed R&D projects can instead be considered as invaluable to the overall innovation process.     

R&D in markets with network externalities

This paper studies the consequences of network externalities on R&D rivalry between an incumbent firm and a potential entrant. In the model, all differences between the R&D projects chosen in market equilibrium and the socially best projects are solely due to network externalities. From a welfare perspective, the incumbent chooses a too risky and the entrant a too certain R&D project. Rothschild and Stiglitz's mean preserving spread criterion is used as a measure of risk. Adoption of a new standard is more likely in equilibrium than in the social optimum.     

Capital Budgeting Practices for R&D: A Survey and Analysis of Business Week's R&D Scoreboard

This paper discusses results of a survey of U.S. Corporations regarding the extent of the utilization of standard capital budgeting measures of investment worth to evaluate R&D projects. This study analyzes responses by three types of R&D activity: Basic, Applied and Development research. The results indicate that discounted cash flow methods are widely utilized in the evaluation of Development projects, and the analysis of Development projects is as sophisticated as the evaluation of non-R&D projects. The use of discounted cash flow analysis techniques for Applied projects is considerably less widespread than for Development projects. However, the utilization of Net Present Value and Internal Rate of Return increases with firm size. Basic research projects are much less likely to be subjected to a formal economic analysis and are generally thought of as being “strategic” investments. This research also indicates that post-audits of Applied and Development projects are based on economic measures, whereas Basic research projects focus on physical or operational goals. Lastly, this research indicates that most R&D projects are terminated because R&D priorities have changed rather than because they are not technically feasible.     

Morphological analysis in agricultural R&D: A technologist's approach to the definition and economic evaluation of technologies

The research scientist, the planner, and the R&D manager require a methodology that can compose a wide range of technological options within a realistic production system context and subject these options to a comprehensive, multi-parameter economic analysis. A technologically-oriented approach to the generation and ex-ante assessment of technologies is developed for this purpose in an agricultural R&D context. The approach is based on morphological analysis, in which a production process is defined as a series of tasks each of which can be accomplished by one or more alternative techniques. The model is customized for any specific production system using information provided by technology experts. This information is received in the language of the technologist, structured in a way that promotes an holistic view of the system, and processed to answer the needs of the economic evaluator. The model has been well received by technologists in the analysis of about a dozen diverse R&D projects.     

How well did the new Sumitomo Electric project ranking method predict performance?

The development and implementation of a new R&D project scoring method (NS-method) within Sumitomo Electric Industries was introduced in a previous report. This paper evaluates the NS-method's effectiveness by comparing the information generated by application to 146 projects in 1997 with the project achievements in 2000. The test results revealed that the NS-method's evaluation scores were correlated to the performance indicators such as the gross profit and R&D productivity. It also showed that, when projects are classified into three groups (i.e., Top, Middle, Bottom) according to the forecast data generated by the NS-method, the projects in the Top category had higher actual productivity ratios and success rates than those in the Bottom category.     

When Research Meets Development: Antecedents and Implications of Transfer Speed

This paper focuses on the organization of new product development in large, R&D‐intensive firms. In these firms, research and development activities are often separated. Research is conducted in dedicated research projects at specialized research labs. Once research results are achieved by research projects, they are transferred to business units for further development and commercialization. We investigate the speed whereby research projects transfer their first research results to business units (hereafter: transfer speed). In particular, we analyze the antecedents and performance implications of transfer speed. Based on data of 503 research projects from a European R&D intensive manufacturing firm, our results suggest that a fast transfer speed (as measured by the time it takes for a research project to develop and transfer its first research result to business units) is associated with a better research performance (as measured by the total number of transfers the research project generates). Moreover, we find that different types of external R&D partners—science‐based and market‐based partners—play distinct roles in speeding up project first research transfers. While market‐based partnerships (i.e., customers and suppliers) generally contribute to a faster transfer of first research results, science‐based partnerships (i.e., universities and research institutions) only speed up first research transfers of technologically very complex projects. Our results also show that early patent filings by research projects accelerate first research transfers.     

International R&D project evaluation by multinational corporations in the electronics and IT industry of Singapore

This paper explores a number of variables associated with the evaluation of international R&D projects by multinational corporations (MNCs) in the electronics and IT industry of Singapore. Empirical analysis of the data collected from R&D managerial executives suggests a series of considerations in relation to their R&D investments. It is desirable if R&D can create a potential impact on the growth of their regional and international businesses. In considering the risks associated with an R&D project, a balance approach would be appropriate when demanding a return on investment. In particular, the consistence with customer demands, the achievement of time‐based competitiveness, the training of R&D manpower and the development of conducive innovation environments are fundamental to the success of international R&D projects.