TOWARDS A SYSTEM OF PERFORMANCE MEASURES FOR RESEARCH ACTIVITIES: NIKEM RESEARCH CASE STUDY (original) (raw)
Related papers
Research, Development, and Engineering Metrics
Management Science, 1998
We seek to understand how the use of Research, Development, and Engineering (R,D&E) metrics can lead to more effective management of R,D&E. This paper combines qualitative and quantitative research to understand and improve the use of R,D&E metrics. Our research begins with interviews of 43 representative Chief Technical Officers, Chief Executive Officers, and researchers at 10 research-intensive international organizations. These interviews, and an extensive review of the literature, provide qualitative insights. Formal mathematical models attempt to explore these qualitative insights based on more general principles.
R&D Management, 2009
Measuring research and development (R&D) performance has become a fundamental concern for R&D managers and executives in the last decades. As a result, the issue has been extensively debated in innovation and R&D management literature. The paper contributes to this growing body of knowledge, adopting a systemic and contextual perspective to look into the problem of measuring R&D performance. In particular, it explores the interplay between measurement objectives, performance dimensions and contextual factors in the design of a performance measurement system (PMS) for R&D activities. The paper relies on a multiple case study analysis that involved 15 Italian technology-intensive firms. The results indicate that firms measure R&D performance with different purposes, i.e. motivate researchers and engineers, monitor the progress of activities, evaluate the profitability of R&D projects, favour coordination and communication and stimulate organisational learning. These objectives are pursued in clusters, and the importance firms attach to each cluster is influenced by the context (type of R&D, industry belonging, size) in which measurement takes place. Furthermore, a firm's choice to measure R&D performance along a particular perspective (i.e. financial, customer, business processes or innovation and learning) is influenced by the classes of objectives (diagnostic, motivational or interactive) that are given higher priority. The implications of these results for R&D managers and scholars are discussed in the paper.
Design of a Research Performance Measurement System: The Case of NIAB
Creativity and Innovation Management, 2001
At NIAB, a UK based company that provides research, services and information to the agricultural and food sector, a system has been designed that helps to assess and manage the growing research programme of the company. Since the company was 'privatised' four years ago, research activities have increased and moved away from solely applied research to a mix of applied and more fundamental research. Being a key element of the new developed company strategy, research now plays an increasing important role in broadening the scope of the company and keeping current services competitive by driving innovation. All research at NIAB is externally funded. In this paper we report on the process to design NIAB's performance measurement system, for which the Performance measurement system Systematic Design Approach was used. The design process was started with an elaborate structured problem analysis of the research process and its inter and extra-organisational context. Based upon this analysis, firstly a conceptual and secondly a detail design of a performance measurement system was made. To maximise the leverage from research, the system has been designed to optimise the value delivered to the funder as well as the value delivered to internal customers in the form of knowledge that drives innovation.
Performance measurement of research and development activities
European Journal of Innovation Management, 2009
Purpose -This paper aims to study the problem of designing a Performance Measurement System (PMS) for R&D. In particular, it aims at investigating the influence exerted by the type of activity being measured (i.e. Basic and Applied Research or New Product Development) on the design of the PMS constitutive elements. Design/methodology/approach -First, a literature review made it possible to build a theoretical model that identifies the constitutive elements of the PMS for R&D. Second, a survey involving 129 Italian firms (with a response rate of 33 per cent) was performed to unearth a number of similarities and differences between PMSs used in Research and New Product Development settings. Finally, a follow-up multiple case study investigation made it possible to understand the reason underlying the dissimilarities which emerged from the survey. Findings -The analysis suggests that a specialisation of the performance measurement practices in research and development is pursued by the Italian firms in the sample, especially when a number of conditions are in place (e.g. high level of uncertainty in R&D, availability of resources, organisational separation between the research and development functions).
A Tool for Measuring the Performance in the R&D Organizations
This research presents a new metrics to measure and assess the scientific performance of public research institutes, which improves models based on standard multivariate techniques. These models called Research Lab Evaluation (RELEV) adjusted are successfully applied to Italian public research institutes, operating in five scientific fields. In addition, the paper presents a comparison between this method and the Data Envelopment Analysis to show some analogies and differences in the results.
Metrics to Evaluate R&D Groups Phase I: Qualitative Interviews
Abstract Wedescribe the results of in-depth qualitative interviews with Chief Executive Officers, Chief Technical Officers, and researchers at ten large research-intensive organizations. In these interviews we explored how these organizations measure success in the R&D mission and how they provide incentives to managers,and researchers in R&D. We gained insight into the three tiers of the R&D mission: exploring the tools of the future, creating the tools, and pioneering the use of the tools. We learned how these tiers relate to the university and the business units. Metrics of success vary by tier, in part, because the role of corporate investment, the role of managers, and the role of internal customers vary by tier. This report provides an initial perspective on R&D metrics from the viewpoint of practicing managers and researchers. This perspective, which is Phase I of our research project, suggests research topics which we will explore in greater depth in subsequent Phase II. We ...
A model for R&D performance measurement
International Journal of Production Economics, 2011
R&D performance measurement Measurement in soft systems Models in measurement Balanced scorecard approach a b s t r a c t R&D activities are increasingly costly and risky and, as a consequence, measuring their performance and contribution to value becomes critical. This paper illustrates a formal model for measuring R&D performance, based upon a balanced and synthetic evaluation of quantitative indicators from five different perspectives of performance: financial, customer, innovation and learning, internal business, alliances, and networks. The model is built in coherence with the suggestions coming from the theory of measurement in soft systems, which gives relevant guidelines for ensuring validity, objectivity and inter-subjectivity of the model. Then, an application in a real R&D setting is described, which helps to understand the model and to enlighten its main advantages and limits.
Engagement in innovation networks can increase a company's innovation potential more than by only exploiting its own R&D resources. Theory has recognized innovation networks' increasing importance by investigating their single components and their relation to others. But in order to help the practice to decide when, and in which form of innovation networks, engagement is needed, and when it is better to cut ties to prevent resources from being wasted, performance monitoring from an individual company perspective is needed. The empirical background for this research was a six-month investigation of a well-established European innovation network for research on radiation dosimetry. This network aims to advance the scientific understanding of ionizing radiation dosimetry to promote dosimetric methods and instruments' technical development as well as their implementation in routine dosimetry, and to ensure the consistency of the dosimetric procedures used within the EU as well as compliance with international guidelines. This network consists of 47 European organizations in 31 different countries. The member organizations range from small to big laboratories (e.g., CERN in Switzerland), or research institutions (Institute of Nuclear Physics, Poland) to governmental institutions for radiation protection (National Agency for New Technology, Energy and the Environment, Italy) to companies that produce and sell dosimetric tools (ARC Seibersdorf Research, Austria). Beside the member organizations, which have different expectations regarding the value of and need for a network, other stakeholder like the European Commission and the governments of the single countries, which fund part of the network's activities, want a certain innovation outcome. These different perspectives make monitoring and demonstrating the network outcome increasingly complex. We are going to investigate the network and measure as well as illustrate its outcome for the different stakeholders in a three-year project. In the article, we present the performance indicators' first findings, based on interviews and questionnaires as well as on site visits and document analysis conduced in the first six months of the research project.
International Conference on Reliable Systems Engineering (ICoRSE) - 2021, 2021
An objective of research is development of a measurement scale for measuring customers' perception of performance value of products and services, provided in a market of research, development and innovation in the fields of technical science. The initial set of attributes that describe the performance value are "Quality and reliability", "Warranties and guarantees", and "Time of delivery". A psychometric adequacy of the initial set of sixteen manifest variables has been assessed for their reliability, convergent and discriminant validity and unidimensionality. Cronbach Alpha coefficient and Item-Total Correlation, exploratory and confirmatory factor analysis have been implemented to assess a psychometric adequacy of scales. The research results indicate that performance value is represented by two attributes, not three as initially hypothesized. They are "Quality and reliability" to which the warranties and guarantees items converged, and "Time of delivery". The developed measurement scales that reflect the attributes of the performance value consist of ten items (seven and three items, respectively). Both measurement scales possess adequate psychometric characteristics and are confirmed for their reliability, convergent and discriminant validity and unidimensionality.