Innovative impact planning and assessment through Global Libraries (original) (raw)

Global Libraries impact planning and assessment progress: part 2

Performance Measurement and Metrics, 2019

Purpose-The purpose of this paper is to report on recent performance measurement and impact evaluation progress made in Brazil, India, Indonesia, Moldova, Turkey and Vietnam as part of the last phase of the Global Libraries Initiative. Design/methodology/approach-The country reports are presented as a series of case studies, in some cases supplementing those reported earlier in this journal. Findings-Recent country-specific survey findings are reported and some conclusions are offered. Research limitations/implications-This paper demonstrates how the adoption of a common approach to library service evaluation across several countries can strengthen research practice at country level beyond the Global Libraries Initiative itself. Practical implications-This paper shares Global Libraries IPA learning at country level with people in other countries who may be contemplating public library evaluation at regional, national or local levels or who are interested in performance measurement and impact evaluation.

The evolution of Global Libraries’ performance measurement and impact assessment systems

Performance Measurement and Metrics, 2015

Purpose-The purpose of this paper is to describe the evolution of a common approach to impact assessment across the Global Libraries (GL) portfolio of grants. It presents an overview of two systems, the Performance Metrics (PMs) and the Common Impact Measurement System (CIMS). By providing a standard set of definitions and methods for use across countries, these systems enable grantees to collect data that can be compared and aggregated for the purpose of collective learning, improvement, accountability, and advocacy. Design/methodology/approach-The PMs offer a standard methodology to collect library project performance management data, whereas the CIMS is a standard survey of public library users. The paper describes how the PM and CIMS data are being visualized and used, with examples of findings and lessons learned. Findings-The paper cites examples of the type of PM and CIMS data available, with a focus on employment, gender, and case studies from Botswana and Indonesia. These highlights illustrate how libraries' user demographics differ from other types of public internet access venues and how libraries can contribute to strong employment and growth.

Gathering and using systematic evidence of public library service outcomes and of public perceptions of libraries to secure sustainability: the Global Libraries experience

2015

This paper introduces the Global Libraries initiative (GL) of the Bill & Melinda Gates Foundation and their focus on applying evidence of change, through a process of impact planning and assessment leading to advocacy. The authors describe the evolution of the GL approach to impact planning and assessment from the early stages of work with country grantees that focused primarily on performance measurement, through an increasing focus on assessing the impact of the program interventions on users and their lives, to the more recent work which has introduced a common impact measurement system (known as CIMS). They then describe the purpose and nature of CIMS and introduce the required and optional indicators across seven categories: digital inclusion, health, education, economic development, communication, culture & leisure, and government & governance. This part of the paper draws of the shared learning of the country teams engaged in the GL work and particularly the Impact Specialist...

Global Libraries Impact Planning and Assessment Progress

The purpose of this paper is to report on performance measurement and impact assessment progress made in 14 countries as part of the Global Libraries initiative, starting with the early country grants in Mexico and Chile. For the mature grants in Bulgaria, Botswana, Poland, Romania, Ukraine and Viet Nam which were recently completed or are approaching completion, the nature of the country program is outlined, before the impact assessment work is described and some recent results and conclusions are reported. A similar approach is adopted with pilot and new grants in Colombia, Indonesia, South Africa, Turkey and Lithuania.

Developing performance and impact indicators and targets in public and education libraries

International Journal of Information Management, 2001

The authors trace recent changes in the idea of evaluating performance in UK education and libraries and examine some of the di!erences in impact assessment between the two "elds; concluding that little attention has so far been given by librarians to service impact assessment. A process model for generating outcome/impact indicators and targets was developed in the course of research on the e!ectiveness of further education college libraries. This was then adapted into a development planning model to enable education library managers to work through the processes required to arrive at appropriate impact indicators. The model is described, various issues in working with the model are explored and its further adaptation for public library service managers through another national research project is reported.

New instruments for impact assessment: study of an academic library

2016

This study presents a review of new instruments for the impact assessment of libraries and a case study of the evaluation impact of the Library of the Faculty of Science, University of Porto (FCUP), from the students' point of view. We conducted a mixed methods research, i.e., which includes both qualitative data, to describe characteristics, in particular human actions, and quantitative data, represented by numbers that indicate exact amounts which can be statistically manipulated. Applying International Standard ISO16439:2014 (E)-Information and documentation-Methods and procedures for assessing the impact of libraries, we collected, 20 opinion texts from students of different nationalities, published in «Notícias da Biblioteca», from January 2013 to December 2014 and have conducted seven interviews.

Three impact evaluations in the province of Barcelona libraries

2017

In recent years, Barcelona Provincial Council has followed a strategy of evaluating the impact of its library programmes. This article presents the impact evaluation results of three such programmes. The impact evaluation of ‘easy-to-read’ clubs was made using a before-and-after methodology, and it showed a 54% increase in participants’ reading habits, and an 18% increase in their language skills. Digital training courses for over 55s were evaluated through randomized control trials. Participants increased their use of communication apps by 15%, and their use of Internet for leisure purposes and access to media by 18%. Finally, a reading promotion programme called ‘Velocirepte’ was analysed to evaluate its impact on the use of library services, through a quasi-experimental matching methodology. On average, participants took out almost 9 more library books per year than the control group.

4. Public Libraries’ Contribution to Sustainable Development Goals

Going Green: Implementing Sustainable Strategies in Libraries Around the World, 2018

Initiated in November 2016, the project Public Libraries and Sustainability: Gathering Evidences of Contribution to SDGs (Project PLS) aims to develop a framework for evaluating public libraries' contribution to Sustainable Development Goals (SDGs) and tailor it to Portuguese public libraries. This paper discusses the role of impact evaluation practices and competencies in evidence gathering and advocacy processes of libraries' contribution to the UN 2030 Agenda, focusing on the Project first stages. After presenting the research background and general methodological frame, the relevant approaches, methods and tools for assessing libraries' contribution to SD are examined, particularly the impact evaluation perspective. The resulting Model for Evaluating Public Libraries Contribution to SDGs is discussed, as well as the alignment process with SD goals and national priorities through the SDG# Mapping Tool. Finally, some key aspects of the ongoing research are presented.

Recent developments in library evaluation, statistics and measurement - and why they are important

2014

This paper identifies six key changes in library evaluation over the past five years and suggests why they may be important for IFLA delegates. Deciding which changes to feature was difficult because library evaluation is a highly contentious area (as is evaluation more generally) and because practice across the world is partial, patchy and uneven. The authors summarize their choices by noting a gradual move in the library evaluation field towards deeper understanding of the nature and significance of evaluation. Their key propositions are that: the demand for evaluation expertise is beginning to outstrip supply; there is a technology-enabled shift in research and evaluation focus from the world of the library to the information world of potential library users; there is growing experience of conducting library impact evaluation across countries; there is a dawning recognition that sustaining impact evaluation efforts is a core element in ensuring sustainability of libraries; there ...

Evaluation of Library Performance - Outcomes and Impact

1998

Measurement of library effectiveness is continuously actual: continued efforts to find ways to evaluate library effectiveness, include -quality improvement, benchmarking, performance measures and standards setting. Use of library performance measurement methods give possibilities to improve library performance effectiveness through using organisation management theory and helping libraries to better understand their organisations needs for innovation. Evaluation and a system of measures were intended to support: • Planning • Resource management • Operational function and service management • Promotion, marketing.