Hallie Preskill - Academia.edu (original) (raw)

Papers by Hallie Preskill

Research paper thumbnail of Evaluating Complexity: Propositions for Improving Practice

This practice brief is intended to bring together knowledge about systems change, complexity, and... more This practice brief is intended to bring together knowledge about systems change, complexity, and evaluation in a way that clarifies and describes how the practice of evaluation needs to evolve to better serve the social sector

Research paper thumbnail of Next Generation Evaluation: Embracing Complexity, Connectivity, and Change

This Learning Brief draws from literature and research, as well as more than a dozen interviews w... more This Learning Brief draws from literature and research, as well as more than a dozen interviews with foundation leaders, evaluation practitioners, and social sector thought leaders, with the intention of starting the conversation in the field around Next Generation Evaluation characteristics and approaches

Research paper thumbnail of Managing for Learning and Impact

Over the past three years, the King Baudouin Foundation has developed a more systematic approach ... more Over the past three years, the King Baudouin Foundation has developed a more systematic approach for the evaluation of its projects, which FSG helped codify in the KBF Project Management Guide: 'Managing for Learning and Impact'. There is a growing interest of foundations in Europe to evaluate the intended impact of their projects and programs. Foundations invest in an impact-driven philanthropy and therefore develop specific strategies, activities and tools

Research paper thumbnail of Facilitating Intentional Group Learning: A Practical Guide to 21 Learning Activites

Many of today's social sector organizations are searching for ways to be more nimble, adaptiv... more Many of today's social sector organizations are searching for ways to be more nimble, adaptive, and responsive, and they are looking to "learning" as a means for responding to myriad competing demands and shifting priorities and challenges. In particular, a range of publications and conferences have shown an interest in learning as a tool for social change. For example, in 2005, Grantmakers for Effective Organizations (GEO) reminded us that "Learning is about continual reflection—asking and answering key questions you need to know to make smarter decisions. It's about engaging staff, the board, and grantees in reflective discussion of what works (and what doesn't) to advance your organization's mission and goals" (p. 2).Others of us, including the Center for Evaluation Innovation, Innovation Network, Grantmakers in Health, Grantmakers in Education, Grantcraft, Johnson Center at Grand Valley State University, Council on Foundations, Center for Effe...

Research paper thumbnail of Markers that Matter: Success Indicators in Early Learning and Education

This new report developed by FSG with support from the W.K. Kellogg Foundation, distills a set of... more This new report developed by FSG with support from the W.K. Kellogg Foundation, distills a set of 48 early childhood indicators that reflect healthy development of young children. The report also highlights 10 emerging themes, areas that are not sufficiently addressed by existing indicators and where further inquiry is needed

Research paper thumbnail of Guide to Evaluating Collective Impact: Learning and Evaluation in the Collective Impact Context

As collective impact has gained traction across the globe, demand has grown for an effective appr... more As collective impact has gained traction across the globe, demand has grown for an effective approach to evaluating collective impact initiatives that meets the needs of various interested parties. Collective impact practitioners seek timely, high-quality data that enables reflection and informs strategic and tactical decision making. Funders and other supporters require an approach to performance measurement and evaluation that can offer evidence of progress toward the initiative's goals at different points along the collective impact journey. This three-part report responds to these needs by offering practitioners, funders, and evaluators a way to think about, plan for, and implement different performance measurement and evaluation activities

Research paper thumbnail of A Multidisciplinary Model of

Research paper thumbnail of New Directions for Evaluation

is intended to advance the practice of evaluation teaching using the case method by "providing sp... more is intended to advance the practice of evaluation teaching using the case method by "providing specially developed cases for teaching and teaching guidelines and discussion points to use in conjunction with the cases" (p. 3). In this issue, chapters 2-4 conclude with "Teaching Guidelines and Questions," which are intended to provide general case teaching guidance by providing case teaching questions and evaluation points to elicit through questioning. Chapter 1, Case Teaching and Evaluation, by Michael Q. Patton and Patricia Patrizi, outlines the logic and likely benefits of using and applying cases as a teaching method for students of evaluation. The authors argue that case teaching and training, like the longstanding traditions of using cases for teaching law and medicine, will prepare future evaluators for the practical problems that arise in real-world evaluations (e.g., "professional practice does note lend itself to rules and formulas" and "decisions are rarely routine", p. 5). The strategies for case teaching strategies presented by the authors in this chapter include (1) facilitating case discussion to provide experiences in evaluative thinking, situational analysis, and practical problem solving for real-world evaluation, (2) set and model norms of civil interaction, (3) emphasizing advanced preparation, (3) setting expectations

Research paper thumbnail of Engaging Stakeholders Guide

This guide describes a five-step process for engaging stakeholders in developing evaluation quest... more This guide describes a five-step process for engaging stakeholders in developing evaluation questions, and includes four worksheets and a case example to further facilitate the planning and implementation of your stakeholder engagement process.Step 1: Prepare for stakeholder engagement: This step includes collecting information about the program or initiative being evaluated -- its history, why it came into being, what it is trying to accomplish and what success would look like.Step 2: Identify potential stakeholders: This step involves identifying all of the potential stakeholders whom you might engage in the evaluation question development process.Step 3: Prioritize the list of stakeholders: This step helps determine which stakeholders are most vital to the question development process.Step 4: Consider potential stakeholders' motivations for participating: This step has you consider stakeholders' motivations for participating in the question development process. Knowing th...

Research paper thumbnail of Guide to Evaluating Collective Impact: Assessing Progress and Impact

As collective impact has gained traction across the globe, demand has grown for an effective appr... more As collective impact has gained traction across the globe, demand has grown for an effective approach to evaluating collective impact initiatives that meets the needs of various interested parties. Collective impact practitioners seek timely, high-quality data that enables reflection and informs strategic and tactical decision making. Funders and other supporters require an approach to performance measurement and evaluation that can offer evidence of progress toward the initiative's goals at different points along the collective impact journey. This three part series responds to these needs by offering practitioners, funders, and evaluators a way to think about, plan for, and implement different performance measurement and evaluation activities

Research paper thumbnail of The Readiness for Organizational Learning and Evaluation (ROLE) Instrument

This tool is designed to help an organization determine its level of readiness for implementing o... more This tool is designed to help an organization determine its level of readiness for implementing organizational learning and evaluation practices and processes that support it. The instrument's results can be used to: 1. Identify the existence of learning organization characteristics; 2. Diagnose interest in conducting evaluation that facilitates organizational learning; 3. Identify areas of strength to leverage evaluative inquiry processes; 4. Identify areas in need of organizational change and development. The organization may use the results to focus its efforts on improving or further strengthening areas that will lead to greater individual, team, and organizational learning

Research paper thumbnail of Building and Sustaining Support for Evaluation

Research paper thumbnail of Hallie Preskill In Search of the Holy Grail : Return on Investment Evaluation in Human Resource Development

The problem and the solution. Much of the human resource development (HRD) evaluation literature ... more The problem and the solution. Much of the human resource development (HRD) evaluation literature focuses on the Kirkpatrick four-level approach and emphasizes the importance of measuring the return on investment (ROI) of HRD initiatives or programs. This article argues that, in many cases, ROI does not provide the kind of information needed by decision makers. What is needed is a systems model that examines the effect of organizational and environmental factors on the intended outcomes of an HRD initiative or program. Such a model can help to frame any evaluation, including one that focuses on ROI.

Research paper thumbnail of The Value of Lived Experience

New Directions for Evaluation, 2018

Research paper thumbnail of The learning dimension of evaluation use

New Directions for Evaluation, 2000

... The 2000 American Society for Training and Development State of the Industry Report.Alexandri... more ... The 2000 American Society for Training and Development State of the Industry Report.Alexandria, Va.: American Society for Training & Development, 2000. Mezirow, J. Transformative Dimensions of Adult Learning. San Francisco: Jossey-Bass, 1991. ...

Research paper thumbnail of The use of critical incidents to foster reflection and learning in HRD

Human Resource Development Quarterly, 1996

Research paper thumbnail of Using appreciative inquiry in evaluation

SERIES EDITORS' NOTES (Gary T. Henry, Jennifer C. Greene).EDITORS' NOTES (Hallie Preskill... more SERIES EDITORS' NOTES (Gary T. Henry, Jennifer C. Greene).EDITORS' NOTES (Hallie Preskill, Anne T. Coghlan).1. An Overview of Appreciative Inquiry in Evaluation (Anne T. Coghlan, Hallie Preskill, Tessie Tzavaras Catsambas) This chapter provides an overview of Appreciative Inquiry and a discussion of why and how it may be used in evaluation practice.2. Appreciative Evaluation Within a Conflicted Educational Context (Sheila McNamee) Appreciative Inquiry was used as part of a schoolwide curriculum reform evaluation process with one department's staff that was having difficulties agreeing on its program's philosophy and curricular changes.3. Using Appreciative Inquiry to Guide an Evaluation of the International Women's Media Foundation Africa Program (Tessie Tzavaras Catsambas, Laverne D. Webb) This chapter examines the benefits and challenges of using Appreciative Inquiry processes to focus an evaluation and to design and conduct several data collection methods.4. Using Appreciative Inquiry to Evaluate Project Activities of a Nongovernmental Organization Supporting Victims of Trauma in Sri Lanka (Mette Jacobsgaard) Appreciative Inquiry was used to evaluate a program that serves victims of torture and trauma.5. Incorporating Appreciative Inquiry Methods to Evaluate a Youth Development Program (Dawn Hanson Smart, Mariann Mann) Using Appreciative Inquiry in conjunction with other evaluation methods helped to identify and confirm a program's theory of change and its long-term expected outcomes. It also provided important information for improving the program.6. Appreciating Appreciative Inquiry (Patricia J. Rogers, Dugan Fraser) This chapter provides a critique of the four case studies in this volume and offers insights into the limitations of using Appreciative Inquiry in evaluation contexts.7. Inquiry into Appreciative Evaluation (Michael Quinn Patton) After comparing Appreciative Inquiry applications in organizational development and evaluation, this chapter focuses on how Appreciative Inquiry adds to the options available to evaluators when seeking to match their evaluation approach to the situation and needs of users.INDEX.

Research paper thumbnail of Communicating and Reporting: Practices and Concerns of Internal and External Evaluators

Evaluation Practice, 1997

This study investigated internal and external evaluators' practices and concerns about commun... more This study investigated internal and external evaluators' practices and concerns about communicating and reporting evaluation findings. Approximately three-quarters (72%) of a random sample of American Evaluation Association members responded to a survey on this topic. Most of those responding: (1) adhere to traditional reporting formats; (2) are only moderately satisfied with their communicating and reporting efforts; (3) found that insufficient time and political/organizational complexity impedes success in communicating and reporting; and (4) describe effective Rosalie T. Torres practice as typically entailing high stakeholder involvement. Internal evaluation was found to be not only equally as prevalent as external evaluation, but different in relation to certain communication and reporting practices.

Research paper thumbnail of Throwing a Curveball in the Game of Evaluation: Deception and the Misuse of Findings

Advances in Developing Human Resources, 2001

Research paper thumbnail of Building Evaluation Capacity: 72 Activities for Teaching and Training. By Hallie Preskill and Darlene Russ-Eft. Thousand Oaks, CA: SAGE, 2005. 366 pp. $39.95. ISBN 0-7619-2810-3 (paperback)

Research paper thumbnail of Evaluating Complexity: Propositions for Improving Practice

This practice brief is intended to bring together knowledge about systems change, complexity, and... more This practice brief is intended to bring together knowledge about systems change, complexity, and evaluation in a way that clarifies and describes how the practice of evaluation needs to evolve to better serve the social sector

Research paper thumbnail of Next Generation Evaluation: Embracing Complexity, Connectivity, and Change

This Learning Brief draws from literature and research, as well as more than a dozen interviews w... more This Learning Brief draws from literature and research, as well as more than a dozen interviews with foundation leaders, evaluation practitioners, and social sector thought leaders, with the intention of starting the conversation in the field around Next Generation Evaluation characteristics and approaches

Research paper thumbnail of Managing for Learning and Impact

Over the past three years, the King Baudouin Foundation has developed a more systematic approach ... more Over the past three years, the King Baudouin Foundation has developed a more systematic approach for the evaluation of its projects, which FSG helped codify in the KBF Project Management Guide: 'Managing for Learning and Impact'. There is a growing interest of foundations in Europe to evaluate the intended impact of their projects and programs. Foundations invest in an impact-driven philanthropy and therefore develop specific strategies, activities and tools

Research paper thumbnail of Facilitating Intentional Group Learning: A Practical Guide to 21 Learning Activites

Many of today's social sector organizations are searching for ways to be more nimble, adaptiv... more Many of today's social sector organizations are searching for ways to be more nimble, adaptive, and responsive, and they are looking to "learning" as a means for responding to myriad competing demands and shifting priorities and challenges. In particular, a range of publications and conferences have shown an interest in learning as a tool for social change. For example, in 2005, Grantmakers for Effective Organizations (GEO) reminded us that "Learning is about continual reflection—asking and answering key questions you need to know to make smarter decisions. It's about engaging staff, the board, and grantees in reflective discussion of what works (and what doesn't) to advance your organization's mission and goals" (p. 2).Others of us, including the Center for Evaluation Innovation, Innovation Network, Grantmakers in Health, Grantmakers in Education, Grantcraft, Johnson Center at Grand Valley State University, Council on Foundations, Center for Effe...

Research paper thumbnail of Markers that Matter: Success Indicators in Early Learning and Education

This new report developed by FSG with support from the W.K. Kellogg Foundation, distills a set of... more This new report developed by FSG with support from the W.K. Kellogg Foundation, distills a set of 48 early childhood indicators that reflect healthy development of young children. The report also highlights 10 emerging themes, areas that are not sufficiently addressed by existing indicators and where further inquiry is needed

Research paper thumbnail of Guide to Evaluating Collective Impact: Learning and Evaluation in the Collective Impact Context

As collective impact has gained traction across the globe, demand has grown for an effective appr... more As collective impact has gained traction across the globe, demand has grown for an effective approach to evaluating collective impact initiatives that meets the needs of various interested parties. Collective impact practitioners seek timely, high-quality data that enables reflection and informs strategic and tactical decision making. Funders and other supporters require an approach to performance measurement and evaluation that can offer evidence of progress toward the initiative's goals at different points along the collective impact journey. This three-part report responds to these needs by offering practitioners, funders, and evaluators a way to think about, plan for, and implement different performance measurement and evaluation activities

Research paper thumbnail of A Multidisciplinary Model of

Research paper thumbnail of New Directions for Evaluation

is intended to advance the practice of evaluation teaching using the case method by "providing sp... more is intended to advance the practice of evaluation teaching using the case method by "providing specially developed cases for teaching and teaching guidelines and discussion points to use in conjunction with the cases" (p. 3). In this issue, chapters 2-4 conclude with "Teaching Guidelines and Questions," which are intended to provide general case teaching guidance by providing case teaching questions and evaluation points to elicit through questioning. Chapter 1, Case Teaching and Evaluation, by Michael Q. Patton and Patricia Patrizi, outlines the logic and likely benefits of using and applying cases as a teaching method for students of evaluation. The authors argue that case teaching and training, like the longstanding traditions of using cases for teaching law and medicine, will prepare future evaluators for the practical problems that arise in real-world evaluations (e.g., "professional practice does note lend itself to rules and formulas" and "decisions are rarely routine", p. 5). The strategies for case teaching strategies presented by the authors in this chapter include (1) facilitating case discussion to provide experiences in evaluative thinking, situational analysis, and practical problem solving for real-world evaluation, (2) set and model norms of civil interaction, (3) emphasizing advanced preparation, (3) setting expectations

Research paper thumbnail of Engaging Stakeholders Guide

This guide describes a five-step process for engaging stakeholders in developing evaluation quest... more This guide describes a five-step process for engaging stakeholders in developing evaluation questions, and includes four worksheets and a case example to further facilitate the planning and implementation of your stakeholder engagement process.Step 1: Prepare for stakeholder engagement: This step includes collecting information about the program or initiative being evaluated -- its history, why it came into being, what it is trying to accomplish and what success would look like.Step 2: Identify potential stakeholders: This step involves identifying all of the potential stakeholders whom you might engage in the evaluation question development process.Step 3: Prioritize the list of stakeholders: This step helps determine which stakeholders are most vital to the question development process.Step 4: Consider potential stakeholders' motivations for participating: This step has you consider stakeholders' motivations for participating in the question development process. Knowing th...

Research paper thumbnail of Guide to Evaluating Collective Impact: Assessing Progress and Impact

As collective impact has gained traction across the globe, demand has grown for an effective appr... more As collective impact has gained traction across the globe, demand has grown for an effective approach to evaluating collective impact initiatives that meets the needs of various interested parties. Collective impact practitioners seek timely, high-quality data that enables reflection and informs strategic and tactical decision making. Funders and other supporters require an approach to performance measurement and evaluation that can offer evidence of progress toward the initiative's goals at different points along the collective impact journey. This three part series responds to these needs by offering practitioners, funders, and evaluators a way to think about, plan for, and implement different performance measurement and evaluation activities

Research paper thumbnail of The Readiness for Organizational Learning and Evaluation (ROLE) Instrument

This tool is designed to help an organization determine its level of readiness for implementing o... more This tool is designed to help an organization determine its level of readiness for implementing organizational learning and evaluation practices and processes that support it. The instrument's results can be used to: 1. Identify the existence of learning organization characteristics; 2. Diagnose interest in conducting evaluation that facilitates organizational learning; 3. Identify areas of strength to leverage evaluative inquiry processes; 4. Identify areas in need of organizational change and development. The organization may use the results to focus its efforts on improving or further strengthening areas that will lead to greater individual, team, and organizational learning

Research paper thumbnail of Building and Sustaining Support for Evaluation

Research paper thumbnail of Hallie Preskill In Search of the Holy Grail : Return on Investment Evaluation in Human Resource Development

The problem and the solution. Much of the human resource development (HRD) evaluation literature ... more The problem and the solution. Much of the human resource development (HRD) evaluation literature focuses on the Kirkpatrick four-level approach and emphasizes the importance of measuring the return on investment (ROI) of HRD initiatives or programs. This article argues that, in many cases, ROI does not provide the kind of information needed by decision makers. What is needed is a systems model that examines the effect of organizational and environmental factors on the intended outcomes of an HRD initiative or program. Such a model can help to frame any evaluation, including one that focuses on ROI.

Research paper thumbnail of The Value of Lived Experience

New Directions for Evaluation, 2018

Research paper thumbnail of The learning dimension of evaluation use

New Directions for Evaluation, 2000

... The 2000 American Society for Training and Development State of the Industry Report.Alexandri... more ... The 2000 American Society for Training and Development State of the Industry Report.Alexandria, Va.: American Society for Training & Development, 2000. Mezirow, J. Transformative Dimensions of Adult Learning. San Francisco: Jossey-Bass, 1991. ...

Research paper thumbnail of The use of critical incidents to foster reflection and learning in HRD

Human Resource Development Quarterly, 1996

Research paper thumbnail of Using appreciative inquiry in evaluation

SERIES EDITORS' NOTES (Gary T. Henry, Jennifer C. Greene).EDITORS' NOTES (Hallie Preskill... more SERIES EDITORS' NOTES (Gary T. Henry, Jennifer C. Greene).EDITORS' NOTES (Hallie Preskill, Anne T. Coghlan).1. An Overview of Appreciative Inquiry in Evaluation (Anne T. Coghlan, Hallie Preskill, Tessie Tzavaras Catsambas) This chapter provides an overview of Appreciative Inquiry and a discussion of why and how it may be used in evaluation practice.2. Appreciative Evaluation Within a Conflicted Educational Context (Sheila McNamee) Appreciative Inquiry was used as part of a schoolwide curriculum reform evaluation process with one department's staff that was having difficulties agreeing on its program's philosophy and curricular changes.3. Using Appreciative Inquiry to Guide an Evaluation of the International Women's Media Foundation Africa Program (Tessie Tzavaras Catsambas, Laverne D. Webb) This chapter examines the benefits and challenges of using Appreciative Inquiry processes to focus an evaluation and to design and conduct several data collection methods.4. Using Appreciative Inquiry to Evaluate Project Activities of a Nongovernmental Organization Supporting Victims of Trauma in Sri Lanka (Mette Jacobsgaard) Appreciative Inquiry was used to evaluate a program that serves victims of torture and trauma.5. Incorporating Appreciative Inquiry Methods to Evaluate a Youth Development Program (Dawn Hanson Smart, Mariann Mann) Using Appreciative Inquiry in conjunction with other evaluation methods helped to identify and confirm a program's theory of change and its long-term expected outcomes. It also provided important information for improving the program.6. Appreciating Appreciative Inquiry (Patricia J. Rogers, Dugan Fraser) This chapter provides a critique of the four case studies in this volume and offers insights into the limitations of using Appreciative Inquiry in evaluation contexts.7. Inquiry into Appreciative Evaluation (Michael Quinn Patton) After comparing Appreciative Inquiry applications in organizational development and evaluation, this chapter focuses on how Appreciative Inquiry adds to the options available to evaluators when seeking to match their evaluation approach to the situation and needs of users.INDEX.

Research paper thumbnail of Communicating and Reporting: Practices and Concerns of Internal and External Evaluators

Evaluation Practice, 1997

This study investigated internal and external evaluators' practices and concerns about commun... more This study investigated internal and external evaluators' practices and concerns about communicating and reporting evaluation findings. Approximately three-quarters (72%) of a random sample of American Evaluation Association members responded to a survey on this topic. Most of those responding: (1) adhere to traditional reporting formats; (2) are only moderately satisfied with their communicating and reporting efforts; (3) found that insufficient time and political/organizational complexity impedes success in communicating and reporting; and (4) describe effective Rosalie T. Torres practice as typically entailing high stakeholder involvement. Internal evaluation was found to be not only equally as prevalent as external evaluation, but different in relation to certain communication and reporting practices.

Research paper thumbnail of Throwing a Curveball in the Game of Evaluation: Deception and the Misuse of Findings

Advances in Developing Human Resources, 2001

Research paper thumbnail of Building Evaluation Capacity: 72 Activities for Teaching and Training. By Hallie Preskill and Darlene Russ-Eft. Thousand Oaks, CA: SAGE, 2005. 366 pp. $39.95. ISBN 0-7619-2810-3 (paperback)