Skip to main content

Foundations of Evaluation for Planetary Health: Conclusion

Foundations of Evaluation for Planetary Health
Conclusion
  • Show the following:

    Annotations
    Resources
  • Adjust appearance:

    Font
    Font style
    Color Scheme
    Light
    Dark
    Annotation contrast
    Low
    High
    Margins
  • Search within:
    • My Notes + Comments
    • Notifications
    • Privacy
  • Project HomeFoundations of Evaluation for Planetary Health
  • Projects
  • Learn more about Manifold

Notes

table of contents
  1. Abstract
  2. Acknowledgements
  3. About the Authors
    1. Astrid Brousselle
    2. Kai Mountfort
  4. Invitation
  5. Prologue: The Hummingbird Fable
  6. Introduction
    1. Earth Day Evaluation Declaration 2024
    2. Endnotes
  7. 1. Context Matters: Evaluation in the 21st Century
    1. Highlights
    2. Introduction
    3. Environmental and Social Depletion
    4. Reducing Risks
    5. Local Cultural Contexts
    6. Evaluation Takes Place in a Political Context
    7. Post-truth Influence as the New Propaganda
    8. Conclusion
    9. Endnotes
  8. 2. Evaluation for Planetary Health
    1. Highlights
    2. Introduction
    3. The United Nations Sustainable Development Goals
    4. The Planetary Health Framework
    5. A Transformative Approach
    6. Conclusion
    7. Endnotes
  9. 3. The Planetary Health Rapid Impact Assessment Tool
    1. Highlights
    2. Introduction
    3. The Planetary Health Rapid Impact Assessment Tool
    4. Conclusion
    5. Endnotes
  10. 4. Evaluation: Definitions, Approaches and Questions
    1. Highlights
    2. Introduction
    3. Definitions
    4. Evaluation Approaches
    5. When to Evaluate and for What Purpose?
    6. Evaluative Questions
    7. Conclusion
    8. Endnotes
  11. 5. Preparing for the Evaluation
    1. Highlights
    2. Introduction
    3. Evaluation Use and the Importance of Mapping the Context
    4. Drafting an Evaluation Plan
    5. Summary
    6. Conclusion
    7. Endnotes
  12. 6. Representing the Intervention
    1. Highlights
    2. Introduction
    3. The Causal Model
    4. The Logic Model
    5. Use of Logic Models
    6. Different Visual Representations of the Intervention
    7. Conclusion
    8. Endnotes
  13. 7. Logic Analysis
    1. Highlights
    2. Introduction
    3. Foundations of Logic Analysis
    4. Types of Logic Analysis
    5. Steps for Conducting a Direct Logic Analysis
    6. Steps for Conducting a Reverse Logic Analysis
    7. Conclusion
    8. Endnotes
  14. 8. Effect Analysis and Related Approaches
    1. Highlights
    2. Introduction
    3. Defining Effects and Causal Relationship
    4. Experimental and Quasi-Experimental Research Designs
    5. Contribution Analysis
    6. Impact Evaluation
    7. Considering Planetary Health Dimensions when Evaluating Impacts
    8. Outcome Harvesting
    9. Conclusion
    10. Endnotes
  15. 9. Implementation Analysis
    1. Highlights
    2. Introduction
    3. In the Literature
    4. Implementation Analysis Questions
    5. Evaluation Designs for Implementation Analysis
    6. Impacts on Planetary Health
    7. Conclusion
    8. Endnotes
  16. 10. Economic Evaluation
    1. Highlights
    2. Introduction
    3. Background
    4. Types of Economic Evaluations
    5. The Comparator
    6. Cost Calculation
    7. Time Horizon
    8. Uncertainty
    9. Decision Criteria
    10. Limitations of Existing Approaches
    11. A Proposal for Useful Economic Evaluations for Planetary Health
    12. Conclusion
    13. Endnotes
  17. 11. Needs Assessment
    1. Highlights
    2. Introduction
    3. Defining What is, What should be and For Whom
    4. Contextual Elements and Boundaries
    5. Ex-ante and Ex-post
    6. Other important Considerations
    7. Next Steps?
    8. A Political Exercise
    9. Summary
    10. Endnotes
  18. 12. Monitoring
    1. Highlights
    2. Introduction
    3. Focus
    4. Establishing a Monitoring System
    5. Reporting and Other Considerations
    6. Gaming and Other Behavioural Effects
    7. Conclusion
    8. Endnotes
  19. 13. An Example: Evaluating a Local Government Official Community Plan Using Planetary Health Lenses
    1. Introduction
    2. Characterizing the OCP Within the Context of the Planetary Health Framework
    3. Data Collection
    4. Findings
    5. Recommendations
    6. Conclusion
    7. Endnotes
  20. 14. Further Thoughts and Resources
    1. Endnotes
  21. Bibliography

Exhibit 8.2: 6-step Approach to Outcome Harvesting

1 - Design the Outcome Harvest based on the principal uses of the primary users. Come to agreement with the people who will use the results of the Outcome Harvest on priority Outcome Harvesting questions to guide the harvest. Users and harvesters should also agree on the process: what information is to be collected, how, from whom, when, and with what resources in order to credibly answer the questions.

2 -Review documentation by identifying and formulating draft, potential outcome statements contained in secondary sources of information: reports, evaluations, press releases, and other documentation. These statements should comprise (a) changes in individuals, groups, communities, organizations, or institutions; and (b) how the intervention plausibly influenced them. They may contain other useful information such as the significance of each outcome.

3 - Engage with human sources. The harvester facilitates conversations with the people who have the most knowledge about what the intervention has achieved and how. They usually are the authors of the documentation, the intervention’s other field staff, allies, and others closest to the action. They review and fill gaps in the potential outcome statements extracted from documentation, identify and formulate additional ones, and together with the harvester agree on a set of robust outcome statements that are sufficiently precise to be verifiable.

4 - Substantiate with external sources a select number of outcome statements. Substantiators are one or more persons knowledgeable about the change but independent from the organization to ensure accuracy, or deepen understanding, or both. For example, they may be the societal actors who changed their behavior or allies who collaborated in the intervention, unless of course they already served as a primary source in the third step. This fourth step ensures that the whole set of outcome statements is sufficiently credible for the intended uses. These outcome statements are the evidence used in the next step.

5 - Analyze and interpret by first organizing outcome statements so they are manageable, for example, categorising them by evaluation question, and then using this to provide evidence-based answers to the prime evaluation questions, where the evidence is the information contained in the outcome statements generated in the previous three steps.

6 - Support use of findings after the evaluation questions are answered so the users make better use of the process and findings.

Source: Wilson-Grau, R. (2019). Outcome Harvesting: Principles, Steps, and Evaluation Applications. Information Age Publishing: 8-9.

Conclusion

Evaluations and reflections on effect analysis (and impact evaluations) have greatly changed in the last 25 years. New approaches are becoming mainstream, which allows evaluators to choose from a diversity of evaluation approaches. Nevertheless, planetary health dimensions are not systematically integrated, which is understandable but no longer acceptable. Existing methodologies and knowledge allow for the planetary health dimensions to be integrated in all studies. This new practice would increase awareness of global and local impacts. It would influence recommendations based on human and environmental impacts and encourage the implementation of mitigation measures to avoid negative intervention impacts.

Annotate

Next Chapter
Endnotes
PreviousNext
EPUB
This book is released under a Creative Commons Attribution-Non-Commercial 4.0 International (CC BY-NC 4.0) license. This means that you are free to share and build upon the material, so long as you give appropriate credit and indicate if changes are made. You may not use the material for commercial purposes. Under this license, anyone who redistributes or modifies this book, in whole or in part, can do so for free providing they properly attribute the book as follows: Brousselle, A. (2026). Foundations of Evaluation for Planetary Health. Victoria, B.C. University of Victoria Libraries. Doi: https://doi.org/10.18357/9781550587364
Powered by Manifold Scholarship. Learn more at
Opens in new tab or windowmanifoldapp.org