Approaches
Canadian Evaluation Society Project in Support of Advocacy and
Professional Development http://consultation.evaluationcanada.ca/results.htm
presents a quick list of potential benefits that can be derived from
evaluation, outputs that result from evaluation activities, and
knowledge elements required to carry out evaluation activities.
The Independent Evaluators Webring has a document http://www.evaluators-webring.net/definitions.html
defining approaches to evaluation, including participatory,
empowerment, collaborative, feminist, outcome, impact, theory based.
Action research
Action research International http://www.scu.edu.au/schools/gcm/ar/arhome.html
see the FAQ page about action research http://www.scu.edu.au/schools/gcm/ar/arp/arfaq.html
Also see Action Research International, an on line journal http://www.scu.edu.au/schools/gcm/ar/ari/arihome.html
Center for Action Research in Professional Practice http://www.bath.ac.uk/carpp/
see their papers and publications page http://www.bath.ac.uk/carpp/publications/index.html
with such papers as "Handbook of Action Research Introduction: Inquiry
& participation in search of a world worthy of human
aspiration"
and "Layperson's guide to co-operative enquiry". Not necessarily
a method as an approach.
Collaborative, Participatory, and
Empowerment Evaluation
Collaborative, Participatory, and Empowerment Evaluation http://homepage.mac.com/profdavidf/empowermentevaluation.htm
This is the home of the AEA tig for this topic.
Empowerment Evaluation and the Internet: A Synergistic
Relationship http://cie.asu.edu/volume1/number4/index.html
an article about empowerment evaluation, by David M. Fetterman
Guide to Project Evaluation: A Participatory Approach http://www.phac-aspc.gc.ca/ncfv-cnivf/publications/fvprojevaluation-eng.php
This includes a brief description of what is participatory
evaluation.
USAID evaluation page
http://evalweb.usaid.gov/resources/tipsseries.cfm
lists the publications Conducting a Participatory Evaluation
Impact Evaluation
Network of Networks on Impact Evaluation (NONIE) http://www.worldbank.org/ieg/nonie/index.html
has some stuff, more coming soon. Some of their documents are on
their members page.
World Bank's impact
evaluation
another page on impact evaluation, has this definition: "An impact
evaluation assesses the changes in the well-being of
individuals that can be attributed to a particular project, program or
policy. This website aims at disseminating information and providing
resources for people and organizations working to assess and improve
the effectiveness of interventions aimed at reducing poverty."
And lists other resources.
The World Bank has this http://www.worldbank.org/ieg/influential_evaluations/
Influential Evaluations: Evaluations that Improved Performance and
Impacts of Development Programs
Impact Evaluation: Methodological and Operational Issues http://www.adb.org/Documents/Handbooks/Impact-Analysis/default.asp
"This quick reference provides an overview of methods available for
evaluating impacts of development programs, and addresses some common
operational concerns about their practical application." From the
Asian Development Bank.
Final Report of the Evaluation Gap Working Group: "When Will We Ever
Learn? Improving Lives through Impact Evaluation" http://www.cgdev.org/section/initiatives/_active/evalgap
"The Evaluation Gap Working Group was convened to understand the
reasons for the lack of good impact evaluation and the possible ways to
make significant progress toward solving the problem. After a year of
research and deliberation and further consultation among a broad set of
interested parties, the group reached a recommendation for what the
international community must do to close the "evaluation gap": take
individual action to reinforce existing efforts, and make a major
advance through a collective endeavor."
and in response:
International Workshop on Impact Evaluation for Development, 15
November 2006 - Hosted by the World Bank and the DAC Evaluation
Network http://www.oecd.org/document/56/0,3343,en_21571361_34047972_37626936_1_1_1_1,00.html
presentations available here.
Impact Evaluation – Its Purpose and Use http://www.oag.govt.nz/central-govt/1st-report-2000
This report includes a discussion of impact evaluation, along with how
its used in the govt.
Evaluation designs to assess program impact http://www.fhi.org/en/Youth/YouthNet/Publications/Focus/ToolsGuides/index.htm
Chapter 5 has some info This chapter "Offers guidance on an
considerations around the
need for impact evaluation, Reviews study designs you can use to carry
out an impact evaluation, Outlines the technical requirements and
resources needed for each type of evaluation." From Family Health
International.
Systems
Systems thinking and program evaluation http://facilitatedsystems.com/weblog/2005/06/systems-thinking-and-program.html
a portal to more info.
Integrated/overall approach
Easy Outcomes http://www.easyoutcomes.org/
"Easy Outcomes is a visual way of working which lets you do strategic
planning, monitoring, evaluation, reporting and contracting for any
project, program, organization, collaboration or sector."
Other
IFADs new approach to evaluation http://www.ifad.org/evaluation/oe/approach/1_0.htm
This includes 1. A strong service and partnership orientation,
2.Evaluation
work is working together, 3.Moving evaluation to a higher plane
and
4.Evaluation work needs to be evaluated. Also, evaluation
work
is inseparable from learning, and its resolve to learn with its
partners
and develop together with them the recommendations and lessons learned
to help improve the performance of IFAD’s operations.
Realistic Evaluation: An Overview, Nick Tilley. http://www.danskevalueringsselskab.dk/Materiale_fra_DES.asp
This paper was presented at the 2000 Founding Conference of the Danish
Evaluation Society. Tilley spells "out what I think evaluation can
usefully
contribute to social policy development." Tilley writes: "Whereas
the question which was asked in traditional experimentation was, 'Does
this work?' or 'What works?', the question asked by us in realistic
evaluation
is 'What works for whom in what circumstances?'" Another paper
in this conference was "Evaluation practices in European countries: is
there a future for national styles of evaluation?" Jacques
Toulemonde,
How research and evaluation evidence contributes to policy
making http://www.nationalschool.gov.uk/policyhub/evaluating_policy/how_res_eval_evid.asp
shows the many factors, including evaluation, that contribute to policy
making. Also shows that values (ie politics) contribute to evaluation.
Logic
Models
Just to start, a logic model is a
formal method to organize what you know about your program (goals,
activities, methods, expected outcomes, etc) so you can clearly specify
what you want to evaluate.
State Program Evaluation Guides: Developing and Using a Logic
Model http://www.cdc.gov/DHDSP/state_program/evaluation_guides/logic_model.htm
another overview
Logic models http://www.evaluationwiki.org/index.php/Logic_Model
Overview of what they are.
Logic model http://www.uwex.edu/ces/pdande/evaluation/evallogicmodel.html
oveview from UW Cooperative Extension
Community Health Worker Evaluation Tool Kit http://www.publichealth.arizona.edu/chwtoolkit/
has this chapter http://www.publichealth.arizona.edu/chwtoolkit/logic_models.htm
on logic models
Logic model development guide http://www.wkkf.org/Pubs/Tools/Evaluation/Pub3669.pdf
Logic models http://www.newvectors.net/esd/cocm.htm
This was a workshop on developing logic models. Listed near the bottom
of the page where it says "For further information about
Cross-Organizational Change Management, click to see the Logic Model
presentation that was presented at the Volpe National
Transportation Systems Center September 27th, 2006." The
actual presentation is here http://www.newvectors.net/esd/lmworkshop.ppt
Good outcomes model guidelines http://www.easyoutcomes.org/guidelines/outcomesguidelines.html
and here http://www.outcomesmodels.org/guidelines.html
similar to logic model, but different name
Logic model presentation http://www.usablellc.net/html/links_we_like.html#logic_models
slide show and talk about what are logic models.
Politics
of evaluation
Politics of evaluation http://weblogs.elearning.ubc.ca/mathison/
See the March 27, 2006 entry. This is an article by Tom Schwandt and is
from the Encyclopedia of Evaluation, 2004, edited by Sandra Mathison.
Decision-Making in Government: The Role of Program
Evaluation http://www.tbs-sct.gc.ca/eval/tools_outils/Aucoin/Aucoin_e.asp
"Decision-making in government is a process in which evidence, both
from systematic research and practical experience, mixes with a complex
interaction of ideas, interests, ideologies, institutions and
individuals. These several factors are the determinants of decisions at
the political and administrative levels. At different times and under
different regimes, the decision-making process will be structured and
managed in ways that seek to give more or less weight to evidence. No
one process is necessarily or always more ‘rational’ than the others.
It all depends on what questions need to be asked by decision-makers in
the circumstances and context of the times in order to make the best
possible decisions for their agendas and/or public expectations of good
governance.
As a consequence, the importance attached to the use
of evidence in decision-making invariable waxes and wanes over time."
Improving agricultural extension. A reference manual http://www.fao.org/docrep/W5830E/w5830e00.htm
see chapter 11 http://www.fao.org/docrep/W5830E/w5830e0d.htm
Evaluating extension programmes, some discussion about politics of
evaluation.
From Addressing Barriers to Learning, Vol. 3 (1), Winter 1998.
Accountability: Is it Becoming a Mantra? http://smhp.psych.ucla.edu/account.htm
School Mental Health Project-UCLA, Center for Mental Health in Schools.
"evaluation is not simply a technical process.
Evaluation involves decisions about what, how, and when to measure, and
these decisions are based in great part on values and beliefs. As a
result, limitedknowledge, bias, vested interests, and ethical issues
are constantly influencing evaluation processes and the decisions made
with respect to accountability."
From The Johns Hopkins University School for Advanced International
Studies http://www.sais-jhu.edu/cmtoolkit/issues/evaluation/effectiveness.html
"evaluation is inevitably a political act – evaluation is always
carried out for someone and for some purpose. At times this may
undermine the integrity of the evaluation." Some further
discussion.
Studies in Educational Policy and Educational Philosophy, E-tidskrift
2003:2 Christina Segerholm, quotes a paper
Dahler-Larsen, Peter (2003). Det politiske i evaluering.Studies in
Educational Policy and Educational Philosophy: E-tidskrift , 2003:1.
Dr. Segerholm writes
Dahler-Larsen points to evaluation as
political in that:
- evaluation policy is an agreement of how evaluation is to be carried
out
- evaluation politics is the political power game about “who gets what
when and how” (p. 2)
- the political in evaluation is about wider issues such as values in
society, the regulation of human relations, meaning-making and
conceptions of the surrounding world.
Both papers are available here http://www.upi.artisan.se
(click on "english" then on ejournal, then on 2003-1.
Evaluation Journal of Australasia
http://www.aes.asn.au/publications/
has several articles
about politics in evaluation. Examples are 'A balancing act':
resolving multiple stakeholder interests in program evaluation - Anne
Markiewicz, (March/April 2005, vol 4, no 1,2) and The politics of
program logic
– Brian English, Lisette Kaleveld (August 2003, vol 3, no 1).
click here to
return
to methods page
last updated 3/28/09
last verified 3/28/09
Didn't work on 3/28/09, I'l check again.
Welcome to Logic Models: The Basics!
http://apps.nccd.cdc.gov/dashoet/logic_model_1/index.html
"This tutorial will provide you with information and resources to
assist you as you plan and develop a logic model to describe your
program and help guide program evaluation."
(being revised, I'll check again)