METHODS - on line books, manuals, guides to research methods and evaluation. 
   
Most of these sites describe social research methods, or evaluation methods, including survey methods, qualitative methods.   These are listed in 2 main sections: General Methods, and Evaluation.  Many of the evaluation guides are also general methods guides.  Each section is further subdivided into academic sites, government sites, or private organization or individual sites.  This organization is used because there are a lot of sites, and this was one way to organize them.  Within sections, site are listed in no particular order.

click here to return to main methods page

I General Research Methods sites

Government


e-Source   http://www.esourceresearch.org/   From the US NIH. This site says "Inside you will find 20 interactive chapters with authoritative answers to methodological questions on behavioral and social science research." Basically, how they say research should be done.


Statistics: Power from data.   http://www.statcan.gc.ca/edu/power-pouvoir/toc-tdm/5214718-eng.htm   has sections describing data collection methods, questionnaires. 


Academic sites


Anol Bhattacherjee  Social Science Research: Principles, Methods, and Practices   http://scholarcommons.usf.edu/oa_textbooks/3/   from 2012


Susan Losh   http://myweb.fsu.edu/slosh/index.html   teaches research methods   http://myweb.fsu.edu/slosh/MethodsOverview.html    introduction to different methods, eg, surveys, focus groups, some less structured methods.


PPA 696 Research Methods  http://www.csulb.edu/~msaintg/ppa696/696menu.htm#PPA 696   very nice overview on different research methods.   


Educational research lectures   http://www.southalabama.edu/coe/bset/johnson/dr_johnson/2lectures.htm      actually brief outlines of general methods, including qualitative, historical, statistical analysis, etc....  
 

Trochim, William M. The Research Methods Knowledge Base,   http://www.socialresearchmethods.net/kb/index.htm  . General research methods text, with chapters on topics such as survey construction, sampling, and a chapter on evaluation.  If its a method, its probably here.


On line research methods   http://www.restore.ac.uk/orm/site/home.htm   From the National Center for Research Methods. Aimed at understanding how to do research on line.


Methods Used in Instructional Assessment and Evaluation   http://www.utexas.edu/academic/ctl/assessment/iar/index.php    See the "learn more" section on the side.


Institute for Health and Work, Guide to Evaluating the Effectiveness of Strategies for Preventing Work Injuries   http://www.iwh.on.ca/evaluating-safety-programs   chapters on planning, designing, analysing, methods for evaluation. From 2001.


This OpenStax book, Introduction to Sociology   http://openstaxcollege.org/textbooks/introduction-to-sociology   has a chapter outlining research methods.


Private organizations or people

s-cool sociology methods  http://www.s-cool.co.uk/a-level/sociology/methods   brief descriptions of different methods such as participant observation, experiments, sampling, comparative methods, and secondary data analysis. This is at s-cool,   http://www.s-cool.co.uk/    then click on A level methods, then sociology, then methods.


Research Design Review   http://researchdesignreview.com/   from Margaret Roller, "is intended for the providers, users, and students of qualitative and/or quantitative research who have an interest in thinking about and discussing research design issues."



II: Evaluation: how to, approaches, manuals, guides
These also often include research methods as well.

Start here

Introduction to Evaluation   http://www.socialresearchmethods.net/kb/intreval.htm   covers basics such as definitions, types, eval questions and methods.



Managing evaluations


The Program Manager's Guide to Evaluation   http://www.acf.hhs.gov/programs/opre/resource/the-program-managers-guide-to-evaluation-second-edition   2010. topics include 'why evaluate your program', who should conduct, how to hire, and so on.

W.K. Kellogg Foundation Evaluation Handbook   http://www.wkkf.org/   2010. The Kellogg Foundation is an organization that gives grants, and this handbook is "written primarily for project directors who have direct responsibility for the ongoing evaluation of W.K. Kellogg Foundation-funded projects"  so a lot of it is an overview of evaluation, the processes involved, and of important considerations in making decisions about the evaluation process.  Not exactly a "how-to", but a comprehensive guide to decisions involved in the evaluation process. They keep changing the location of this book, so I don't list the specific url. Do a search for 'Evaluation Handbook'.
 

Making evaluations matter: A practical guide for evaluators.  http://library.wur.nl/WebQuery/wurpubs/405451   by Cecile Kusters with Simone van Vugt, Seerp Wigboldus, Bob Williams and Jim Woodhill. 2011. Published from Centre for Development Innovation, Wageningen University & Research centre, Wageningen, The Netherlands.


A guide for project M&E   https://www.ifad.org/evaluation/reports/guide   from IFAD. "This Guide has been written to help project managers and M&E staff improve the quality of M&E"


Academic sites    

Richard A. Krueger's site   http://www.tc.umn.edu/~rkrueger/   has some brief guides for various topics about evaluation, such as strategies, logic models, but also tips about surveys, interviewing, observations, focus groups.

 

Evaluation cookbook    http://www.icbl.hw.ac.uk/ltdi/cookbook/contents.html    evaluation methods for lecturers, but some of the guides seem appropriate for everyone. The preparation page has some info on questionnaires, scaling, etc.


Power of Proof: An Evaluation Primer   http://www.ttac.org/services/power-of-proof/index.html   from Emory University, Rollins School of Public Health


The Center for Program Evaluation and Research   http://programeval.ucdavis.edu/index.html   has some nice pamphlets and videos.


Monitoring and Evaluation: How and How Well Objectives are Being Reached   http://cec.vcn.bc.ca/cmp/modules/mon-int.htm   Phil Bartle, PhD. Written for community empowerment.



Cooperative extension resources


Rutgers Cooperative Extension publications   http://njaes.rutgers.edu/pubs/subcategory.asp?cat=11&sub=70  2002, 2003. lists the following publications, A Step-By-Step Guide to Developing Questionnaires and Survey Research Procedures for Program Evaluation & Research, Choosing a Data Collection Method for Survey Research, Maximizing Response Rate and Controlling Nonresponse Error in Survey Research, and Choosing Appropriate Research Methods to Evaluate Educational Programs. These are all short (2-3 page) pdf files.
    If above link doesn't work, try   http://njaes.rutgers.edu/pubs/default.asp   then click on Educational Design and Program Evaluation then Rutgers Cooperative Extension
 

Penn State  Program Evaluation Tip sheets   http://extension.psu.edu/evaluation/   a bunch of guides to many aspects.of program evaluation, including methods such as creating questionnaires, data collection methods, research design, sampling, etc.
 

Univ of Wisconsin Cooperative Extension publications   has this set of eval docs   http://www.uwex.edu/ces/pdande/evaluation/evaldocs.html    and these sections: Collecting and analyzing data   http://learningstore.uwex.edu/Collecting-Analyzing-Data-C237.aspx   and Designing evaluation   http://learningstore.uwex.edu/Designing-Evaluations-C238.aspx   

 
Program Evaluation Measurement Resource    http://www.ag.ohio-state.edu/~brick/dcc1pg.htm    from Michigan State University Department of Agricultural and Extension Education. Includes Introduction to Program Evaluation   http://www.ag.ohio-state.edu/~brick/suved2.htm   a brief overview of evalaution issues and methods.

 

Government sites

From the UK

Green Book, Appraisal and Evaluation in Central Government   https://www.gov.uk/government/publications/the-green-book-appraisal-and-evaluation-in-central-governent   "This new edition of the Green Book, Appraisal and Evaluation in Central Government, incorporates revised guidance, to encourage a more thorough, long-term and analytically robust approach to appraisal and evaluation. It is relevant to all appraisals and evaluations."  Last updated 2015



From Canada


Centre of Excellence for Evaluation (CEE)   http://www.tbs-sct.gc.ca/cee/index-eng.asp   not exactly a how to, but according to their website "The CEE provides functional leadership, including advice and guidance in the conduct, use and advancement of evaluation practices across the federal government."  They have policies and standards on evaluation, and these
Theory-Based Approaches to Evaluation: Concepts and Practices
and
Supporting Effective Evaluations: A Guide to Developing Performance Measurement Strategies




From the USA
  

Psychological Health and Traumatic Brain Injury Program Evaluation  http://www.dcoe.mil/About_DCoE/Program_Evaluation.aspx   pretty comprehensive guide to many aspects of evaluation. Not much about methods of gathering data though. July 2012.



National Science Foundation:  has three reports available on line:
   User-Friendly Handbook for Mixed Method Evaluations     http://www.nsf.gov/publications/pub_summ.jsp?ods_key=nsf97153  1997.
   The User-Friendly Handbook for Project Evaluation       http://www.nsf.gov/pubs/2002/nsf02057/start.htm   2002.
   Footprints: Strategies for Non-Traditional Program Evaluation     http://www.nsf.gov/publications/pub_summ.jsp?ods_key=nsf9541  1995
   

CDC Evaluation Working Group http://www.cdc.gov/eval/index.htm  This site is about the CDC Evaluation Working Group and its efforts to promote program evaluation at the CDC and throughout the public health system.  See especially their "highlights of a framework for program evaluation", and their links page which is a really comprehensive list of links.  Their categories include Ethics, Principles and Standards, Organizations, Societies, Foundations, Associations, Journals and On-Line Publications, Step-by-Step Manuals, Logic Model Resources, Planning and Performance Improvement Tools.

CDC also has these
*   Introduction to program evaluation for public health programs: A self-study guide.  http://www.cdc.gov/eval/guide/   some more basics. 2011.
*   Introduction to Program Evaluation for Comprehensive Tobacco Control Programs   http://www.cdc.gov/tobacco/tobacco_control_programs/surveillance_evaluation/evaluation_manual/index.htm   another general methods guide. 2001.
*   Program evaluation manuals   http://www.cdc.gov/tb/programs/Evaluation/default.htm   several listed here. One is TB Program Evaluation Handbook: Introduction to Program Evaluation, 2006
*   Introduction to Program Evaluation for Public Health Program. Evaluating Appropriate Antibiotic Use Programs, 2006.  
     http://www.cdc.gov/getsmart/community/improving-prescribing/program-development-eval/evaluation-manual/index.html   


Measuring the Difference: Guide to Planning and Evaluating Health Information Outreach    http://nnlm.gov/evaluation/guides.html    Second edition from 2013.
 
Identifying and Implementing Educational Practices Supported By Rigorous Evidence: A User Friendly Guide. From the US Department of Education Institute of Educational Sciences   http://ies.ed.gov/ncee/pubs/evidence_based/evidence_based.asp   This guide offers tools to educational practitioners that help distinguish practices supported by rigorous evidence from those that are not." This is mainly about randomized control trials.

Also see some technical publications   http://ies.ed.gov/ncee/tech_methods/  
"Technical Methods Report: Statistical Power for Regression Discontinuity Designs in Education Evaluations" 2008
"What to Do When Data Are Missing in Group Randomized Controlled Trials"
Also see this one
"Random Assignment in Program Evaluation and Intervention Research: Questions and Answers" here   http://ies.ed.gov/ncee/pdf/20035001.pdf   2003
   


Pink Book-Making Health Communication Programs Work   http://www.cancer.gov/publications/health-communication   has a chapter on evaluation (stage 4) and a chapter on research methods.



From Australia

Planning and Evaluation Wizard    http://www.flinders.edu.au/medicine/sites/pew/pew_home.cfm    see the evaluation zone   http://som.flinders.edu.au/FUSA/SACHRU/PEW/pep_eval_zone.htm  



Private organizations or people


Impact Evaluation


InterAction has a couple of manuals about impact evaluation   http://www.interaction.org/resources/training   by Patricia Rogers, Burt Perrin, Michael Bamberger. 


Unicef has briefs and videos  https://www.unicef-irc.org/KM/IE/impact_1.php  


Impact Evaluation http://go.worldbank.org/2DHMCRFFT2  explains a lot and has key readings, links to their methods page


And World Bank has this  http://go.worldbank.org/IT69C5OGL0   Impact Evaluation Toolkit


Other

Amnesty International,   Evaluation, A Beginners Guide  https://www.amnesty.org/en/documents/pol32/003/1999/en/    1999
 

Annie E. Casey Foundation has some evaluation guides like this one:  The Need for Self-Evaluation: Using Data to Guide Policy and Practice (summary)  http://www.aecf.org/resources/the-need-for-self-evaluation/   no date given.


Asian Development Bank.   http://www.adb.org/site/evaluation/methods-guidelines     includes this, from 2015,  Guidelines for the Preparation of Country Assistance Program Evaluations and Country Partnership Strategy Final Review Validations.


Better Evaluation   http://betterevaluation.org/   "An international collaboration to improve evaluation practice and theory by sharing information about options (methods or tools) and approaches."  Has stuff about methods and a lot more.


Horizon Research, Inc., Taking Stock: A Practical Guide to Evaluating Your Own Programs, 1997.   http://www.horizon-research.com/taking-stock-a-practical-guide-to-evaluating-your-own-programs/    The guide is an overview of four steps in evaluation: framing the evaluation, defining goals and objectives, finding evidence, making sense of the evidence.


IFAD Evaluation   https://www.ifad.org/evaluation/overview    Includes an evaluation manual on methods and issues. 2015.  https://www.ifad.org/evaluation/policy_and_methodology/overview/tags/2085763 

Also see   https://www.ifad.org/evaluation/reports/guide/tags/1880189   A guide for project M&E, 2002.


Basic Guide to Program Evaluation   http://managementhelp.org/evaluation/program-evaluation-guide.htm   Written by Carter McNamara, PhD, this is an on line guide to program evaluation, which describes many of the methods used, for example, surveys, interviewing, focus groups, and other methods.  This site also has many useful links. 


McCreary Center.  Asking Questions That Matter   http://www.mcs.bc.ca/evaluation_resources    This toolkit aims to increase understanding evaluation, develop the skills to prepare an evaluation plan, and provide tools to carry out an evaluation of a local community project.


Mymande has a number of evaluation books   http://www.mymande.org/selected-books   not always exactly how to, but interesting and useful.
 


Challenges in Program Evaluation of Health Interventions in Developing Countries. Barbara O. Wynn, Arindam Dutta, Martha I. Nelson   http://www.rand.org/pubs/monographs/MG402/   The authors provide an overview of various approaches, methodologies, and issues related to program evaluation for health projects in developing countries
 

Tools 4 Development   http://www.tools4dev.org/category/resources/how-to-guides/  and here  http://www.tools4dev.org/category/skills/monitoring-evaluation/    has many guides about how to do research and evaluation


Robert McCormick Foundation has an evaluation guide   http://www.mccormickfoundation.org/page.aspx?pid=642   in their tools for learning. 2013

OECD Evaluation of development programmes   http://www.oecd.org/dac/evaluation/   has some documents, like this "Evaluating Development Co-operation: Summary of key norms and standards"  Contains the main elements of the OECD DAC's approach to evaluation, including evaluation criteria, core principles and quality standards


UNESCOs Evaluation Manual   http://portal.unesco.org/en/ev.php-URL_ID=24425&URL_DO=DO_TOPIC&URL_SECTION=201.html   has overview of evaluation, guide to surveys and to interviewing.

A Manual on Monitoring and Evaluation for Alternative Development Projects. 2003. http://otp.unesco-ci.org/training-resource/project-management/manual-monitoring-and-evaluation-alternative-development-projec  

Planning, monitoring and evaluation training manual for higher education HIV/AIDS and SRH interventions in Ethiopia. 2013. http://hivhealthclearinghouse.unesco.org/library/documents/planning-monitoring-and-evaluation-training-manual-higher-education-hivaids-and  

UNDP methodological publications,   http://www.undp.org/evaluation/  


World Bank has this 
Monitoring and Evaluation (M&E): Some Tools, Methods and Approaches   http://www.worldbank.org/ieg/ecd/tools/   pdf booklet, brief overview of various methods. From 2004
Logic Models

Guide 5: Define How a Program Will Work - The Logic Model   http://nnlm.gov/outreach/community/logicmodel.html   From the website:
A logic model is a planning tool to clarify and graphically display what your project intends to do and what it hopes to accomplish and impact.
    A logic model:
    Summarizes key program elements;
    Explains rationale behind program activities;
    Clarifies intended outcomes;
    Provides a communication tool


Logic models   http://www.uwex.edu/ces/pdande/evaluation/evallogicmodel.html   has templates, self study module, example charts


Logic model   http://www.cdc.gov/nccdphp/dnpao/hwi/programdesign/logic_model.htm   "Developing a logic model provides workforce health promotion (WHP) programs with something like a map—an idea of where the program is going, and a document to consult along the way."


Develop Programme Theory   http://betterevaluation.org/plan/define/develop_logic_model   from Better Evaluation. Nice easy to follow explanation of logic model.


Training guide for Logic Models   https://medicalreservecorps.gov/SearchFldr/SelfEvaluationTools   "A logic model is a visual representation of how your MRC unit works. It provides the logic for why you do what you do, and how your activities relate to the outcomes you are hoping to accomplish. It can take the form of a map, diagram, flow chart, or some other visual schematic that links program resources and activities to the desired results. The purpose of a logic model is to provide stakeholders (internal and external) with a road map that links the goals, objectives and strategies with the performance measures by specifying the resources and activities that are expected to lead to desired short- and long-term outcomes."


Using Logic Models for Program Development   http://edis.ifas.ufl.edu/wc041   "Logic models help us to think through our plans for the program. The reason logic models can help is that the process of developing a model forces us to make assumptions about how the program will work. A logic model also can help us communicate more clearly with our colleagues and peers about the internal workings of the program."


click here to return to methods page
last verified  4/23/2016
last updated 4/23/2016


Web Counters
stats counter