METHODS - on line books, manuals, guides to research methods and evaluation. 
   
Most of these sites describe social research methods, or evaluation methods, including survey methods, qualitative methods.   These are listed in 2 main sections: General Methods, and Evaluation.  Many of the evaluation guides are also general methods guides.  Each section is further subdivided into academic sites, government sites, or private organization or individual sites.  This organization is used because there are a lot of sites, and this was one way to organize them.  Within sections, site are listed in no particular order.

click here to return to main methods page

I General Research Methods sites

Academic sites


Susan Losh's home page    http://mailer.fsu.edu/~slosh//index.html    lists a class:
  research methods    http://mailer.fsu.edu/~slosh/MethodsGuide1.html     introduction to different methods, eg, surveys, focus groups, some less structured methods.


Lecture notes on research methods   http://www.apsu.edu/oconnort/3760/3760lects.htm   brief guide with links.
 

PPA 696 Research Methods  http://www.csulb.edu/~msaintg/ppa696/696menu.htm#PPA 696   very nice overview on different research methods.
 

Research Methods WWW tutorial    http://sociology.camden.rutgers.edu/jfm/tutorial/main.htm   tutorial on some basics of research methods.  Not yet complete.
 

Educational research lectures   http://www.southalabama.edu/coe/bset/johnson/dr_johnson/2lectures.htm      actually brief outlines of general methods, including qualitative, historical, statistical analysis, etc....  
 

Trochim, William M. The Research Methods Knowledge Base,   http://www.socialresearchmethods.net/kb/index.htm  . General research methods text, with chapters on topics such as survey construction, sampling, and a chapter on evaluation.  If its a method, its probably here.


On line research methods   http://www.geog.le.ac.uk/orm/site/home.htm   aimed at understanding how to do research on line.


Methods Used in Instructional Assessment and Evaluation    http://www.utexas.edu/academic/diia/assessment/iar/index.php    program evaluation section has a brief description and how to's for document analysis, experiments, focus groups, interviews, surveys.


Institute for Health and Work, Guide to Evaluating the Effectiveness of Strategies for Preventing Work Injuries   http://www.iwh.on.ca/evaluating-safety-programs   chapters on planning, designing, analysing, methods for exaluation.


Research methods   http://www2.uiah.fi/projects/metodi/   from the University of Art and Design Helsinki, kind of an introduction


Private organizations or people

s-cool sociology methods    http://www.s-cool.co.uk/alevel/sociology/methods.html   brief descriptions of different methods such as participant observation, experiments, sampling, comparative methods, and secondary data analysis. This is at s-cool,   http://www.s-cool.co.uk/    then click on A level methods, then sociology, then methods.


Methods for Social Researchers in Developing Countries   http://srmdc.net/   "This site has been prepared specifically for beginning researchers in developing countries."  Overview.

Government


Statistics: Power from data.   http://www.statcan.gc.ca/edu/power-pouvoir/toc-tdm/5214718-eng.htm   has sections describing data collection methods, questionnaires.

 

II: Evaluation: how to, approaches, manuals, guides
These also often include research methods as well.

Start here

Introduction to Evaluation   http://www.socialresearchmethods.net/kb/intreval.htm   covers basics such as definitions, types, eval questions and methods.


Introduction to Program Evaluation for Public Health Programs: A Self-Study Guide   http://www.cdc.gov/eval/whatsnew.htm   overview of most of evaluation.


Managing evaluations


The Program Manager's Guide to Evaluation    http://www.acf.hhs.gov/programs/opre/other_resrch/pm_guide_eval/reports/pmguide/pmguide_toc.html   topics include 'why evaluate your program', who should conduct, how to hire, and so on.

W.K. Kellogg Foundation Evaluation Handbook    http://www.wkkf.org/knowledge-center/Resources-Page.aspx    The Kellogg Foundation is an organization that gives grants, and this handbook is "written primarily for project directors who have direct responsibility for the ongoing evaluation of W.K. Kellogg Foundation-funded projects"  so a lot of it is an overview of evaluation, the processes involved, and of important considerations in making decisions about the evaluation process.  Not exactly a "how-to", but a comprehensive guide to decisions involved in the evaluation process. They keep changing the location of this book, so you may have to search.
 

The Programme Manager’s Planning, Monitoring and Evaluation Toolkit    http://www.unfpa.org/monitoring/toolkit.htm    "The toolkit is a supplement to the UNFPA programming guidelines. It provides guidance and options for UNFPA Country Office staff to improve planning, monitoring and evaluation (PM&E) activities in the context of results based programme management. It is also useful for programme managers at headquarters and for national programme managers and counterparts."  Hopefully useful to others as well.


Evaluation Guidelines   http://www.idrc.ca/en/ev-32492-201-1-DO_TOPIC.html   includes "Selecting and Managing an Evaluation Consultant or Team"  and a couple of other things about managing evaluation.


Academic sites
 

Manual and Handbooks   http://www.cpc.unc.edu/measure/publications/index.php   manuals on how to evaluation specific types of programs, such as national aids programs, and reproductive health programs. Some are listed on the manuals page, but also search for the type "manuals, handbooks and guides".
 

Evaluation handbook   http://www.ncela.gwu.edu/rcd/bibliography/BE020502   By Judith Wilde and Suzanne Sockey.  planning, designing, doing, reporting on evaluations.  Brief overviews of many many topics.

Richard A. Krueger's site   http://www.tc.umn.edu/~rkrueger/   has some brief guides for various topics about evaluation, such as strategies, logic models, but also tips about surveys, interviewing, observations, focus groups.
 

Evaluation cookbook    http://www.icbl.hw.ac.uk/ltdi/cookbook/contents.html    evaluation methods for lecturers, but some of the guides seem appropriate for everyone. The preparation page has some info on questionnaires, scaling, etc.


Power of Proof: An Evaluation Primer   http://www.ttac.org/power-of-proof/index.html   from Emory University, Rollins School of Public Health



Cooperative extension resources


Rutgers Cooperative Extension publications   http://njaes.rutgers.edu/pubs/subcategory.asp?cat=11&sub=70   lists the following publications, A Step-By-Step Guide to Developing Questionnaires and Survey Research Procedures for Program Evaluation & Research, Choosing a Data Collection Method for Survey Research, Maximizing Response Rate and Controlling Nonresponse Error in Survey Research, and Choosing Appropriate Research Methods to Evaluate Educational Programs. These are all short (2-3 page) pdf files.
    If above link doesn't work, try   http://njaes.rutgers.edu/pubs/default.asp   then click on Educational Design and Program Evaluation then Rutgers Cooperative Extension
 

Penn State  Program Evaluation Tip sheets   http://extension.psu.edu/evaluation/   a bunch of guides to many aspects.of program evaluation, including methods such as creating questionnaires, data collection methods, research design, sampling, etc.
 

Univ of Wisconsin Cooperative Extension publications   has this set of eval docs   http://www.uwex.edu/ces/pdande/evaluation/evaldocs.html    and these sections: Collecting and analyzing data   http://learningstore.uwex.edu/Collecting-Analyzing-Data-C237.aspx   and Designing evaluation   http://learningstore.uwex.edu/Designing-Evaluations-C238.aspx   

 
Program Evaluation Measurement Resource    http://www.ag.ohio-state.edu/~brick/dcc1pg.htm    from Michigan State University Department of Agricultural and Extension Education. Includes Introduction to Program Evaluation   http://www.ag.ohio-state.edu/~brick/suved2.htm   a brief overview of evalaution issues and methods.


Utah State University Extension   http://extnet.usu.edu/evaluate/   program planning, evaluation and reporting. Brief papers, presentations etc, on evaluation topics.



 

Government sites

From the UK

The Magenta Book: Guidance Notes on Policy Evaluation    http://www.nationalschool.gov.uk/policyhub/magenta_book/    from their site: "The Government Chief Social Researcher's Office has prepared this set of guidance notes on policy evaluation and analysis to help ‘intelligent customers’ and ‘intelligent providers’ determine what constitutes high quality work in the field on policy evaluation and analysis." This has info on what is evaluation and how to do it, eg, some notes on research methods.


Green Book, Appraisal and Evaluation in Central Government   http://www.hm-treasury.gov.uk/data_greenbook_index.htm   l "This new edition of the Green Book, Appraisal and Evaluation in Central Government, incorporates revised guidance, to encourage a more thorough, long-term and analytically robust approach to appraisal and evaluation. It is relevant to all appraisals and evaluations."


Guidebook to Evaluation   http://new.wales.gov.uk/topics/educationandskills/research-and-evaluation/guidetoevaluation/?lang=en   This guide "give a basic introduction to the process and purpose of evaluation" and "outline the steps that project or programme managers should go through in designing, briefing and using the results of an evaluation. "


From Canada

Guide to Project Evaluation: A Participatory Approach   http://www.phac-aspc.gc.ca/ncfv-cnivf/publications/fvprojevaluation-eng.php   some brief outlines of the steps to take in participatory evaluation.  This is all in one page. This site   http://www.phac-aspc.gc.ca/ph-sp/resources-ressources/guide/index-eng.php   has it in sections.
 

Canadian International Development Agency Evaluation   http://www.acdi-cida.gc.ca/CIDAWEB/acdicida.nsf/En/JUD-111795644-KJX   has evaluation guides and how to do evaluation.


PROGRAM EVALUATION METHODS: Measurement and Attribution of Program Results
  http://www.tbs-sct.gc.ca/eval/tools-outils_e.asp    from the Treasury Board of Canada. But this is from 1998.


Community Action Resources for Inuit, Métis and First Nations: Evaluating   http://www.hc-sc.gc.ca/fniah-spnia/pubs/services/_adp-apd/planning-planification/index-eng.php    Nice overview of purpose, process, methods. Also includes some info about the human aspects of evaluation (resistance, peoples feelings, etc.)


Evaluation Guidebook for Small Agencies   http://www.tbs-sct.gc.ca/eval/dev/sma-pet/guidelines/guidebook_e.asp   from the Treasury Board of Canada.  Not exactly a how to do it, more of a how to manage, introduction. The website says "This guidebook is designed for small agencies that require assistance in implementing the Treasury Board of Canada (TB) Evaluation Policy requirements."



From the USA
  

National Science Foundation:  has three reports available on line:
   User-Friendly Handbook for Mixed Method Evaluations     http://www.nsf.gov/publications/pub_summ.jsp?ods_key=nsf97153  
   The User-Friendly Handbook for Project Evaluation       http://www.nsf.gov/pubs/2002/nsf02057/start.htm  
   Footprints: Strategies for Non-Traditional Program Evaluation     http://www.nsf.gov/publications/pub_summ.jsp?ods_key=nsf9541


An Evaluation Primer   http://www.atsdr.cdc.gov/HEC/evalprmr.html    This is actually a primer on Health Risk Communication Programs and Outcomes, but it also has info useful for other evaluators.
 

CDC Evaluation Working Group http://www.cdc.gov/eval/index.htm  This site is about the CDC Evaluation Working Group and its efforts to promote program evaluation at the CDC and throughout the public health system.  See especially their "highlights of a framework for program evaluation", and their links page which is a really comprehensive list of links.  Their categories include Ethics, Principles and Standards, Organizations, Societies, Foundations, Associations, Journals and On-Line Publications, Step-by-Step Manuals, Logic Model Resources, Planning and Performance Improvement Tools.

CDC also has these
*   Demonstrating your programs worth: A Primer on Evaluation for Programs to Prevent Unintentional Injury   http://www.cdc.gov/ncipc/pub-res/dypw/Index.htm   very brief overview of many different methods, and some general info on evaluation.
*   Introduction to program evaluation for public health programs: A self-study guide.   http://www.cdc.gov/eval/framework.htm#formats    some more basics
*   Introduction to Program Evaluation for Comprehensive Tobacco Control Programs   http://www.cdc.gov/tobacco/tobacco_control_programs/surveillance_evaluation/evaluation_manual/index.htm   another general methods guide.
*   Evaluation Primer on Health Risk Communication Programs   http://www.atsdr.cdc.gov/risk/evalprimer/index.html   another general methods guide, with chapters on the usual topics, design, planning, methods, types of evaluation
*   Program evaluation manuals   http://www.cdc.gov/tb/programs/Evaluation/default.htm   several listed here
*   Evaluation manual, an introduction   http://www.cdc.gov/getsmart/program-planner/Introduction.html   about anti biotics


Measuring the Difference: Guide to Planning and Evaluating Health Information Outreach    http://nnlm.gov/evaluation/guide/    you can also order single copies for free at  http://nnlm.gov/evaluation/

 
US Department of Education Institute of Educational Sciences  http://www2.ed.gov/about/offices/list/ies/index.html   has a link to the evaluation center   http://ies.ed.gov/ncee/  which lists this guide on the publications page "Identifying and Implementing Educational Practices Supported By Rigorous Evidence: A User Friendly Guide". The Dept of Ed says "NCEE has issued a new guide on evidence based education, titled "Identifying and Implementing Educational Practices Supported by Rigorous Evidence." This guide offers tools to educational practitioners that help distinguish practices supported by rigorous evidence from those that are not." This is mainly about randomized control trials.

Also see these related publications:
"Random Assignment in Program Evaluation and Intervention Research: Questions and Answers"
"Technical Methods Report: Statistical Power for Regression Discontinuity Designs in Education Evaluations"
    The American Evaluation Association also has a page linking to comments about the Dept of Ed guide  http://www.eval.org/doepage.htm

These are old or archived  Dept of Ed documents:

Evaluation Primer   http://www2.ed.gov/offices/OUS/PES/primer1.html   The way to better prevention programs.  Some overivew sections of evaluation. This page is the overview, and links to the full guide.
 
Evaluation frequently asked questions   http://www2.ed.gov/offices/OUS/PES/eval_faq.html   some basic answers to faqs about evaluation in general and specific methods.
 

National Highway Traffic Safety Administration has produced a booklet entitled "Community How To Guides On, " which covers several topics, including evaluation.   http://www.nhtsa.dot.gov/people/injury/alcohol/community%20guides%20html/Book3_Evaluation.html

Pink Book-Making Health Communication Programs Work   http://www.cancer.gov/pinkbook   has a chapter on evaluation (stage 4) and a chapter on research methods.


Talking quality   http://www.talkingquality.gov/docs/section5/default.htm   this section has
       Evaluating the Results of Your Project   http://www.talkingquality.gov/docs/section5/5_2.htm   overview of evaluation process.
       Techniques for Testing and Evaluation   http://www.talkingquality.gov/docs/section5/5_3.htm   brief overview of different methods.




From Australia

Planning and Evaluation Wizard    http://som.flinders.edu.au/FUSA/SACHRU/PEW/index.htm   see the evaluation zone


From Europe

Evaluation Guides   http://ec.europa.eu/regional_policy/sources/docgener/evaluation/evalsed/guide/index_en.htm   from the European Commission. Some parts of this are general guides to evaluation.


Evaluation Website of the Directorates-General Development, External Relations and EuropeAid  http://ec.europa.eu/europeaid/how/evaluation/index_en.htm   has a methodology section, and overviews of evaluation tools.



Private organizations or people


Impact Evaluation: Methodological and Operational Issues   http://www.adb.org/Documents/Handbooks/Impact-Analysis/default.asp   "This quick reference provides an overview of methods available for evaluating impacts of development programs, and addresses some common operational concerns about their practical application."  From the Asian Development Bank.


A Guide to Evaluation Primers
   http://www.rwjf.org/pr/product.jsp?id=18657   A review by Robert Wood Johnson Foundation of several evaluation guides, who should use them, how easy to use, etc.


Basic Guide to Program Evaluation
  http://www.managementhelp.org/evaluatn/fnl_eval.htm   Written by Carter McNamara, PhD, this is an on line guide to program evaluation, which describes many of the methods used, for example, surveys, interviewing, focus groups, and other methods.  This site also has many useful links.  


Evaluation Unit   http://www.idrc.ca/en/ev-26266-201-1-DO_TOPIC.html   International Development Research Center has various publications, guidelines, other useful stuff.

Taking Stock: A Practical Guide to Evaluating Your Own Programs  http://www.horizon-research.com/reports/   This is their publications list page.  "Taking Stock" is listed on this page, at http://www.horizon-research.com/reports/1997/taking_stock.php   This is from Horizon Research, Inc., a private research firm.  The guide is an overview of four steps in evaluation: framing the evaluation, defining goals and objectives, finding evidence, making sense of the evidence.
 

The Snyder evaluation process   http://www.uq.net.au/action_research/arp/snyder.html   "To understand, to improve, to continue improving...  these are the goals addressed by the evaluation process described in this document.  The vehicles for doing this are a systems model of a project or organisation, and a three-stage process of process evaluation, outcome evaluation, and short-cycle evaluation."
 

Evaluating Comprehensive Community Change  http://www.aecf.org/KnowledgeCenter.aspx  and then search for "evaluating comprehensive community change" or some of those words.  The book is mainly about approach to evaluations, with some discussion of issues of data collection and use. 
 

IFAD Evaluation   http://www.ifad.org/evaluation/index.htm    Includes a new evaluation manual on methods and issues   http://www.ifad.org/evaluation/process_methodology/index.htm   April 2009.


Challenges in Program Evaluation of Health Interventions in Developing Countries. Barbara O. Wynn, Arindam Dutta, Martha I. Nelson   http://www.rand.org/pubs/monographs/MG402/   The authors provide an overview of various approaches, methodologies, and issues related to program evaluation for health projects in developing countries
 

Pathfinder International has these guides    http://www.pathfind.org/site/PageServer?pagename=Pubs_MandE_Guides   such as guides on evaluating health programs, and doing surveys.

Some of the guides are also listed here   http://www.fhi.org/en/Youth/YouthNet/Publications/Focus/ToolsGuides/index.htm   in chapters, and this book has methods chapters   http://www.fhi.org/en/HIVAIDS/pub/Archive/evalchap/index.htm   chapters 8 to 13.


Evaluating Programs for HIV/AIDS Prevention and Care in Developing Countries   http://www.fhi.org/en/HIVAIDS/pub/Archive/evalchap/index.htm    Specific for HIV research but has general chapters such as Uses of Behavioral Data for Program Evaluation, Indicators and Questionnaires for Behavioral Surveys, and  Assessing the Validity and Reliability of Self-Reported Behavioral Data.


Evaluation Primer  http://www.cadca.org/resources/detail/evaluation-primer   overview of methods etc.  Also listed here   http://www.cadca.org/resources/series/Primers   along with some other primers. I think this organization is sponsored by the US govt.


Evaluation toolkit   http://www.evaluationtrust.org/tools/   Overview on many topics about evaluation, how to pick a consultant, how to observe, etc.


A Participatory Model for Evaluating Social Programs  http://www.irvine.org/evaluation/tools-and-resources  Part case study and part instruction guide.  Plus a couple of other evaluation guides.


UNESCOs Evaluation Manual   http://portal.unesco.org/en/ev.php-URL_ID=24425&URL_DO=DO_TOPIC&URL_SECTION=201.html   has overview of evaluation, guide to surveys and to interviewing.
 

UNDP methodological publications,   http://www.undp.org/evaluation/   and a guidance page   http://www.undp.org/evaluation/methodologies.htm  

and



Impact Evaluation  http://web.worldbank.org/WBSITE/EXTERNAL/TOPICS/EXTPOVERTY/EXTISPMA/0,,menuPK:384339~pagePK:162100~piPK:159310~theSitePK:384329,00.html   explains a lot and has key readings, links to their methods page

Also worldbank has this 
Monitoring and Evaluation (M&E): Some Tools, Methods and Approaches   http://www.worldbank.org/ieg/ecd/tools/   pdf booklet, brief overview of various methods.



World Food Program Monitoring and Evaluation Guidelines   http://www.wfp.org/operations/evaluation/guidelines.asp   various booklets like "How to plan an evaluation" and "How to manage an evaluation and disseminate its results"


click here to return to methods page
last verified  1/23/10
last updated 1/23/10