METHODS - on line books, manuals, guides to research methods and evaluation. 
   
Most of these sites describe social research methods, or evaluation methods, including survey methods, qualitative methods.   These are listed in 2 main sections: General Methods, and Evaluation.  Many of the evaluation guides are also general methods guides.  Each section is further subdivided into academic sites, government sites, or private organization or individual sites.  This organization is used because there are a lot of sites, and this was one way to organize them.  Within sections, site are listed in no particular order.

click here to return to main methods page

I General Research Methods sites

Academic sites


Susan Losh's home page   http://mailer.fsu.edu/~slosh/   lists a class:
  research methods    http://mailer.fsu.edu/~slosh/MethodsGuide1.html     introduction to different methods, eg, surveys, focus groups, some less structured methods.


Lecture notes on research methods   http://www.drtomoconnor.com/3760/default.htm   brief guide with links.
 

PPA 696 Research Methods  http://www.csulb.edu/~msaintg/ppa696/696menu.htm#PPA 696   very nice overview on different research methods.
 

Research Methods WWW tutorial    http://sociology.camden.rutgers.edu/jfm/tutorial/main.htm   tutorial on some basics of research methods.  Not yet complete.
 

Educational research lectures   http://www.southalabama.edu/coe/bset/johnson/dr_johnson/2lectures.htm      actually brief outlines of general methods, including qualitative, historical, statistical analysis, etc....  
 

Trochim, William M. The Research Methods Knowledge Base,   http://www.socialresearchmethods.net/kb/index.htm  . General research methods text, with chapters on topics such as survey construction, sampling, and a chapter on evaluation.  If its a method, its probably here.


On line research methods   http://www.geog.le.ac.uk/orm/site/home.htm   aimed at understanding how to do research on line.


Methods Used in Instructional Assessment and Evaluation   http://www.utexas.edu/academic/ctl/assessment/iar/index.php    program evaluation section has a brief description and how to's for document analysis, experiments, focus groups, interviews, surveys.


Institute for Health and Work, Guide to Evaluating the Effectiveness of Strategies for Preventing Work Injuries   http://www.iwh.on.ca/evaluating-safety-programs   chapters on planning, designing, analysing, methods for exaluation.


Research methods   http://www2.uiah.fi/projects/metodi/   from the University of Art and Design Helsinki, kind of an introduction


Private organizations or people

s-cool sociology methods    http://www.s-cool.co.uk/alevel/sociology/methods.html   brief descriptions of different methods such as participant observation, experiments, sampling, comparative methods, and secondary data analysis. This is at s-cool,   http://www.s-cool.co.uk/    then click on A level methods, then sociology, then methods.


Methods for Social Researchers in Developing Countries   http://srmdc.net/   "This site has been prepared specifically for beginning researchers in developing countries."  Overview.

Government


Statistics: Power from data.   http://www.statcan.gc.ca/edu/power-pouvoir/toc-tdm/5214718-eng.htm   has sections describing data collection methods, questionnaires.


How to get customer feedback   https://www.howto.gov/customer-service/how-to-collect-customer-feedback   brief but instructive

 

II: Evaluation: how to, approaches, manuals, guides
These also often include research methods as well.

Start here

Introduction to Evaluation   http://www.socialresearchmethods.net/kb/intreval.htm   covers basics such as definitions, types, eval questions and methods.


Evaluation Manual  http://www.cdc.gov/getsmart/specific-groups/program-planner.html   overview of most of evaluation.


Managing evaluations


The Program Manager's Guide to Evaluation    http://www.acf.hhs.gov/programs/opre/other_resrch/pm_guide_eval/reports/pmguide/pmguide_toc.html   topics include 'why evaluate your program', who should conduct, how to hire, and so on.

W.K. Kellogg Foundation Evaluation Handbook   http://www.wkkf.org/   The Kellogg Foundation is an organization that gives grants, and this handbook is "written primarily for project directors who have direct responsibility for the ongoing evaluation of W.K. Kellogg Foundation-funded projects"  so a lot of it is an overview of evaluation, the processes involved, and of important considerations in making decisions about the evaluation process.  Not exactly a "how-to", but a comprehensive guide to decisions involved in the evaluation process. They keep changing the location of this book, so I don't list the specific url. Do a search for 'Evaluation Handbook'.
 

The Programme Manager’s Planning, Monitoring and Evaluation Toolkit    http://www.unfpa.org/monitoring/toolkit.htm    "The toolkit is a supplement to the UNFPA programming guidelines. It provides guidance and options for UNFPA Country Office staff to improve planning, monitoring and evaluation (PM&E) activities in the context of results based programme management. It is also useful for programme managers at headquarters and for national programme managers and counterparts."  Hopefully useful to others as well.


The evaluation process   http://www.evaluationbaron.com/6-step-process.php   from Evaluation Baron. A very brief overview of what to expect in the evaluation process.


Making evaluations matter: A practical guide for evaluators.   http://www.cdi.wur.nl/UK/resources/Publications/   by Cecile Kusters with Simone van Vugt, Seerp Wigboldus, Bob Williams and Jim Woodhill. Published from Centre for Development Innovation, Wageningen University & Research centre, Wageningen, The Netherlands.


Academic sites
 

Manual and Handbooks   http://www.cpc.unc.edu/measure/publications/   manuals on how to evaluation specific types of programs, such as national aids programs, and reproductive health programs. Some are listed on the manuals page, but also search for the type "manuals, handbooks and guides".
 

Evaluation handbook   http://www.ncela.gwu.edu/rcd/bibliography/BE020502   By Judith Wilde and Suzanne Sockey.  planning, designing, doing, reporting on evaluations.  Brief overviews of many many topics.

Richard A. Krueger's site   http://www.tc.umn.edu/~rkrueger/   has some brief guides for various topics about evaluation, such as strategies, logic models, but also tips about surveys, interviewing, observations, focus groups.
 

Evaluation cookbook    http://www.icbl.hw.ac.uk/ltdi/cookbook/contents.html    evaluation methods for lecturers, but some of the guides seem appropriate for everyone. The preparation page has some info on questionnaires, scaling, etc.


Power of Proof: An Evaluation Primer   http://www.ttac.org/services/power-of-proof/index.html   from Emory University, Rollins School of Public Health


The Center for Program Evaluation and Research   http://programeval.ucdavis.edu/index.php   has some nice pamphlets and videos. See the File Cabinet, then Evaluation Tools, or Past Webinars


Monitoring and Evaluation: How and How Well Objectives are Being Reached   http://cec.vcn.bc.ca/cmp/modules/mon-int.htm   Phil Bartle, PhD. Written for community empowerment.



Cooperative extension resources


Rutgers Cooperative Extension publications   http://njaes.rutgers.edu/pubs/subcategory.asp?cat=11&sub=70   lists the following publications, A Step-By-Step Guide to Developing Questionnaires and Survey Research Procedures for Program Evaluation & Research, Choosing a Data Collection Method for Survey Research, Maximizing Response Rate and Controlling Nonresponse Error in Survey Research, and Choosing Appropriate Research Methods to Evaluate Educational Programs. These are all short (2-3 page) pdf files.
    If above link doesn't work, try   http://njaes.rutgers.edu/pubs/default.asp   then click on Educational Design and Program Evaluation then Rutgers Cooperative Extension
 

Penn State  Program Evaluation Tip sheets   http://extension.psu.edu/evaluation/   a bunch of guides to many aspects.of program evaluation, including methods such as creating questionnaires, data collection methods, research design, sampling, etc.
 

Univ of Wisconsin Cooperative Extension publications   has this set of eval docs   http://www.uwex.edu/ces/pdande/evaluation/evaldocs.html    and these sections: Collecting and analyzing data   http://learningstore.uwex.edu/Collecting-Analyzing-Data-C237.aspx   and Designing evaluation   http://learningstore.uwex.edu/Designing-Evaluations-C238.aspx   

 
Program Evaluation Measurement Resource    http://www.ag.ohio-state.edu/~brick/dcc1pg.htm    from Michigan State University Department of Agricultural and Extension Education. Includes Introduction to Program Evaluation   http://www.ag.ohio-state.edu/~brick/suved2.htm   a brief overview of evalaution issues and methods.

 

Government sites

From the UK

The Magenta Book: Guidance Notes on Policy Evaluation    http://www.nationalschool.gov.uk/policyhub/magenta_book/    from their site: "The Government Chief Social Researcher's Office has prepared this set of guidance notes on policy evaluation and analysis to help ‘intelligent customers’ and ‘intelligent providers’ determine what constitutes high quality work in the field on policy evaluation and analysis." This has info on what is evaluation and how to do it, eg, some notes on research methods.


Green Book, Appraisal and Evaluation in Central Government   http://www.hm-treasury.gov.uk/data_greenbook_index.htm   l "This new edition of the Green Book, Appraisal and Evaluation in Central Government, incorporates revised guidance, to encourage a more thorough, long-term and analytically robust approach to appraisal and evaluation. It is relevant to all appraisals and evaluations."



From Canada

Guide to Project Evaluation: A Participatory Approach  http://www.phac-aspc.gc.ca/ph-sp/resources-ressources/guide/index-eng.php   some brief outlines of the steps to take in participatory evaluation. 
 

Canadian International Development Agency Evaluation   http://www.acdi-cida.gc.ca/acdi-cida/ACDI-CIDA.nsf/eng/JUD-111795644-KJX   has evaluation guides and how to do evaluation.


PROGRAM EVALUATION METHODS: Measurement and Attribution of Program Results
  http://www.tbs-sct.gc.ca/eval/tools-outils_e.asp    from the Treasury Board of Canada. But this is from 1998.


Community Action Resources for Inuit, Métis and First Nations: Evaluating   http://www.hc-sc.gc.ca/fniah-spnia/pubs/services/_adp-apd/planning-planification/index-eng.php    Nice overview of purpose, process, methods. Also includes some info about the human aspects of evaluation (resistance, peoples feelings, etc.)


Evaluation Guidebook for Small Agencies   http://www.tbs-sct.gc.ca/eval/dev/sma-pet/guidelines/guidebook_e.asp   from the Treasury Board of Canada.  Not exactly a how to do it, more of a how to manage, introduction. The website says "This guidebook is designed for small agencies that require assistance in implementing the Treasury Board of Canada (TB) Evaluation Policy requirements."



From the USA
  

National Science Foundation:  has three reports available on line:
   User-Friendly Handbook for Mixed Method Evaluations     http://www.nsf.gov/publications/pub_summ.jsp?ods_key=nsf97153  
   The User-Friendly Handbook for Project Evaluation       http://www.nsf.gov/pubs/2002/nsf02057/start.htm  
   Footprints: Strategies for Non-Traditional Program Evaluation     http://www.nsf.gov/publications/pub_summ.jsp?ods_key=nsf9541


An Evaluation Primer   http://www.atsdr.cdc.gov/HEC/evalprmr.html    This is actually a primer on Health Risk Communication Programs and Outcomes, but it also has info useful for other evaluators.
 

CDC Evaluation Working Group http://www.cdc.gov/eval/index.htm  This site is about the CDC Evaluation Working Group and its efforts to promote program evaluation at the CDC and throughout the public health system.  See especially their "highlights of a framework for program evaluation", and their links page which is a really comprehensive list of links.  Their categories include Ethics, Principles and Standards, Organizations, Societies, Foundations, Associations, Journals and On-Line Publications, Step-by-Step Manuals, Logic Model Resources, Planning and Performance Improvement Tools.

CDC also has these
*   Demonstrating your programs worth: A Primer on Evaluation for Programs to Prevent Unintentional Injury   http://www.cdc.gov/ncipc/pub-res/dypw/Index.htm   very brief overview of many different methods, and some general info on evaluation.
*   Introduction to program evaluation for public health programs: A self-study guide.   http://www.cdc.gov/eval/framework.htm#formats    some more basics
*   Introduction to Program Evaluation for Comprehensive Tobacco Control Programs   http://www.cdc.gov/tobacco/tobacco_control_programs/surveillance_evaluation/evaluation_manual/index.htm   another general methods guide.
*   Evaluation Primer on Health Risk Communication Programs   http://www.atsdr.cdc.gov/risk/evalprimer/index.html   another general methods guide, with chapters on the usual topics, design, planning, methods, types of evaluation
*   Program evaluation manuals   http://www.cdc.gov/tb/programs/Evaluation/default.htm   several listed here
*   Evaluation manual, an introduction   http://www.cdc.gov/getsmart/program-planner/Introduction.html   about anti biotics
*   Evaluation Briefs   http://www.cdc.gov/healthyyouth/evaluation/resources.htm   bunch of small guides to specific topics on evaluation


Measuring the Difference: Guide to Planning and Evaluating Health Information Outreach    http://nnlm.gov/evaluation/guide/    you can also order single copies for free at  http://nnlm.gov/evaluation/

 
US Department of Education Institute of Educational Sciences  http://www2.ed.gov/about/offices/list/ies/index.html   has a link to the evaluation center   http://ies.ed.gov/ncee/  which lists this guide on the publications page "Identifying and Implementing Educational Practices Supported By Rigorous Evidence: A User Friendly Guide". The Dept of Ed says "NCEE has issued a new guide on evidence based education, titled "Identifying and Implementing Educational Practices Supported by Rigorous Evidence." This guide offers tools to educational practitioners that help distinguish practices supported by rigorous evidence from those that are not." This is mainly about randomized control trials.

Also see these related publications:
"Random Assignment in Program Evaluation and Intervention Research: Questions and Answers"
"Technical Methods Report: Statistical Power for Regression Discontinuity Designs in Education Evaluations"
   

These are old or archived  Dept of Ed documents:

Evaluation Primer   http://www2.ed.gov/offices/OUS/PES/primer1.html   The way to better prevention programs.  Some overivew sections of evaluation. This page is the overview, and links to the full guide.
 
Evaluation frequently asked questions   http://www2.ed.gov/offices/OUS/PES/eval_faq.html   some basic answers to faqs about evaluation in general and specific methods.
 

National Highway Traffic Safety Administration has produced a booklet entitled "Community How To Guides On, " which covers several topics, including evaluation.  
http://www.nhtsa.gov/people/injury/alcohol/community%20guides%20html/Book3_Evaluation.html    


Pink Book-Making Health Communication Programs Work   http://www.cancer.gov/pinkbook   has a chapter on evaluation (stage 4) and a chapter on research methods.


Talking quality   https://www.talkingquality.ahrq.gov/default.aspx    has a section on assessing the project   https://www.talkingquality.ahrq.gov/content/assess/default.aspx     
Has info on assessing or evaluating the process and results, methods, and management of evaluation.



From Australia

Planning and Evaluation Wizard    http://som.flinders.edu.au/FUSA/SACHRU/PEW/index.htm   see the evaluation zone


From Europe

Evaluation Guides   http://ec.europa.eu/regional_policy/sources/docgener/evaluation/evalsed/guide/index_en.htm   from the European Commission. Some parts of this are general guides to evaluation.


Evaluation Website of the Directorates-General Development, External Relations and EuropeAid  http://ec.europa.eu/europeaid/how/evaluation/index_en.htm   has a methodology section, and overviews of evaluation tools.



Private organizations or people


Impact Evaluation: Methodological and Operational Issues   http://www.adb.org/Documents/Handbooks/Impact-Analysis/default.asp   "This quick reference provides an overview of methods available for evaluating impacts of development programs, and addresses some common operational concerns about their practical application."  From the Asian Development Bank.


A Guide to Evaluation Primers   http://www.rwjf.org/pr/product.jsp?id=18657   A review by Robert Wood Johnson Foundation of several evaluation guides, who should use them, how easy to use, etc.


Basic Guide to Program Evaluation   http://managementhelp.org/evaluation/program-evaluation-guide.htm   Written by Carter McNamara, PhD, this is an on line guide to program evaluation, which describes many of the methods used, for example, surveys, interviewing, focus groups, and other methods.  This site also has many useful links.  


Evaluation Capacity Development Group has this   http://www.ecdg.net/products.htm    ECDG Evaluation Guidebook for the Arts, useful in other areas too, as a general guide.


Evaluation Unit   http://www.idrc.ca/EN/Programs/Evaluation/Pages/default.aspx   International Development Research Center has various publications, guidelines, other useful stuff.


Taking Stock: A Practical Guide to Evaluating Your Own Programs is listed on this page, at  http://www.horizon-research.com/reports/1997/taking_stock.php   This is from Horizon Research, Inc., a private research firm.  The guide is an overview of four steps in evaluation: framing the evaluation, defining goals and objectives, finding evidence, making sense of the evidence.
 

Evaluating Comprehensive Community Change  http://www.aecf.org/KnowledgeCenter.aspx  and then search for "evaluating comprehensive community change" or some of those words.  The book is mainly about approach to evaluations, with some discussion of issues of data collection and use. 
 

IFAD Evaluation   http://www.ifad.org/evaluation/index.htm    Includes a new evaluation manual on methods and issues   http://www.ifad.org/evaluation/process_methodology/index.htm   April 2009.


Challenges in Program Evaluation of Health Interventions in Developing Countries. Barbara O. Wynn, Arindam Dutta, Martha I. Nelson   http://www.rand.org/pubs/monographs/MG402/   The authors provide an overview of various approaches, methodologies, and issues related to program evaluation for health projects in developing countries
 

Pathfinder International has these guides    http://www.pathfind.org/site/PageServer?pagename=Pubs_MandE_Guides   such as guides on evaluating health programs, and doing surveys.


Some of the guides are also listed here   http://www.fhi.org/en/Youth/YouthNet/Publications/Focus/ToolsGuides/index.htm   in chapters, and this book has methods chapters   http://www.fhi.org/en/HIVAIDS/pub/Archive/evalchap/index.htm   chapters 8 to 13.


Evaluating Programs for HIV/AIDS Prevention and Care in Developing Countries   http://www.fhi.org/en/HIVAIDS/pub/Archive/evalchap/index.htm    Specific for HIV research but has general chapters such as Uses of Behavioral Data for Program Evaluation, Indicators and Questionnaires for Behavioral Surveys, and  Assessing the Validity and Reliability of Self-Reported Behavioral Data.


Evaluation Primer  http://www.cadca.org/resources/detail/evaluation-primer   overview of methods etc.  Also listed here   http://www.cadca.org/resources/series/Primers   along with some other primers. I think this organization is sponsored by the US govt.


Evaluation toolkit   http://www.evaluationtrust.org/tools/   Overview on many topics about evaluation, how to pick a consultant, how to observe, etc.


A Participatory Model for Evaluating Social Programs  http://www.irvine.org/evaluation/tools-and-resources  Part case study and part instruction guide.  Plus a couple of other evaluation guides.


Getting Started with Program Evaluation. A Guide for Arts Organizations   http://www.nasaa-arts.org/Members/Evaluation_Guide.pdf   from the National Assembly of State Arts Agencies


Program evaluation   http://www.nmac.org/pdf/program%20evalution.pdf   a guidebook from the National Minority AIDS Council.


UNESCOs Evaluation Manual   http://portal.unesco.org/en/ev.php-URL_ID=24425&URL_DO=DO_TOPIC&URL_SECTION=201.html   has overview of evaluation, guide to surveys and to interviewing.
 

UNDP methodological publications,   http://www.undp.org/evaluation/   and a guidance page   http://www.undp.org/evaluation/methodologies.htm  

and



Impact Evaluation  http://web.worldbank.org/WBSITE/EXTERNAL/TOPICS/EXTPOVERTY/EXTISPMA/0,,menuPK:384339~pagePK:162100~piPK:159310~theSitePK:384329,00.html   explains a lot and has key readings, links to their methods page

Also worldbank has this 
Monitoring and Evaluation (M&E): Some Tools, Methods and Approaches   http://www.worldbank.org/ieg/ecd/tools/   pdf booklet, brief overview of various methods.



World Food Program Monitoring and Evaluation Guidelines   http://www.wfp.org/operations/evaluation/guidelines.asp   various booklets like "How to plan an evaluation" and "How to manage an evaluation and disseminate its results"


click here to return to methods page
last verified  9/26/11
last updated 9/26/11