Statistics and Design


click here to return to methods page

Evaluators should know statistics, to analyze program data, for example, and also design.  These are just a few of the available links. First, here are links about doing statistical analysis. The second section shows links on research design.

Statistics books, guides

HyperStat  http://davidmlane.com/hyperstat/index.html   HyperStat Online is an introductory-level hypertext statistics book.  Also comprehensive links to other on line stat books and links to some stat jokes.
 

Statistics at square one   http://resources.bmj.com/bmj/readers/statistics-at-square-one/statistics-at-square-one    From BMJ, an on line brief stat text, from 1997.  Also see Epidemiology for the uninitiated   http://resources.bmj.com/bmj/readers/epidemiology-for-the-uninitiated/epidemiology-for-the-uninitiated-fourth-edition  

 
Electronic Textbook   http://www.statsoft.com/textbook/   Complete on line statistics text book, with many advanced topics.
  

PA 765 Statnotes: An Online Textbook, by G. David Garson   http://faculty.chass.ncsu.edu/garson/PA765/statnote.htm   On line stats book, but with chapters on evaluation, surveys, sampling, some theoretical frameworks.
 

Statistics: power from data   http://www.statcan.gc.ca/edu/power-pouvoir/toc-tdm/5214718-eng.htm   general on line stat book with chapters about data collection, processing, problems, presenting, analyzing.


Just Plain Data Analysis   http://lilt.ilstu.edu/jpda/   companion to published book, but still has lots of info.


Susan Losh's home page   http://mailer.fsu.edu/~slosh/   links to her classes
Intro statistics and data analysis  http://mailer.fsu.edu/~slosh/IntroStatsGuide1.html   some basic notes on making tables, univariate, bivariate and regression analysis.
Multivariate analysis of categorical data   http://mailer.fsu.edu/~slosh/CatDataOverview.html  
 

Timeweb    http://www.bized.co.uk/timeweb/index.htm   sort of an on line stat text.  Main topics include sections on: Digging for data. Where can you find it? What does it mean, etc?;  Crunching or processing the data; and Polishing or finishing the data.
 

A New View of Statistics   http://www.sportsci.org/resource/stats/contents.html   all the usual topics, but pretty comprehensive.   Another version is here,   http://www.sportsci.org/resource/stats/index.html   showing a table of contents on a left panel.

Statistical Good Practice Guidelines - Overview   http://www.reading.ac.uk/ssc/publications/guides.html    Several booklets are available from this site, including Concepts Underlying The Design of Experiments , Confidence and Significance: Key Concepts of Inferential Statistics , Modern Approaches to the Analysis of Experimental Data and Modern Methods of Analysis   They are geared toward agricultural research but seem useful for any social scientist. 
  

Betty Jung's Statistics page   http://www.bettycjung.net/Statsites.htm     has links to many stat notes, such as
Stat Primer    http://www.sjsu.edu/faculty/gerstman/StatPrimer/    an on line public domain stat manual.


The Little Handbook of Statistical Practice   http://www.tufts.edu/~gdallal/LHSP.HTM   basic stats to anova and regression.
 

Steve's Attempt to teach statistics   http://www.childrens-mercy.org/stats/   Has a short list of topics, which are useful, and also see Training opportunities at Children's Mercy Hospital for some class notes.

 
SticiGui: Statistics Tools for Internet and Classroom Instruction with a Graphical User Interface   http://www.stat.berkeley.edu/users/stark/SticiGui/   includes a text book on basics and advanced basics.


The North Carolina Center for Public Health Preparedness Training Website  http://cphp.sph.unc.edu/training/index.php   has free on line training for biostatistics, epidemiology, other topics.

Experimental design   http://www.authorstream.com/User-Presentations/physioactive/   on line lecture slide show. By Chee-Wee Tan. See the show called week 2 experimental design.


Understanding Descriptive Statistics   http://www.nationalatlas.gov/articles/mapping/a_statistics.html   just some basic concepts.


CADDIS Volume 4: Data Analysis   http://www.epa.gov/caddis/da_tropo.html   basic concepts, of basic stat and some advanced stat too.


Handbook of biological statistics   http://udel.edu/~mcdonald/statintro.html   for biology but much is applicable to any field.



Specific topics or lists of links
click here to return to methods page
 

Methods for evaluating area-wide and organisation-based interventions in health and health care: a systematic review 1999.   http://www.hta.ac.uk/execsumm/summ305.htm   This report describes a systematic review of methods for evaluating cluster-based interventions.  It also evaluates existing practice in healthcare evaluation.  It is also a handbook for design.
 


Free Statistical Tools on the Web http://gsociology.icaap.org/methods/statontheweb.html    brief review of free statistical resources.  A short version of this article first appeared in the International Statistical Association newsletter, Vol 26, Number 1 (76),  2002, and is at   http://isi.cbs.nl/NLet/NLet021-04.htm   and    http://isi.cbs.nl/FreeTools.htm 


A Literature Review of the Use of Random Assignment Methodology in Evaluations of US Social Policy Programmes   http://statistics.dwp.gov.uk/asd/asd5/ih-index.asp   In house report #94


Safety Science Monitor, Guide to Evaluating the Effectiveness of Strategies for Preventing Work Injuries   http://ssmon.chb.kth.se/safebk.php   See chapters 3 and 4 on design.


Tom Knapp's page   http://www.tomswebpage.net/   papers and manuscripts for books on various statistical topics, including percentages, statistical testing, reliability. These books explain the topics.

 

Design, validity, Randomized Control Trials (RCT)
click here to return to methods page

See our pamphlet on experimental design   http://gsociology.icaap.org/methods/BasicguidesHandouts.html   establishing cause


Statsoft has a chapter on experimental design   http://www.statsoft.com/textbook/  


Research Methods Knowledge Base, chapter on design  http://www.socialresearchmethods.net/kb/design.htm


Allpsych on line texts   http://allpsych.com/onlinetexts.html   the research methods text is mainly about design. Also has an on line text on stats. For example, this    http://allpsych.com/researchmethods/quasiexperimentaldesign.html   is a brief overview of quasi experimental design.


Government of Canada Human Resources lists this:  http://www.hrsdc.gc.ca/eng/cs/sp/sdc/evaluation/sp-ah053e/page00.shtml   Quasi-Experimental Evaluation  


Statnotes  http://faculty.chass.ncsu.edu/garson/PA765/design.htm   has this brief overview.


Threat to validity   http://psych.athabascau.ca/html/Validity/   overview of threats to validity. See part 1.


Research Design Lessons   http://core.ecu.edu/psyc/wuenschk/DesignLessons.htm   lectures in word.


This Research Methods class   http://www.csulb.edu/~msaintg/ppa696/696menu.htm   has chapters on experimental and quasi experimental design


Johnson's educational research  book   http://www.southalabama.edu/coe/bset/johnson/dr_johnson/2lectures.htm   has chapters (9 and 10) that cover experimental and quasi experimental design. These chapters are fairly detailed.


Resources to design and carry out rigorous evaluations.   http://www.evidencebasedpolicy.org/default.asp?sURL=ombII   various papers such as this "Which Study Designs Can Produce Rigorous Evidence of Program Effectiveness? A Brief Overview"


Identifying and Implementing Educational Practices Supported By Rigorous Evidence: A User Friendly Guide   http://ies.ed.gov/ncee/pubs/evidence_based/evidence_based.asp   "This Guide seeks to provide educational practitioners with user-friendly tools to distinguish practices supported by rigorous evidence from those that are not."


The Core Analytics of Randomized Experiments for Social Research, by Howard S. Bloom    http://www.mdrc.org/publications/437/abstract.html   "This paper ... provides a compact discussion for faculty members, graduate students, and applied researchers of the design and analysis of randomized experiments for measuring the impacts of social or educational interventions."

The Politics of Random Assignment, Implementing Studies and Impacting Policy, by Judith M. Gueron   http://www.mdrc.org/publications/45/workpaper.html   How to get organizations to agree to do random assignment.
 

How Random Must Random Assignment Be in Random Assignment Experiments?   http://www.srdc.org/en_publications.asp?type=8       by Paul Gustafson, "This technical paper reviews options for different approaches to randomization used in experimental studies that measure program impacts"


Gerardo Munck has a methods paper   http://www-rcf.usc.edu/~munck/research/methods.html   See this paper  “Research Designs”., and “Ten Fallacies About Qualitative Research”.


Propensity Score Analysis


Urban institute paper   http://www.urban.org/toolkit/data-methods/propensity.cfm   explanation of what it is and non technical overview of how to do it.


Robert Pruzek's page   http://propensityscoreanalysis.pbworks.com/w/page/19358742/FrontPage   has papers and presentations about psa

A Comparison of Propensity Score Analysis to Analysis of Covariance: A Case Illustration   http://works.bepress.com/john_fraas/25/   paper by Fraas, explaining PSA, and some how to do it.


Reducing the Impact of Selection Bias with Propensity Scores   http://www.chrp.org/propensity/   some slides from a class, some on what it is, some on how to.


Papers by Rajeev Dehejia   http://www.nber.org/~rdehejia/cvindex.htm   one paper from 2005 is "Practical Propensity Score Matching" and another from 2002 is "Propensity Score Matching Methods for Non-Experimental Causal Studies"


The propensity score and estimation in nonrandom surveys - an overview  http://websm.org/uploadi/editor/113518957711.pdf   Stig Danielsson, Department of Statistics, University of Linköping. This paper is about weighting and websurveys.


Propensity score analysis: a new method for analysing register data  http://www.escardio.org/congresses/europrevent2006/Pages/resources.aspx   presentation by T. Kurth. A few slides explain what PSA is.

The case against null hypothesis significance testing.


The Case Against Null Hypothesis Significance Testing: Flaws, Alternatives, and Action Plans   http://meeting.aomonline.org/2007/index.php?option=com_content&task=view&id=147&Itemid=1   "The purpose of this workshop is to increase the awareness among management researchers of the severe limitations of Null Hypothesis Significance Testing (NHST) and to introduce alternative approaches based on effect size measures and confidence intervals."  At an Academy of Management annual meeting. Presented by William H. Starbuck, Jose M. Cortina and Eric Abrahamson.



And now, a little humor

Lies with statistics   http://www.ted.com/talks/lies_damned_lies_and_statistics_about_tedtalks.html   statistical analysis of ted talks. How to make the perfect ted talk. 
Also here   http://www.youtube.com/watch?v=1Totz8aa2Gg&feature=related  


click here to return to methods page
last updated 9/26/11
last verified 9/26/11