Statistics and Design


click here to return to methods page

Evaluators should know statistics, to analyze program data, for example, and also design.  These are just a few of the available links. First, here are links about doing statistical analysis. The second section shows links on research design.

Statistics books, guides


What statistics should I use   http://www.ats.ucla.edu/stat/spss/whatstat/   UCLA's guide


Online Statistics Education: An Interactive Multimedia Course of Study   http://onlinestatbook.com/2/index.html   A public domain on line stat multi media course (although to me it looks like an on line text book.)

HyperStat  http://davidmlane.com/hyperstat/index.html   HyperStat Online is an introductory-level hypertext statistics book.  Also comprehensive links to other on line stat books and links to some stat jokes.
 

Statistics at square one   http://www.bmj.com/about-bmj/resources-readers/publications/statistics-square-one   From BMJ, an on line brief stat text, from 1997.  Also see Epidemiology for the uninitiated   http://www.bmj.com/about-bmj/resources-readers/publications/epidemiology-uninitiated  

 
Electronic Textbook   http://www.statsoft.com/textbook/   Complete on line statistics text book, with many advanced topics.
  

Statistics: power from data   http://www.statcan.gc.ca/edu/power-pouvoir/toc-tdm/5214718-eng.htm   general on line stat book with chapters about data collection, processing, problems, presenting, analyzing.


Stat Primer    http://www.sjsu.edu/faculty/gerstman/StatPrimer/    an on line public domain stat manual.


The Little Handbook of Statistical Practice   http://www.jerrydallal.com/LHSP/LHSP.htm   basic stats to anova and regression. As of 2012, the website isn't being updated. He put it together in a book.
 

SticiGui: Statistics Tools for Internet and Classroom Instruction with a Graphical User Interface   http://www.stat.berkeley.edu/~stark/SticiGui/   includes a text book on basics and advanced basics.


Statistiki   http://statistiki.eu/wiki/Main_Page   "The goal of this wiki is to become an online statistics textbook. ... This wiki does aim to be a practical resource for researchers."


A New View of Statistics    http://www.sportsci.org/resource/stats/index.html   all the usual topics, but pretty comprehensive (from 2013). Will G Hopkins 


Betty Jung's Statistics page   http://www.bettycjung.net/Statsites.htm     has links to many stat notes, such as Stat Primer, below.


Dabbling in the Data. A Hands-on Guide to Participatory Data Analysis   http://publicprofit.net/Publications/DabblingintheData/   from Public Profit. "This guide provides a gentle introduction to practical approaches to explore and analyze data"


CADDIS Volume 4: Data Analysis   http://www.epa.gov/caddis/da_tropo.html   basic concepts, of basic stat and some advanced stat too.


John H. McDonald's Handbook of biological statistics  http://www.biostathandbook.com/   for biology but much is applicable to any field.  2014


Usable Statistics   http://www.usablestats.com/index.php   Some statistical tutorials with graphical demos. The website also has questions and answers and you can ask your own questions. The site owner, Jeff Sauro, is a Six Sigma Black-Belt trained statistical analyst, and also has a couple of interesting articles about completion rates and small samples,  http://www.usablestats.com/about.php  


The North Carolina Center for Public Health Preparedness Training Website  http://nciph.sph.unc.edu/tws/index.php  has free on line training for biostatistics, epidemiology, other topics.


Engineering Statistics   http://www.itl.nist.gov/div898/handbook/index.htm   although much is for engineers, some is also useful for social research. For example a chapter on exploratory analysis  has a section about graphing the data. Another section on quantitative techniques describes many of the usual statistical tests used in social science.


Stat Prob   http://statprob.com/   This is an Encyclopedia Sponsored by Statistics and Probability Societies. Kind of a combination of wikis and editorial review. Popular articles include Logistic Regression   http://statprob.com/?op=getobj&from=objects&id=211   and Generalized Linear Models  http://statprob.com/?op=getobj&from=objects&id=210   The authors are listed with the articles.


Handbook of Biological Statistics   http://udel.edu/~mcdonald/statintro.html   by John H. McDonald. For biology students, but it looks very useful for social scientists too.

Susan Losh's home page   http://myweb.fsu.edu/slosh/index.html    links to her classes
Intro statistics and data analysis   http://myweb.fsu.edu/slosh/IntroStatsGuide1.html   some basic notes on making tables, univariate, bivariate and regression analysis.
Multivariate analysis of categorical data   http://myweb.fsu.edu/slosh/CatDataOverview.html    

(checked to here, 6/20/15)

Specific topics or lists of links
click here to return to methods page
 


Free Statistical Tools on the Web http://gsociology.icaap.org/methods/statontheweb.html    brief review of free statistical resources.  A short version of this article first appeared in the International Statistical Association newsletter, Vol 26, Number 1 (76),  2002, and is at   http://isi.cbs.nl/NLet/NLet021-04.htm   and    http://isi.cbs.nl/FreeTools.htm 


Study design 101   http://himmelfarb.gwu.edu/tutorials/studydesign101/   brief overview of several designs (randomized control trial, cohort, case control).  


A Literature Review of the Use of Random Assignment Methodology in Evaluations of US Social Policy Programmes   http://webarchive.nationalarchives.gov.uk/20130128102031/http://statistics.dwp.gov.uk/asd/asd5/ih-index.asp   In house report #94


Guide to Evaluating the Effectiveness of Strategies for Preventing Work Injuries   http://www.cdc.gov/niosh/docs/2001-119/   See chapters 3 and 4 on design.


Tom Knapp's page   http://www.tomswebpage.net/   papers and manuscripts for books on various statistical topics, including percentages, statistical testing, reliability. These books explain the topics. Some of these books are also available as pdf files here   http://www.statlit.org/Knapp.htm  

 

Design, validity, Randomized Control Trials (RCT)
click here to return to methods page

See our pamphlet on experimental design   http://gsociology.icaap.org/methods/BasicguidesHandouts.html   establishing cause


Experimental Design and Some Threats to Experimental Validity: A Primer   http://eric.ed.gov/?id=ED499991   Skidmore, Susan. Online Submission, Paper presented at the Annual Meeting of the Southwest Educational Research Association (New Orleans, LA, Feb 6, 2008)


When to Use a Randomized Controlled Trial and When Not to   http://www.meaningfulevidence.com/index.php/newsandupdates/publications   April 2013, from Dr. Bernadette Wright, Meaningful Evidence. This paper is also available as pdf on her resource page.

Statsoft has a chapter on experimental design   http://www.statsoft.com/textbook/  


Research Methods Knowledge Base, chapter on design  http://www.socialresearchmethods.net/kb/design.htm


Allpsych on line texts   http://allpsych.com/onlinetexts.html   the research methods text is mainly about design. Also has an on line text on stats. For example, this    http://allpsych.com/researchmethods/quasiexperimentaldesign.html   is a brief overview of quasi experimental design.


Steps of the scientific method   http://www.experiment-resources.com/   describes many of the experimental design concepts, issues.


Quasi-Experimental Evaluation  http://www.childtrends.org/?publications=quasi-experimental-evaluations    


Threat to validity   http://psych.athabascau.ca/html/Validity/   overview of threats to validity. See part 1.


Research Design Lessons   http://core.ecu.edu/psyc/wuenschk/DesignLessons.htm   lectures in word.


This Research Methods class   http://www.csulb.edu/~msaintg/ppa696/696menu.htm   has chapters on experimental and quasi experimental design


Nursing Resources: Threats to Validity of Research Designs   http://researchguides.ebling.library.wisc.edu/c.php?g=293229&p=1953398   nice overview


Johnson's educational research  book   http://www.southalabama.edu/coe/bset/johnson/dr_johnson/2lectures.htm   has chapters (9 and 10) that cover experimental and quasi experimental design. These chapters are fairly detailed.


Basics of Research for the Health Professions. by Linda L. Wright & David A. Lake   http://www.pt.armstrong.edu/wright/hlpr/toc.htm   variables, design, validity


Anol Bhattacherjee  Social Science Research: Principles, Methods, and Practices   http://scholarcommons.usf.edu/oa_textbooks/3/   from 2012. On line text book, complete book.


Identifying and Implementing Educational Practices Supported By Rigorous Evidence: A User Friendly Guide   http://ies.ed.gov/ncee/pubs/evidence_based/evidence_based.asp   "This Guide seeks to provide educational practitioners with user-friendly tools to distinguish practices supported by rigorous evidence from those that are not."


How Random Must Random Assignment Be in Random Assignment Experiments?   http://www.srdc.org/publications/How-Random-Must-Random-Assignment-Be-in-Random-Assignment-Experiments-details.aspx     by Paul Gustafson, 2003, "This technical paper reviews options for different approaches to randomization used in experimental studies that measure program impacts"


Gerardo Munck has a methods paper   http://www-rcf.usc.edu/~munck/research/methods.html   See this paper  “Research Designs”., and “Ten Fallacies About Qualitative Research”.


The Core Analytics of Randomized Experiments for Social Research, by Howard S. Bloom      
http://www.mdrc.org/publication/core-analytics-randomized-experiments-social-research  
and
The Politics of Random Assignment, Implementing Studies and Impacting Policy, by Judith M. Gueron  
http://www.mdrc.org/publication/politics-random-assignment   


Propensity Score Analysis


Robert Pruzek's page   http://propensityscoreanalysis.pbworks.com/w/page/19358742/FrontPage   has papers and presentations about psa

A Comparison of Propensity Score Analysis to Analysis of Covariance: A Case Illustration   http://works.bepress.com/john_fraas/25/   paper by Fraas, explaining PSA, and some how to do it.


Reducing the Impact of Selection Bias with Propensity Scores   http://www.chrp.org/propensity/   some slides from a class, some on what it is, some on how to.


The propensity score and estimation in nonrandom surveys - an overview   http://www.websm.org/db/12/11631/Bibliography/The_propensity_score_and_estimation_in_nonrandom_surveys__an_overview/?menu=1&lst=&q=propensityscoreandestimationnonrandomsurveys_0_111111_-1&qdb=12&qsort=0   Stig Danielsson, Department of Statistics, University of Linköping. This paper is about weighting and websurveys.



Bayesian Inference


Jim Berger, Professor of Statistics   http://www.stat.duke.edu/~berger/   has a paper The interplay between Bayesian and frequentist analysis. Bayarri, M.J. and Berger, J. (2004) `Statistical Science',  which says statisticians need both Bayesian and frequentist approaches.

The International Society for Bayesian Analysis (ISBA)   http://bayesian.org/   has a brief description of bayesian inference.


Guidance for the Use of Bayesian Statistics in Medical Device Clinical Trials   http://www.fda.gov/MedicalDevices/DeviceRegulationandGuidance/GuidanceDocuments/ucm071072.htm   This guidebook from the FDA explains bayesian methods "Bayesian statistics is an approach for learning from evidence as it accumulates. In clinical trials, traditional (frequentist) statistical methods may use information from previous studies only at the design stage. Then, at the data analysis stage, the information from these studies is considered as a complement to, but not part of, the formal analysis. In contrast, the Bayesian approach uses Bayes’ Theorem to formally combine prior information with current information on a quantity of interest. The Bayesian idea is to consider the prior information and the trial results as part of a continual data stream, in which inferences are being updated each time new data become available."


Bayesian perspectives for epidemiological research: I. Foundations and basic methods   http://ije.oxfordjournals.org/content/35/3/765.full   by Sander Greenland. I have to read this article again to understand what it says, but it's in the International Journal of Epidemiology.

This Los Alamos labs page   http://www.lanl.gov/bayesian/   also has a tutorial on bayesian methods.


Bayesian Statistics in Oncology   http://onlinelibrary.wiley.com/doi/10.1002/cncr.24628/full  by Adamina, Tomlinson and Guller. Also some explanation.


Bayesian statistics, WinBUGS , and R   http://www.stat.auckland.ac.nz/~millar/   from Russell Millar, Department of Statistics, University of Auckland
See chapter 1 in the Applied Bayesian Inference workshop, power point handouts


Bayesian statistics made (as) simple (as possible)   http://www.youtube.com/watch?v=bobeo5kFz1g   lecture. Look at it starting about 7 or 8 minutes in. This is from Allen Downey  
http://allendowney.blogspot.com/2012/03/bayesian-statistics-made-simple.html   Dr. Downey is a Professor of Computer Science at the Franklin W. Olin College of Engineering.  http://www.olin.edu/faculty/profile/allen-downey/   


Kevin Boone's explanation of Bayes   http://kevinboone.net/bayes.html  


Bayesian Statistics   http://www.youtube.com/playlist?list=PLFHD4aOUZFp0Xhzd5j1nWnExD54xJfnJX   from Jared Niemi, from Iowa State University, Department of Statistics  
http://www.stat.iastate.edu/personal/?id=niemi      These are for his Intro to Bayesian Statistics class.  



Null hypothesis significance testing: issues to know about. Some things to read about significance testing. Some of these article also make the point that the conclusion is not that significance testing is wrong, but that it is misused.


The Case Against Statistical Significance Testing  Ronald P Carver   http://hepg.org/her-home/issues/harvard-educational-review-volume-48,-issue-3/herarticle/_894   Harvard Educational Review, 1978. Just to show this criticism has a long history.


The Case Against Null Hypothesis Significance Testing: Flaws, Alternatives, and Action Plans  http://feb.ugm.ac.id/en/news/489-questioning-null-hypothesis-significance-tests.html   This is a summary.  At an Academy of Management annual meeting. Presented by William H. Starbuck, Jose M. Cortina and Eric Abrahamson.


An investigation of the false discovery rate and the misinterpretation of p-values. David Colquhoun. Published 19 November 2014   http://rsos.royalsocietypublishing.org/content/1/3/140216   Royal Society Open Science.


Why Most Published Research Findings Are False. John P. A. Ioannidis. Published: August 30, 2005  PLOS Medicine.   http://journals.plos.org/plosmedicine/article?id=10.1371/journal.pmed.0020124  


The Insignificance of Null Hypothesis Significance Testing   http://polmeth.wustl.edu/media/Paper/gill99.pdf   Jeff Gill.  Political Research Quarterly September 1999 vol. 52 no. 3
"There is evidence that null hypothesis significance testing as practiced in political science is deeply flawed and widely misunderstood. " 
    The published version is here  http://prq.sagepub.com/content/52/3/647.abstract  but not free to read.




And now, a little humor

Lies with statistics   http://www.ted.com/talks/lies_damned_lies_and_statistics_about_tedtalks.html   statistical analysis of ted talks. How to make the perfect ted talk. 
Also here   http://www.youtube.com/watch?v=1Totz8aa2Gg&feature=related  


Parachute use to prevent death and major trauma related to gravitational challenge: systematic review of randomised controlled trials.
Smith GC, Pell JP.  BMJ. 2003 Dec 20;327(7429):1459-61.  http://www.ncbi.nlm.nih.gov/pubmed/14684649.1   The authors suggest there is a need for controlled randomized experiments to determine whether parachutes are effective when you jump out of an airplane.





click here to return to methods page
last updated 6/21/15
last verified 6/21/15



Looking for updated urls
 
Statistical Service Center http://www.reading.ac.uk/ssc/resourcepage/index.php  is going to have papers and presentations.