Reporting and Assessing Statistical Evidence 2

PSM 2

Bennett Kleinberg

26 Feb 2019

Probability, Statistics & Modeling II

Lecture 7

Statistical reporting 2 + assessment details

Which question do you have?

Today

  • recap week 1-5
  • statistical reporting
  • assessment details

Week 1

  • marginal probability
  • conditional probability
  • Bayes’ Rule
  • Simpson’s paradox

Week 2

  • modelling data
  • regression idea
  • regression effects

Week 3

  • GLM idea
  • logistic regression
  • model comparison

Week 4

  • GLM for t-tests
  • GLM for ANOVAs
  • Relationship between t-test, ANOVA, lm

Week 5

  • non-paramtric tests
  • esp. ranking methods
  • discrete data
  • R by C (ChiSquare)
  • X by Y by Z (loglinear)

Week 5

Statistical reporting

A tricky time

  • Reproducibility crisis (2015)
  • Statistics crisis (2016)

A tricky time

  • QRPs widespread
  • Some remedies in place
    • preregistration
    • data sharing

A tricky time

Problems:

  • preregistration a long way from the norm
  • data sharing is often a taboo

So what can we do without relying on (old) researchers improving their research practices?

Ways forward

  • get the journals on board
  • get the funding bodies on board
  • tackle the NHST problem

My first “science” surprise