Reproducible Pipelines, Statistical Parametric Maps and Strong Inference in fMRI
Measuring and Improving Reliability and Reproducibility in fMRI
1. Reproducible Pipelines, Statistical Parametric Maps and Strong Inference in fMRIStudies of Cognitive Aging
Stephen Strother, BabakAfshipour, GrigoriYourganov, Anita Oder, Cheryl Grady. RotmanResearch Institute, Baycrest & University of Toronto, Canada
2. Investigations into test-retest reliability using an empirical ROC approach.
Morgan Hough and Stephen Smith, FMRIB, Oxford University, England
3. The Impact of Resting Perfusion and Breath Hold BOLD Calibration on Between Site Reliability of Cognitive BOLD Data
Gregory G. Brown, San Diego, VAMC, USA for the Functional Biomedical Informatics Research Network
4. Reliability and Reproducibility in Scientific Inquiry
Michelle Liou, Institute of Statistical Science Academia Sinica, Taiwan, R.O.C.
15th Annual Meeting of the Organization for Human Brain Mapping
San Francisco, CA, USA (June 18-23, 2009)
Measuring and Improving Reliability and Reproducibility in Neuroimaging Chair: Stephen Strother, Rotman Research Institute, Toronto, ON, Cana Reliability and reproducibility (R&R) are fundamentally important criteria for a result to be considered scientific, but they are poorly understood ideas in the neuroimaging community. Their relationship to standard thresholding of SPMs based on p-values remains unclear as does the technique or techniques to use for quantitative measurement. Stephen Strother and Morgan Hough will address the relationship of R&R measurements to standard thresholding of SPMs based on p-values, and he and Morgan Hough and Greg Brown will cover three different approaches to measurement (NPAIRS split-half metrics, Genovese’s binomial mixture model and ANOVA ICCs) in a variety of data sets and settings (Strother – multi-tasking in cognitive aging; Hough – pipeline optimization; Brown – multi-center studies). Finally, Michelle Liou will address whether or not reliability and reproducibility should be considered synonyms in the context of within- and between- subject results from multiple visual tasks. Learning Objectives: Having completed this workshop, participants will be able to: • Illustrate the relationship of reliability & reproducibility measurements to standard thresholding of SPMs based on p-values; • Introduce the audience to the range of reliability & reproducibility measurement techniques that are appearing in the literature with increasing frequency; • Describe techniques that improve reliability & reproducibility measurements in a diverse range of fMRI studies.