Justify Your Alpha
Lakens, Daniel; Adolfi, Federico G.; Albers, Casper J.; Anvari, Farid; Apps, Matthew A. J.; Argamon, Shlomo E.; Baguley, Thom; Becker, Raymond B.; Benning, Stephen D.; Bradford, Daniel E.; Buchanan, Erin M.; Caldwell, Aaron R.; Van Calster, Ben; Carlsson, Rickard; Chen, Sau-Chin; Chung, Bryan; Colling, Lincoln J.; Collins, Gary S.; Crook, Zander; Cross, Emily S.; Daniels, Sameera; Danielsson, Henrik; DeBruine, Lisa M.; Dunleavy, Daniel J.; Earp, Brian D.; Feist, Michele I.; Ferrell, Jason D.; Field, James G.; Fox, Nicholas W.; Friesen, Amanda; Gomes, Caio; Gonzalez-Marquez, Monica; Grange, James A.; Grieve, Andrew P.; Guggenberger, Robert; Grist, James; van Harmelen, Anne-Laura; Hasselman, Fred; Hochard, Kevin D.; Hoffarth, Mark R.; Holmes, Nicholas P.; Ingre, Michael; Isager, Peder M.; Isotalus, Hanna K.; Johansson, Christer; Juszczyk, Konrad; Kenny, David A.; Khalil, Ahmed A.; Konat, Barbara; Lao, Junpeng; Larsen, Erik Gahner; Lodder, Gerine M. A.; Lukavský, Jiří; Madan, Christopher R.; Manheim, David; Martin, Stephen R.; Martin, Andrea E.; Mayo, Deborah G.; McCarthy, Randy J.; McConway, Kevin; McFarland, Colin; Nio, Amanda Q. X.; Nilsonne, Gustav; de Oliveira, Cilene Lino; de Xivry, Jean-Jacques Orban; Parsons, Sam; Pfuhl, Gerit; Quinn, Kimberly A.; Sakon, John J.; Saribay, S. Adil; Schneider, Iris K.; Selvaraju, Manojkumar; Sjoerds, Zsuzsika; Smith, Samuel G.; Smits, Tim; Spies, Jeffrey R.; Sreekumar, Vishnu; Steltenpohl, Crystal N.; Stenhouse, Neil; Świątkowski, Wojciech; Vadillo, Miguel A.; Van Assen, Marcel A. L. M.; Williams, Matt N.; Williams, Samantha E.; Williams, Donald R.; Yarkoni, Tal; Ziano, Ignazio; Zwaan, Rolf A.
2018
Files
Abstract
In response to recommendations to redefine statistical significance to P ≤ 0.005, we propose that researchers should transparently report and justify all choices they make when designing a study, including the alpha level.
Details
Title
Justify Your Alpha
Author
Lakens, Daniel
Adolfi, Federico G.
Albers, Casper J.
Anvari, Farid
Apps, Matthew A. J.
Argamon, Shlomo E.
Baguley, Thom
Becker, Raymond B.
Benning, Stephen D.
Bradford, Daniel E.
Buchanan, Erin M.
Caldwell, Aaron R.
Van Calster, Ben
Carlsson, Rickard
Chen, Sau-Chin
Chung, Bryan
Colling, Lincoln J.
Collins, Gary S.
Crook, Zander
Cross, Emily S.
Daniels, Sameera
Danielsson, Henrik
DeBruine, Lisa M.
Dunleavy, Daniel J.
Earp, Brian D.
Feist, Michele I.
Ferrell, Jason D.
Field, James G.
Fox, Nicholas W.
Friesen, Amanda
Gomes, Caio
Gonzalez-Marquez, Monica
Grange, James A.
Grieve, Andrew P.
Guggenberger, Robert
Grist, James
van Harmelen, Anne-Laura
Hasselman, Fred
Hochard, Kevin D.
Hoffarth, Mark R.
Holmes, Nicholas P.
Ingre, Michael
Isager, Peder M.
Isotalus, Hanna K.
Johansson, Christer
Juszczyk, Konrad
Kenny, David A.
Khalil, Ahmed A.
Konat, Barbara
Lao, Junpeng
Larsen, Erik Gahner
Lodder, Gerine M. A.
Lukavský, Jiří
Madan, Christopher R.
Manheim, David
Martin, Stephen R.
Martin, Andrea E.
Mayo, Deborah G.
McCarthy, Randy J.
McConway, Kevin
McFarland, Colin
Nio, Amanda Q. X.
Nilsonne, Gustav
de Oliveira, Cilene Lino
de Xivry, Jean-Jacques Orban
Parsons, Sam
Pfuhl, Gerit
Quinn, Kimberly A.
Sakon, John J.
Saribay, S. Adil
Schneider, Iris K.
Selvaraju, Manojkumar
Sjoerds, Zsuzsika
Smith, Samuel G.
Smits, Tim
Spies, Jeffrey R.
Sreekumar, Vishnu
Steltenpohl, Crystal N. (University of Southern Indiana)
Stenhouse, Neil
Świątkowski, Wojciech
Vadillo, Miguel A.
Van Assen, Marcel A. L. M.
Williams, Matt N.
Williams, Samantha E.
Williams, Donald R.
Yarkoni, Tal
Ziano, Ignazio
Zwaan, Rolf A.
Adolfi, Federico G.
Albers, Casper J.
Anvari, Farid
Apps, Matthew A. J.
Argamon, Shlomo E.
Baguley, Thom
Becker, Raymond B.
Benning, Stephen D.
Bradford, Daniel E.
Buchanan, Erin M.
Caldwell, Aaron R.
Van Calster, Ben
Carlsson, Rickard
Chen, Sau-Chin
Chung, Bryan
Colling, Lincoln J.
Collins, Gary S.
Crook, Zander
Cross, Emily S.
Daniels, Sameera
Danielsson, Henrik
DeBruine, Lisa M.
Dunleavy, Daniel J.
Earp, Brian D.
Feist, Michele I.
Ferrell, Jason D.
Field, James G.
Fox, Nicholas W.
Friesen, Amanda
Gomes, Caio
Gonzalez-Marquez, Monica
Grange, James A.
Grieve, Andrew P.
Guggenberger, Robert
Grist, James
van Harmelen, Anne-Laura
Hasselman, Fred
Hochard, Kevin D.
Hoffarth, Mark R.
Holmes, Nicholas P.
Ingre, Michael
Isager, Peder M.
Isotalus, Hanna K.
Johansson, Christer
Juszczyk, Konrad
Kenny, David A.
Khalil, Ahmed A.
Konat, Barbara
Lao, Junpeng
Larsen, Erik Gahner
Lodder, Gerine M. A.
Lukavský, Jiří
Madan, Christopher R.
Manheim, David
Martin, Stephen R.
Martin, Andrea E.
Mayo, Deborah G.
McCarthy, Randy J.
McConway, Kevin
McFarland, Colin
Nio, Amanda Q. X.
Nilsonne, Gustav
de Oliveira, Cilene Lino
de Xivry, Jean-Jacques Orban
Parsons, Sam
Pfuhl, Gerit
Quinn, Kimberly A.
Sakon, John J.
Saribay, S. Adil
Schneider, Iris K.
Selvaraju, Manojkumar
Sjoerds, Zsuzsika
Smith, Samuel G.
Smits, Tim
Spies, Jeffrey R.
Sreekumar, Vishnu
Steltenpohl, Crystal N. (University of Southern Indiana)
Stenhouse, Neil
Świątkowski, Wojciech
Vadillo, Miguel A.
Van Assen, Marcel A. L. M.
Williams, Matt N.
Williams, Samantha E.
Williams, Donald R.
Yarkoni, Tal
Ziano, Ignazio
Zwaan, Rolf A.
Date
2018-2-26
Publisher
Springer Science and Business Media LLC
Content Type
Article
Record ID
1416647
ISSN
2397-3374
Language
English
Published in
Nature Human Behavior
Grant Information
We thank D. Barr, F. Cheung, D. Colquhoun, H. IJzerman, H. Motulsky and R. Morey for helpful discussions while drafting this Comment. D.L. was supported by Nederlandse Organisatie voor Wetenschappelijk Onderzoek 452-17-013. F.G.A. was supported by CONICET. M.A.J.A. was funded by a Biotechnology and Biological Sciences Research Council AFL Fellowship (BB/M013596/1). G.S.C. was supported by the National Institute for Health Research Biomedical Research Centre, Oxford. Z.C. was supported by the Economic and Social Research Council (grant number C106891X). E.S.C. was supported by the European Research Council (ERC-2015-StG-677270). L.D. is supported by the European Research Council (ERC-2014-CoG-647910 KINSHIP). A.-L.v.H. is funded by a Royal Society Dorothy Hodgkin Fellowship (DH150176). M.R.H. was supported by the National Science Foundation under grant SBE SPRF-FR 1714446. J.Lao was supported by the Swiss National Science Foundation grant 100014_156490/1. C.L.d.O. was supported by Conselho Nacional de Desenvolvimento Científico e Tecnológico. A.E.M. was supported by the Economic and Social Research Council of the United Kingdom (grant number ES/K009095/1). J.-J.O.d.X. is supported by an internal grant from the KU Leuven (STG/14/054) and by the Fonds voor Wetenschappelijk Onderzoek (1519916N). S.P. was supported by the European Research Council (FP7/2007–2013; ERC grant agreement no. 324176). G.M.A.L. was funded by Nederlandse Organisatie voor Wetenschappelijk Onderzoek 453-14-016. S.G.S. is supported by a Cancer Research UK Fellowship (C42785/A17965). V.S. was supported by the National Institute for Neurological Disorders and Stroke Intramural Research Program (IRP). M.A.V. was supported by grant 2016-T1/SOC-1395 from Comunidad de Madrid. T.Y. was supported by National Institutes of Health award R01MH109682.
Record Appears in
Scholarly Open Access Repository > Faculty Scholarship > Articles & Manuscripts