학술논문

Beware the F test (or, how to compare variances)
Document Type
Report
Source
Animal Behaviour. Feb, 2018, Vol. 136, 119
Subject
Zoology and wildlife conservation
Language
English
ISSN
0003-3472
Abstract
Keywords Box--Anderson test; F test; jackknife; Levene's test; normality; permutation; power; variance Highlights * Behaviourists often wish to compare variances. * F tests are frequently used to make these comparisons, but should not be. * Levine's test is probably the best way to compare variance equality. Biologists commonly compare variances among samples, to test whether underlying populations have equal spread. However, despite warnings from statisticians, incorrect testing is rife. Here we show that one of the most commonly employed of these tests, the F test, is extremely sensitive to deviations from normality. The F test suffers greatly elevated false positive errors when the underlying distributions are heavy tailed, a distribution feature that is very hard to detect using standard normality tests. We highlight and assess a selection of parametric, jackknife and permutation tests, consider their performance in terms of false positives, and power to detect signal when it exists, then show correct methods to compare measures of variation among samples. Based on these assessments, we recommend using Levene's test, Box--Anderson test, jackknifing or permutation tests to compare variances when normality is in doubt. Levene's and Box--Anderson tests are the most powerful at small sample sizes, but the Box--Anderson test may not control type I error for extremely heavy-tailed distributions. As noted previously, do not use F tests to compare variances. Author Affiliation: Centre for Ecology & Conservation, University of Exeter, Cornwall, Penryn U.K. * Correspondence: D. J. Hosken and D. J. Hodgson, Centre for Ecology & Conservation, University of Exeter, Cornwall, Penryn TR10 9EZ, U.K. Article History: Received 15 May 2017; Revised 1 June 2017; Accepted 23 November 2017 (miscellaneous) MS number: 17-00407R Byline: D.J. Hosken [d.j.hosken@exeter.ac.uk] (*), D.L. Buss, D.J. Hodgson [d.j.hodgson@exeter.ac.uk] (*)