Statistics Question.
Alternatives to Bonferroni Correction?
Do we need Bonferroni corrections for a series of T-tests that are conducted on different tasks? Philosophical Objections to Bonferroni Corrections “Bonferroni adjustments are, at best, unnecessary and, at worst, deleterious to sound statistical inference” Perneger (1998) •Counter-intuitive: interpretation of finding depends on the number of other tests performed … It is named after Sture Holm, who codified the method, and Carlo Emilio Bonferroni. Alternativen.
Bonferroni corrections are employed to reduce Type I errors (i.e., rejecting H o when H o is true) when multiple tests or comparisons are conducted. Dunnet’s Correction Dunnet’s correction is similar to Tukey’s procedure except that it involves the comparison of every mean to a single control mean. Es existieren etliche andere, wenn auch weniger bekannte Methoden, die alternative berechnet werden können, beispielsweise die Holm–Bonferroni–Korrektur und die Šidák–Korrektur.
False discovery rate control is a recommended alternative to Bonferroni-type adjustments in health studies Mark E. Glickmana,b,*, Sowmya R. Raoa,c, Mark R. Schultza aCenter for Health care Organization and Implementation Research, Bedford VA Medical Center, 200 Springs Road (152), Bedford, MA 01730, USA Under that criterion, only the test for total calories is significant. Because the Bonferroni corrections is rather conservative, alternative procedure have been suggested.
The Bonferroni correction is one of the simplest and most conservative multiple comparisons technique. Increase in type II errors.
4 And type II errors are no less false than type I errors.
It is also one of the oldest and has been improved upon greatly over time. In statistics, the Holm–Bonferroni method, also called the Holm method or Bonferroni–Holm method, is used to counteract the problem of multiple comparisons.
It is intended to control the family-wise error rate and offers a simple test uniformly more powerful than the Bonferroni correction. Hochberg's and Hommel's methods are valid when the hypothesis tests are independent or when they are non-negatively associated (Sarkar, 1998; Sarkar and Chang, 1997). Type I errors cannot decrease (the whole point of Bonferroni adjustments) without inflating type II errors (the probability of accepting the null hypothesis when the alternative is true). Bonferroni correction is a conservative test that, although protects from Type I Error, is vulnerable to Type II errors (failing to reject the null hypothesis when …
Does …
The Bonferroni correction was specifically applied in 51 (36%) of articles, other types of correction such as the Bonferroni‐Holm method, standard Abbott formula, the false discovery rate, the Hochberg method, or an alternative conservative post‐hoc procedure, such as Scheffé's test, being used in the remainder.
Here, I highlight and discuss an implication of this low statistical power on one of the most widely used statistical procedures, Bonferroni correction (Cabin and Mitchell, 2000).
It is fair to say that the Bonferroni adjustments have limited application in almost all situations. My company uses a frequentist testing tool to run AB tests.
Applying the Bonferroni correction, you'd divide P=0.05 by the number of tests (25) to get the Bonferroni critical value, so a test would have to have P<0.002 to be significant. In order to account for family wise errors we've been using the Sidak-Dunn Bonferroni correction, but I feel like there could be a better solution. There seems no reason to use the unmodified Bonferroni correction because it is dominated by Holm's method, which is also valid under arbitrary assumptions.
Beide Methoden besitzen mindestens immer dieselbe statistische Power, wie die Bonferroni-Korrektur.