Let denote a quantile of the standard normal distribution. Reject when . The statistical power at the specified positive effect is
Equating this to and using gives . Thus, for the usual target ,
Rounding up ensures at least the target statistical power. This normal-mean sample size calculation assumes a positive integer sample size; if a requested power is at most , every positive sample size already exceeds that target for , and one should not square a negative quantile sum to impose an unnecessary lower bound.
Three distinct benefits of a meta-analysis are greater precision, an explicit synthesis of the effect, and assessment of variation across studies.
Combining compatible independent estimates can reduce the standard error, improve statistical power and provide more informative confidence intervals than individual small trials. A prespecified pooled estimate summarises the direction and magnitude of the evidence quantitatively, instead of informally counting statistically significant results. Finally, between-study heterogeneity and subgroup comparisons can reveal whether effects vary with populations or interventions, helping assess generalisability. These benefits require comparable estimands and an appraisal of study validity; pooling cannot repair systematic within-study bias.
Let be simple hypotheses with densities (their Radon-Nikodym derivatives) relative to a common dominating measure. A possibly randomised statistical test is a measurable function ; its size of a statistical test is and its statistical power is . The Neyman-Pearson lemma says that a likelihood ratio threshold test
chosen to have size , is a most powerful test among tests of size at most . A constant randomisation on the equality set suffices to reach the required size; sets where are always rejected. For , a quantile of the likelihood ratio under gives such a threshold. If the threshold is zero, randomisation where may be needed to use the remaining size. At , one can reject only a -null set and optimally reject the part supporting ; at , always reject.
For the proof, every competing satisfies
pointwise: the signs agree off the equality set, where the product is zero. Integrating gives
Thus the likelihood-ratio threshold test has maximum power at the stated level. If , a competing most-powerful test must have size and agree with off the equality set, apart from sets null for ; both inequalities must then be equalities. For , equal size is not necessary for optimality, because changing decisions where does not affect power. These qualifications account for ties and singular supports rather than assuming all densities are strictly positive.
Under the null hypothesis , has the uniform distribution on . Against , the likelihood ratio is , increasing on that interval. The Neyman-Pearson lemma therefore gives
The size of a statistical test is , and there is no boundary randomisation issue for this continuous probability distribution. Its statistical power against is .
For every admissible alternative , the likelihood ratio is strictly increasing. The same upper-tail rejection set has size and is a most powerful test against each fixed such alternative, again by the Neyman-Pearson lemma. Hence the same test is a uniformly most powerful test against , where the alternative is understood within the specified parameter range. Its full power function is
For or , the never-reject or always-reject test supplies the respective endpoint case.
Under the null hypothesis of consistency, has approximately zero expectation and variance , since the displayed trials are independent. Thus a two-sided Wald test uses
The observed difference is , and . Its two-sided p-value is approximately , so there is no detectable discrepancy here. Failure to reject is not proof of consistency: this test has limited statistical power, and transitivity in network meta-analysis also needs substantive assessment. If evidence sources overlap, replace by .
Use the usual normal linear model , with fixed full-column-rank design , , and . These Gaussian distribution and constant-variance hypotheses are necessary for an exact finite-sample Student's t-test. Put and . The vector of ordinary least squares estimators satisfies
With , the test statistic is
Under the null hypothesis, has Student's t-distribution with degrees of freedom. A two-sided level- Student's t-test rejects when . If the intended test is one-sided against , it rejects when ; the statistical power conclusion below holds for either convention.
The orthogonal projections of the Gaussian noise onto the column space of and its orthogonal complement are independent. Consequently and the residual sum of squares are independent, and
Thus under the alternative,
This is the noncentral t-distribution. The rejection region is fixed by the design, and the chosen level, while this probability distribution depends on only through . Therefore the statistical power does not depend on the other regression coefficients, with the design and fixed.
A simple hypothesis specifies a single probability distribution. For a test with rejection region , its size of a statistical test is the rejection probability under the simple null hypothesis, while its statistical power against the simple alternative is the rejection probability under that alternative. The Neyman-Pearson lemma states that among tests of size at most , a test rejecting for the largest values of the likelihood ratio has greatest power, with boundary randomization if needed.
Here
which decreases with . The best test therefore rejects for . Under , , so size requires . Its power is
Thus reject exactly when .
Put and assume . For fixed and a fixed nonzero difference , the approximate statistical power of the Wald test increases as its noncentrality increases, where
Differentiating with respect to the continuous allocation gives
Hence the unique minimum and its associated minimum variance are
This is Neyman allocation. Integer allocations use a feasible adjacent integer to the continuous optimum, comparing the resulting variances; must still hold. It is a large-sample normal approximation argument, not an exact finite-sample power theorem for arbitrary response-adaptive randomization. Under the null , the approximate power is the significance level for any allocation, although the same allocation still minimizes the stated variance.
For equal arm size , write at the clinically relevant alternative. A one-sided level- Wald test rejects when , and its approximate statistical power is
Equating this to gives the per-arm sample size
rounded up. If the design uses a null-based critical standard error but an alternative standard error , the corresponding more general formula is
Suppose each collaborating centre contributes independently randomized participants per arm with specified event probabilities. At 50% statistical power, the usual normal-approximation alternative quantile is zero. The required size per arm is , with for a two-sided test or for a one-sided test. Divide by the per-centre arm size and round up. Endpoints must use the same time origin and follow-up window, and cluster dependence requires an additional adjustment.
Regression coefficient test power ignores nuisance coefficients Created 2026-10-05 Updated 2026-10-14
In a fixed full-rank normal linear model, the studentized estimator of one coefficient has a noncentral t-distribution with noncentrality equal to that coefficient divided by its standard deviation. The fitted and residual orthogonal projections of the Gaussian noise are independent. Therefore the statistical power of its exact Student's t-test does not depend on the other regression coefficients, with design and variance fixed.
Statistical test Created 2026-10-05 Updated 2026-10-14
A statistical test is a measurable rule for deciding whether to reject a null hypothesis. Allowing randomisation, it is represented by a function giving the conditional rejection probability after observing . A deterministic test takes only values zero and one. Under a simple null, is its size of a statistical test; under an alternative, is its statistical power. Randomisation on a likelihood ratio equality set allows a Neyman-Pearson lemma threshold test to attain a prescribed size even for discrete data.