An analysis of variance comparing a quantitative response variable across levels of one factor. The ordinary independent-groups F-test evaluates equality of group population means under the one-way normal linear model. Rejection says that not all means are equal, rather than identifying every differing pair.
Let be the population means of the numerical vaccination intention score in the two recorded groups. The two-sided hypothesis test compares
The sample means are and , giving a difference of sample means of approximately 0.01988 score points, in the order group zero minus group one. The reported group counts are 1,866 and 262; seven observations have a missing group indicator.
Welch's t-test divides that estimated difference by its estimated standard error. Its reported test statistic is , with approximately statistical degrees of freedom. This is an unequal-variance comparison; fractional statistical degrees of freedom are appropriate for the Welch approximation. The two groups need not have equal sample sizes or equal population variances.[ref]
The reported p-value is . Under the specified equal-mean null hypothesis and sampling model, a p-value measures the probability of a result at least as extreme as the observed one. It is not a posterior probability that the null hypothesis is true. There is no rejection at a prespecified 5% significance level. The observed difference of sample means is tiny relative to its estimated standard error.
The 95% confidence interval is approximately
It includes zero and differences in either direction. The interval's coverage refers to repeated use of the procedure under its assumptions, rather than to a probability assigned to this fixed unknown parameter or to the spread of individual scores. Nonrejection does not establish that the two population means are identical.
Simple random sampling supports the sampling interpretation, but the score is bounded and its raw distribution need not be a normal distribution. The large group sizes can support an approximate normal sampling distribution of the sample means under regularity conditions. The supplied observational study does not identify a causal explanation of any difference, and the numeric coding of the group labels creates no biological or ordinal interpretation.
Let and be the population means of the newspaper trust score for the unvaccinated and vaccinated groups. A two-sided hypothesis test compares
The observed difference of sample means is : the vaccinated group has a one-unit higher average trust score. The negative test statistic agrees with subtraction in this order. A Student's t-test scales the estimated difference by its estimated standard error; means that the observed difference is 3.6 estimated standard errors below the equal-mean null hypothesis.
Using the reported reference Student t-distribution with 747 statistical degrees of freedom,
Thus the equal-mean null hypothesis is rejected at a prespecified 5%, 1% or 0.1% significance level, subject to the test's assumptions. A p-value is a probability of a result at least this extreme under the specified null hypothesis and sampling model. It is neither the probability that the null hypothesis is true nor the probability that this particular conclusion is mistaken. A chosen significance level controls the procedure's type I error probability under that model.
The estimated difference is more informative than statistical significance alone. If the reported statistic uses this one-unit contrast, its estimated standard error is . The corresponding approximate 95% confidence interval is
This interval concerns a population mean difference under repeated sampling; it is not a range containing 95% of individual trust scores. Its practical interpretation also depends on the trust scale and the importance of a one-unit difference.
The groups are disjoint, so an independent-samples comparison is appropriate if the sampled observations are independent. The exact pooled Student's t-test additionally assumes common population variance and normal distributions; Welch's t-test permits unequal variances and uses an approximate reference distribution. A bounded or ordinal rating need not be exactly normal, so treating it numerically and using a large-sample approximation also requires judgment about group sizes and the score's meaning.
There is a bookkeeping qualification. The later outputs use 748 observations. If these are also the complete observations for this two-group comparison, the pooled test has statistical degrees of freedom, and the Welch degrees of freedom upper bound is also 746. The printed 747 therefore needs the original test call or a different sample count to reconcile it. The reported-calibration calculation above answers the stated test; it does not invent group sizes or silently change the reference distribution.
The evidence supports an association between higher newspaper trust and recorded vaccination, rather than a causal effect of trust. An observational study does not rule out confounding, selection bias or reverse causation. A statistical hypothesis test cannot supply those missing causal assumptions.
Use one-way analysis of variance to compare a quantitative response variable across levels of one categorical factor; for example, compare task accuracy across three independently assigned teaching methods. The ordinary independent-groups procedure tests the null hypothesis that all group population means are equal. Its F-test compares variation associated with the group factor against within-group error variation; a significant result indicates that not all population means are equal, without identifying which groups differ.[ref]
The classical one-way normal linear model assumes independent observations and within-group errors approximately following a normal distribution with a common variance. Repeated observations on the same people require a different dependence structure; pronounced unequal variances may call for Welch's one-way analysis of variance. Planned contrasts or appropriately controlled follow-up comparisons identify scientifically relevant differences. Report the means, differences and confidence intervals, not just significance. Causal interpretation depends on the design of experiments, particularly randomization, rather than on the F-test alone.
Use a Student t-test to assess a mean or mean difference relative to its standard error. A one-sample version compares a population mean with a specified reference. An independent two-sample version compares two separate groups, such as groups assigned different instructions; Welch's t-test permits unequal group variances. A paired t-test uses within-pair differences, such as each participant's before/after scores, rather than pretending those measurements are independent.[ref]
The relevant normality assumption concerns within-group errors for the independent-groups model or the distribution of within-pair differences for the paired model. Independent participants or pairs remain essential. Report the estimated difference and its confidence interval together with the test result. A small p-value indicates incompatibility with the specified null hypothesis under the model; it does not measure the size of the difference, the probability that the null hypothesis is true, or whether the difference matters practically.