Clinical trial Created 2026-09-24 Updated 2026-11-05
A clinical trial is a research study that prospectively assigns people to an intervention to evaluate health-related outcomes. The intervention can be a medicine, procedure, device or behavioural approach. In a randomized controlled trial, random assignment creates comparison groups; blinding reduces some measurement and expectation effects. For example, comparing a new treatment with usual care requires a prespecified outcome and follow-up interval, not merely observing whether treated participants improve. A trial differs from an observational study, where investigators do not assign the exposure.[ref]
Hypercalcaemia Created 2026-10-05 Updated 2026-11-05
Hypercalcaemia is an abnormally elevated serum calcium concentration. A diagnosis in medical records depends on testing and diagnostic practice, which can introduce selection bias into an observational study.
James M. Robins 2026-11-05
James M. Robins develops statistical methods for causal inference in epidemiology. His joint exposition with Miguel A. Hernán explains how inverse probability weighting can estimate population treatment effects from observational studies under appropriate identifying assumptions.[ref]
Weighting gives more influence to people whose observed treatment was relatively unlikely given their measured baseline covariates. In the resulting weighted comparison, measured treatment-selection differences are removed under the assumed model. Validity still depends on conditional exchangeability, consistency of potential outcomes and positivity in causal inference; extreme weights also expose a practical difficulty when some treatment choices are rare.[ref]
Kari Lock Morgan 2026-11-05
Kari Lock Morgan studies the design of randomized experiments, especially how to improve baseline covariate balance. Her work on restricted randomization specifies acceptable balance before an experiment and redraws allocations that fail that criterion. Inference must account for the resulting assignment procedure.[ref]
With Fan Li and Alan M. Zaslavsky, she studied propensity score weighting for observational studies. For a logistic propensity score fitted by maximum likelihood estimation with an intercept, their overlap weights exactly balance weighted means of the included covariates under the stated fitting conditions.[ref]
Migraine Created 2026-10-05 Updated 2026-11-05
Migraine is a neurological disorder that can be an outcome in a clinical trial or an observational study. Its statistical association with an exposure does not alone establish a causal effect.
Miguel A. Hernán 2026-11-05
Miguel A. Hernán develops causal inference methods for epidemiological data. With James M. Robins, he explains how observational studies can estimate treatment effects when the treatment groups satisfy appropriate conditional exchangeability assumptions.[ref]
One method is outcome standardization: estimate outcome risks within baseline covariate strata under each treatment and average both sets of risks over the same target population. The comparison depends on identifying assumptions, including adequate measurement of confounders, consistency of potential outcomes and positivity in causal inference.[ref]
Multiple linear regression Created 2026-10-14 Updated 2026-10-18
Multiple linear regression models a scalar response by an intercept and several predictors. It is linear in the regression coefficients, even when predictors include transformed variables or interactions. In an observational study, adjustment can address measured confounding, but does not automatically identify a causal effect. Improvements in fitted coefficient of determination require external predictive assessment rather than being treated as proof of improved future prediction.
Observational study Created 2026-09-28 Updated 2026-11-05
An observational study measures exposures and outcomes without assigning the exposure by an intervention. Its causal interpretation therefore requires assumptions that address confounding and selection bias.
Greater technology distrust is associated with lower efficacy in the overall sample. The omnibus evidence against independence is strong, while the unsigned association magnitude is modest: on 6 statistical degrees of freedom, and Cramér's V about 0.148. The observational study does not establish that changing trust would cause efficacy to change.
Rows identify the technology response and columns identify efficacy. Each body percentage is a within-row conditional probability estimate, not a column percentage. For example, of those who strongly disagree with the distrust statement have High efficacy, whereas of those who agree do. The difference is about 21.69 percentage points. High efficacy decreases across all four rows: 49.40%, 42.41%, 31.02%, 27.72%. Low efficacy is 20.54% in the strongly-disagree row, 18.00% in Disagree, 21.43% in Neutral and 34.26% in Agree. Thus the overall pattern is clear without claiming that every category changes monotonically: the low-efficacy proportion initially falls, and the Medium proportion peaks at 47.55% among neutral respondents.
For the Pearson chi-squared test of independence, the null hypothesis says that the two categorical variables are independent, equivalently that the efficacy distribution is the same in every technology-response row. With row totals and column totals , the expected frequency under that hypothesis is , and
All twelve expected frequencies exceed 79, with minimum about 79.844, so sparse expected cells are not the concern here. Under independent sampling and the usual large-sample calibration, the very small p-value rejects independence at conventional significance levels. This is an omnibus finding: it does not provide a separate adjusted significance test for every pair of row percentages.[ref]
The likelihood-ratio test of independence in a contingency table uses . The supplied with 6 statistical degrees of freedom gives . Its displayed 0.000 is rounded, not an exact zero. It corroborates the omnibus finding. The generalized phi coefficient is , the contingency coefficient is about 0.205, and Cramér's V is . These are unsigned measures of association strength rather than three additional significance tests; they do not describe causal effects or percentages of variance explained. Their magnitude and the small p-value answer different questions, especially with a large sample size.
The ordinal measures use the displayed order: increasing row index means increasing distrust, while increasing column index means decreasing efficacy. There are 882033 concordant pairs and 552543 discordant pairs. Hence Goodman and Kruskal's gamma is
Its positive sign therefore means that increasing distrust tends to accompany movement toward lower efficacy. Under an ascending efficacy order its sign would be negative, by sign reversal under reversal of one ordinal ordering. Goodman and Kruskal's gamma ignores tied pairs; it is not a claim that 23% of efficacy variation is explained. The displayed pair counts partition all unordered pairs correctly, including ties. Somers' D for efficacy given technology is about 0.151, Kendall's tau-b about 0.158, and Stuart's tau-c about 0.163. Their different denominators handle ties or table dimensions differently, so their differing magnitudes do not constitute disagreement about the direction.[ref][ref]
Goodman and Kruskal's lambda concerns the proportional reduction in errors when predicting a most frequent category, not ordinal movement. Without technology information the modal efficacy category is Medium, producing errors. Choosing a separate modal efficacy category in each technology row yields errors. Thus . In the reverse prediction direction the reduction is , matching the other printed lambda. The improvement in modal classification is small even though independence is decisively rejected. Both the conditional percentages and these distinct summaries support a real sample association; ethnicity and other possible confounders still require attention before any causal account.
Let be the population means of the numerical vaccination intention score in the two recorded groups. The two-sided hypothesis test compares
The sample means are and , giving a difference of sample means of approximately 0.01988 score points, in the order group zero minus group one. The reported group counts are 1,866 and 262; seven observations have a missing group indicator.
Welch's t-test divides that estimated difference by its estimated standard error. Its reported test statistic is , with approximately statistical degrees of freedom. This is an unequal-variance comparison; fractional statistical degrees of freedom are appropriate for the Welch approximation. The two groups need not have equal sample sizes or equal population variances.[ref]
The reported p-value is . Under the specified equal-mean null hypothesis and sampling model, a p-value measures the probability of a result at least as extreme as the observed one. It is not a posterior probability that the null hypothesis is true. There is no rejection at a prespecified 5% significance level. The observed difference of sample means is tiny relative to its estimated standard error.
The 95% confidence interval is approximately
It includes zero and differences in either direction. The interval's coverage refers to repeated use of the procedure under its assumptions, rather than to a probability assigned to this fixed unknown parameter or to the spread of individual scores. Nonrejection does not establish that the two population means are identical.
Simple random sampling supports the sampling interpretation, but the score is bounded and its raw distribution need not be a normal distribution. The large group sizes can support an approximate normal sampling distribution of the sample means under regularity conditions. The supplied observational study does not identify a causal explanation of any difference, and the numeric coding of the group labels creates no biological or ordinal interpretation.
Let and be the population means of the newspaper trust score for the unvaccinated and vaccinated groups. A two-sided hypothesis test compares
The observed difference of sample means is : the vaccinated group has a one-unit higher average trust score. The negative test statistic agrees with subtraction in this order. A Student's t-test scales the estimated difference by its estimated standard error; means that the observed difference is 3.6 estimated standard errors below the equal-mean null hypothesis.
Using the reported reference Student t-distribution with 747 statistical degrees of freedom,
Thus the equal-mean null hypothesis is rejected at a prespecified 5%, 1% or 0.1% significance level, subject to the test's assumptions. A p-value is a probability of a result at least this extreme under the specified null hypothesis and sampling model. It is neither the probability that the null hypothesis is true nor the probability that this particular conclusion is mistaken. A chosen significance level controls the procedure's type I error probability under that model.
The estimated difference is more informative than statistical significance alone. If the reported statistic uses this one-unit contrast, its estimated standard error is . The corresponding approximate 95% confidence interval is
This interval concerns a population mean difference under repeated sampling; it is not a range containing 95% of individual trust scores. Its practical interpretation also depends on the trust scale and the importance of a one-unit difference.
The groups are disjoint, so an independent-samples comparison is appropriate if the sampled observations are independent. The exact pooled Student's t-test additionally assumes common population variance and normal distributions; Welch's t-test permits unequal variances and uses an approximate reference distribution. A bounded or ordinal rating need not be exactly normal, so treating it numerically and using a large-sample approximation also requires judgment about group sizes and the score's meaning.
There is a bookkeeping qualification. The later outputs use 748 observations. If these are also the complete observations for this two-group comparison, the pooled test has statistical degrees of freedom, and the Welch degrees of freedom upper bound is also 746. The printed 747 therefore needs the original test call or a different sample count to reconcile it. The reported-calibration calculation above answers the stated test; it does not invent group sizes or silently change the reference distribution.
The evidence supports an association between higher newspaper trust and recorded vaccination, rather than a causal effect of trust. An observational study does not rule out confounding, selection bias or reverse causation. A statistical hypothesis test cannot supply those missing causal assumptions.
The association remains positive within each income group, although its estimated size is smaller in the higher-income groups. The two extreme trust categories give the following conditional vaccination percentages and differences:
Annual household incomeLowest trustHighest trustDifference in percentage points
Below £20,00036.36%89.60%53.24
£20,000–£40,00050.00%93.10%43.10
£40,000 and above66.67%91.14%24.47
In the lowest-income group, the intervening percentages are 42.86%, 44.12% and 82.54%, so the increase is monotone. Its Pearson chi-squared statistic is approximately 62.520 on four statistical degrees of freedom, with the printed asymptotic . Cramér's V is approximately 0.441, Goodman and Kruskal's gamma is approximately 0.626 and the column-dependent Somers' D is approximately 0.259. The column-dependent Goodman and Kruskal's lambda is approximately 0.158: trust improves the modal prediction more here than in the pooled table.
In the middle-income group, the intervening vaccination percentages are 61.54%, 81.82% and 92.04%. The printed Pearson chi-squared statistic is approximately 24.033 on four statistical degrees of freedom, with asymptotic . Cramér's V is approximately 0.298, Goodman and Kruskal's gamma approximately 0.454 and column-dependent Somers' D approximately 0.100. Column-dependent Goodman and Kruskal's lambda is zero: vaccinated respondents are the majority in every row, so the modal prediction never changes. A zero lambda does not mean independence.
In the highest-income group, the intermediate vaccination percentages are 71.43%, 76.92% and 94.55%; the final category falls slightly to 91.14%. Thus the observed pattern is broadly positive rather than strictly monotone. The printed Pearson chi-squared statistic is approximately 8.199 on four statistical degrees of freedom, with asymptotic . It does not reject independence at 5%. The corresponding Cramér's V is approximately 0.229, Goodman and Kruskal's gamma approximately 0.281 and column-dependent Somers' D approximately 0.058. The column-dependent Goodman and Kruskal's lambda is again zero.
Small counts limit the asymptotic tests, especially in the middle- and highest-income tables. Their minimum expected counts are approximately 0.644 and 0.306, with respectively 30% and 40% of cells below five. The lowest-income table has one expected count below five, with minimum approximately 3.315. These diagnostics concern expected counts under independence, not just the observed row sizes.
The supplied counts are sufficient to make an exact conditional Pearson test for a binary contingency table, without needing individual records or assuming a chi-squared distribution approximation. Conditioning on the row totals and total unvaccinated count removes the common unknown binomial probability. For each admissible table, sum its multivariate hypergeometric distribution probability when its Pearson chi-squared statistic is at least the observed one. Complete enumeration gives:
Income groupEnumerated tablesExact conditional p-value
Lowest507150
Middle22379
Highest2585
These are new exact conditional calculations, rather than the paper's printed asymptotic p-values. They confirm evidence of association in the first two groups and nonrejection at 5% in the third, while showing the numerical effect of sparse cells. The tail is ordered by the Pearson chi-squared statistic; an exact test with a different ordering need not have the same p-value. Fixed-margin Monte Carlo tests approximate this same Pearson-ordered tail when enumeration is impractical.[ref]
The original count-based figure below includes pointwise approximate 95% Wilson intervals. The very wide intervals for sparsely populated trust categories make the uncertainty visible; they are not simultaneous intervals or a formal test of differences between income groups.
Figure 1.
Recorded vaccination by NHS trust within household-income groups, with pointwise Wilson intervals
. Original plot from the supplied table counts. Connected categories show their order without assuming equal numerical trust increments. The intervals concern conditional proportions, and the figure does not identify causal effects. Details.
In the elaboration model, the positive direction is replicated after conditioning on income: income does not fully explain away the observed trust–vaccination relationship. The decreasing estimated contrasts and ordered coefficients suggest possible specification by income, or effect modification on an explicitly chosen scale. They do not establish it. Different p-values can arise from different sample sizes and standard errors; significant and nonsignificant results need not differ significantly. A formal statistical interaction test or a confidence interval for differences between comparable contrasts would address that question.[ref]
Nor do these conditional tables prove that income is a causal confounder or causal mediator. Those labels require assumptions about causal order, relevant confounding and how variables were measured. This is an observational study of recorded vaccination status, not a randomized change in trust or a test of vaccine effectiveness.
Each row of the contingency table is a conditional distribution of the safety category among respondents with that experience status. Thus the relevant comparison uses row percentages, rather than interpreting the larger number of respondents with some bad experiences as itself an effect on safety.
The sample proportions reporting feeling very safe are without bad experiences and with some bad experiences: the latter is lower by about percentage points. Feeling fairly safe rises from to , a difference of about percentage points. Feeling unsafe changes only from to , about percentage points. The main descriptive shift is therefore from very safe toward fairly safe, rather than a large increase in the unsafe category.
Pearson's chi-squared test tests the null hypothesis that experience status and safety category are independent. If that were true, the expected cell count would be its row total times column total divided by . The Pearson chi-squared statistic sums squared observed-minus-expected count differences divided by their expected counts. Here
The expected counts are comfortably large, with minimum approximately , so the ordinary large-sample chi-squared distribution approximation is appropriate under the sampling assumptions. There is evidence against independence even at the significance level. The reported likelihood-ratio result gives the same conclusion.
Magnitude is a separate question. Cramér's V gives
which describes a weak statistical association. It does not mean that of safety is explained. Nor does the p-value measure the size of that association.
For ordinal direction, order the experience categories as none, some, and the safety categories from very safe toward unsafe. Goodman and Kruskal's gamma compares concordant pairs with discordant pairs after excluding tied pairs:
Its small positive sign then corresponds to a weak tendency toward less safety among respondents with bad experiences. The sign would reverse if exactly one category ordering were reversed. Because this contingency table has many ties, the response-direction Somers' D, which retains response ties among pairs with different predictor values, is smaller:
These coefficients describe ordered association; the omnibus Pearson's chi-squared test tests any departure from independence and does not supply a separate p-value for gamma.
The column-dependent Goodman and Kruskal's lambda makes the weak predictive improvement tangible. Predicting the overall most frequent safety category makes errors in this table. Using a separate most frequent category within each experience row makes , giving , only about a reduction in those classification errors.
The sample supports a statistically detectable but weak association, chiefly a reduced sample proportion feeling very safe. This observational study does not establish that bad experiences cause the change: reverse direction, reporting differences or confounding could also contribute. The numerical p-value also presumes the sampling and complete-case assumptions appropriate to the observations used.
The ordinary least squares fit estimates the conditional mean of the continuous safety response as a linear function of the income coding:
The regression coefficient for income is positive. Since larger response values mean greater safety, one additional coded income unit corresponds to an estimated increase of safety-scale units in the fitted mean. Following the question's stated units, a unit is a £10,000 income step. The observed coding also uses income bands with open end categories, so this is a linear trend per coded band step; it is not evidence of a known constant effect for every extra pound, especially within the open top band. The output's abbreviated variable label does not override the stated units.
The intercept is the fitted mean at income code zero. It is estimated as , but zero is outside the observed income codes, so that value is an extrapolated model baseline, not an observed estimate for a particular income category. Its small p-value tests a zero intercept; it is not the main test of the income association.
For the income coefficient, the standard error is . The reported test statistic and two-sided test give
providing strong evidence against the null hypothesis of zero linear slope under the stated model assumptions. A Student t confidence interval, using residual statistical degrees of freedom, is
This is an interval for the population linear coefficient under the model, not an interval containing of individual safety scores. The large-sample estimate is precise enough to detect a positive association, but that does not establish substantial individual predictive power.
The coefficient of determination is : the fitted line accounts for about of the in-sample variation about the response sample mean. The adjusted coefficient of determination is about . Thus income alone explains very little of the observed variation, despite the small slope p-value. The residual standard error of response units describes substantial scatter about the fitted line. This is an estimated residual standard deviation, rather than the standard error of the slope or a complete individual prediction interval.
The overall F-test has on statistical degrees of freedom and . With one predictor and an intercept, it tests the same zero-slope hypothesis as the coefficient Student's t-test; , up to rounding. It is not an additional independent confirmation. In this simple linear regression, the Pearson correlation coefficient has the slope's sign and magnitude , another description of the weak linear association.
The regression uses complete observations and estimates two coefficients, giving residual statistical degrees of freedom. The deletion of observations is complete-case analysis; extending its conclusions to the full target population requires suitable assumptions about the missing-data mechanism. Classical reported standard errors also rely on an adequate linear conditional mean, independent errors and homoscedasticity; a normal linear model gives the finite-sample Student t-distribution and F-test calibration, while large-sample approximations can justify similar tests under weaker distributional assumptions. The printed summary alone does not establish these assumptions. Regression diagnostics and, where appropriate, heteroskedasticity-consistent standard errors address different parts of that assessment.
Finally, this unadjusted observational study estimates an association. Other covariates, such as age or experience status, may be related to both income and reported safety. Without additional design or causal identification assumptions, the positive fitted slope does not establish that increasing income would cause an increase in safety.
TODO: the numerical results, association direction and statistical evidence are unavailable. The required output includes the actual fitted model, estimates and uncertainty, test statistics, statistical degrees of freedom, p-values and an appropriate model-fit summary. An age-adjusted regression coefficient, if reported, would describe a conditional association under that model rather than the same estimand as an unadjusted correlation. Irrespective of its numerical outcome, this observational study does not by itself show that executive power changes real-life friendliness.
Several mechanisms could explain an observed association without a causal effect of power on friendliness. No exposure was assigned, so this is an observational study. Age, organizational role, wealth, gender, industry, public prominence or other common causes could produce confounding. Reverse direction is also possible: interpersonal behavior might influence advancement and hence power. Adjusting for age alone would not remove every alternative explanation.
The measured outcome is perceived friendliness from a photograph. Facial expression, pose, lighting, clothing, attractiveness and familiarity could affect those ratings independently of everyday behavior. If raters recognize an executive or know their status, expectations could alter the outcome; financial experts' power ratings may themselves involve judgment and measurement error. These are construct validity issues, since a photographic impression need not measure friendliness toward colleagues.
The preselected thirty executives are not a probability sample of all workers or even necessarily of all executives. Selection bias, narrow representation and restriction of range could alter associations and limit external validity. Multiple ratings of the same executive are also not independent executive observations; ignoring that structure would be pseudoreplication. These possibilities apply whether the reported association is positive, negative or inconclusive; the unavailable numerical findings are not assumed.
Use logistic regression when the response variable is binary, for example whether a lecturer missed a deadline. It relates the event's log odds to one or more predictors, producing fitted probabilities between zero and one. Exponentiating a coefficient gives an odds ratio for a specified predictor change, conditional on the other model terms. An odds ratio is not generally a ratio of probabilities; the corresponding probability change depends on the starting probability and other predictors.
Report the outcome coding, estimated associations with confidence intervals, and relevant model checks. Sparse events, complete separation and dependent observations can make ordinary estimates or inferential procedures unreliable; repeated observations may need a generalized linear mixed model. For prediction, evaluate calibration and discrimination on data not used to tune the model. An adjusted association in an observational study does not automatically identify a causal effect.
The supplementary excerpt uses an adjusted observational study and a two-sample Mendelian randomization analysis.
The observational study examines co-occurrence of hypercalcaemia and migraine diagnoses in electronic health records, adjusting for age, sex, and ancestry. Its adjusted odds ratio is 1.58, with .
The two-sample Mendelian randomization analysis combines the associations of eight genetic variants with serum calcium and with migraine, using a weighted genetic risk score. It estimates an odds ratio of 1.80 per genetically predicted 1 mg/dL higher serum calcium, with 95% confidence interval . The weighted-median Mendelian randomization estimator and MR-Egger regression provide sensitivity analyses.
The measured and instrumented exposure is serum calcium, rather than dietary calcium intake itself. Calcium intake and serum calcium are not interchangeable interventions, and an odds ratio of 1.80 is an odds contrast rather than necessarily an 80% increase in probability. The shortened excerpt supplies two approaches; a further analysis in the full research paper is outside this excerpt.
For the electronic-record observational study, three strengths are:
Three weaknesses are:
For two-sample Mendelian randomization, three strengths are:
Three weaknesses are:
Thus the agreement supports the hypothesis, but does not establish the effect of a dietary intervention.
First, an observational study can suffer from confounding or reverse causality. Ill health may both lower circulating vitamin D and raise mortality, while lifestyle, socioeconomic status, and comorbidity may affect both variables. Randomization breaks these baseline associations in expectation.
Second, the interventions answer different questions. Supplementation may be too small, too late, too short, or poorly adhered to, and an average effect can be nearly zero when benefit is confined to people with severe deficiency. Such heterogeneous treatment effects can coexist with a strong observational gradient.