If the parametric score function has zero conditional expectation given a covariate , it is orthogonal to the centered functions of that form the covariate-density nuisance tangent space. Its efficient score then equals its parametric score function, and the unknown covariate distribution causes no loss of Fisher information. This applies to Gaussian regression scores and more generally to regular conditional models with unrestricted covariate distribution and no additional nuisance components.
Alan M. Zaslavsky 2026-11-05
Alan M. Zaslavsky develops statistical methods for measuring health-care quality and disparities. His research includes missing data, hierarchical Bayesian models and Bayesian inference, bringing statistical adjustment to comparisons between health-care providers and populations.[ref]
https://www.hcc.harvard.edu/members/alan-mark-zaslavsky. First-person institutional research profile
With Fan Li and Kari Lock Morgan, he developed a framework for balancing covariates through propensity score weighting. Their overlap weights emphasize people with a substantial chance of receiving either treatment, defining an overlap-weighted average treatment effect for that comparison population.[ref]
Baseline covariate Created 2026-10-07 Updated 2026-11-05
A baseline covariate is measured before treatment assignment or the exposure being studied. A prognostic baseline covariate predicts the outcome. In a randomized controlled trial, adjusting for such a covariate can improve statistical efficiency without conditioning on a consequence of treatment. For instance, a measurement taken before treatment can explain persistent between-subject variation in a later measurement.[ref]
Adjusting for Covariates in Randomized Clinical Trials for Drugs and Biological Products by the FDA. May 2023, Sections I–II, printed pp. 1–2: prognostic baseline covariates and precision
Here is a linear regression example with explicit noise assumptions. Letwhere treatment is independent of the baseline covariate , all displayed variances are finite, and . ThenThe first identity uses the law of total variance. It isolates the unexplained population variation removed by adjustment for . For , and , this variation falls from to . Estimating additional coefficients still uses data, so this population calculation is not a guarantee that every finite-sample reported standard error becomes smaller. Measurement before treatment also does not by itself make a covariate prognostic or establish a causal effect.
Component and marginal effects in zero-inflated regression Created 2026-10-06 Updated 2026-11-05
A logarithmic count-component contrast multiplies the susceptible mean by , while a zero-logit contrast multiplies the structural-zero odds by . If the baseline zero predictor is , the marginal mean ratio isThus the count ratio alone is not a population-average effect when a covariate changes both components. With interaction terms, the relevant count contrast must first include the interactions for the stated reference group.
Conditional front-door adjustment Created 2026-09-28 Updated 2026-11-05
Conditional front-door adjustment applies the front-door argument within strata of observed covariates and then averages over those covariates. The covariates must remove exposure-mediator confounding, while the exposure together with the covariates must remove mediator-outcome confounding.
Conditional logistic model for longitudinal binary data Created 2026-10-07 Updated 2026-10-14
A logistic regression can specify each binary response conditionally on recorded past outcomes and baseline covariates. A chain rule for probabilities gives the path likelihood as the product of the conditional Bernoulli distribution masses. This permits dependence within a person's history without treating their outcomes as unconditionally independent. The model must specify the initial history and which past features enter its conditional mean.
Conditional randomization test Created 2026-09-28 Updated 2026-11-05
A conditional randomization test tests by resampling the tested variable from its conditional law given the remaining covariates. For independent sample rows, hold the observed fixed and draw each replacement vector from the true product conditional law of . Under the null hypothesis, the original and these replacements are conditionally exchangeable. Applying the same prespecified test statistic and fitting rule to every dataset therefore gives the valid rank-based Monte Carlo testThe add-one convention and conservative treatment of ties give finite-sample type I error control. Other resampling constructions are possible when they preserve the same conditional exchangeability.[ref]
Replacing the true conditional law by an estimate does not automatically preserve that guarantee. For a counterexample without , let the true be a fair Bernoulli random variable and let be constant, so independence holds. If the resampling model incorrectly uses and the test statistic is , the model assigns upper-tail probability whenever the observed . That event actually occurs with probability , so the limiting simulation test rejects far more often than level permits.
Estimated conditional models require a separate calibration or approximation argument. More resamples reduce Monte Carlo error but do not correct a wrong conditional law. The method tests conditional independence; interpreting it as a causal effect test requires the appropriate additional causal inference assumptions.
Confounder Created 2026-09-24 Updated 2026-11-05
A confounder is a pretreatment variable relevant to removing confounding for a specified treatment-outcome question. A common cause with arrows is a basic example: it creates a backdoor path between treatment and outcome .
Association with both variables is not a sufficient definition. In an appropriate causal directed acyclic graph, conditioning on a common effect can instead introduce collider bias. A confounder is a causal adjustment role, rather than any predictor with a small p-value.
One precise definition identifies a confounder as a member of some minimal sufficient adjustment set: there is a set containing that makes the relevant potential outcomes independent of treatment, and no proper subset of that set does so. The role can therefore depend on which other covariates are available and on the effect being estimated. A variable that merely reduces residual bias need not satisfy this definition.[ref]
On the definition of a confounder by Tyler J. VanderWeele and Ilya Shpitser. Sections 1–3 and concluding remarks: association-only criteria and the minimally sufficient adjustment-set definition
Counting-process intensity in survival analysis Created 2026-10-06 Updated 2026-11-05
An observed event counting process has conditional increment , where is the at-risk process. The filtration records the past observed events, censoring, and covariates; the integral of is the compensator of a counting process.
Covariate Created 2026-10-05 Updated 2026-11-05
A covariate is an observed explanatory variable used to model the conditional distribution of a response. A vector of covariates can enter a linear predictor, a treatment-effect adjustment or a hazard multiplier. Conditioning on a covariate does not itself establish that its effect is causal.
Covariate balance Created 2026-09-24 Updated 2026-11-05
Covariate balance means that the compared treatment groups have similar distributions of specified pretreatment covariates. Exact distributional balance in a weighted population isThis is a property of the represented covariates and chosen weights. Matching and inverse probability weighting can aim to approximate it.
Equal means are weaker than equal probability distributions. For example, a covariate taking values equally often in one group and equally often in the other has mean zero in both, but variances one and four. A zero standardized mean difference would miss that discrepancy. Inspect relevant spreads, tails, categories and combinations as well as means.
A nonsignificant difference test does not demonstrate covariate balance: small samples may have low statistical power, while large samples can detect negligible discrepancies. Covariate balance on measured pretreatment variables also cannot establish conditional exchangeability for unmeasured potential outcomes.
Covariate-dependent missing at random Created 2026-10-14 Updated 2026-11-05
For each fixed observation pattern, the probability of that pattern may depend on observed response components and fully observed covariates, but not on the response components missing under that pattern. Conditional missing completely at random is the special case with no dependence on observed response components either.
Covariate-dependent missing completely at random Created 2026-10-14 Updated 2026-11-05
Missingness depends only on fully observed covariates , not on the response after conditioning on them. A responder-only marginal estimate may still be biased when response rates and outcome probabilities both vary across covariate strata. MAR standardization over a fully observed covariate weights within-stratum respondent estimates using covariate frequencies from the whole target cohort.
Cox partial likelihood Created 2026-09-24 Updated 2026-11-05
In a Cox proportional-hazards model, . At distinct event times , let identify the event subject and let be the risk set immediately before . With covariates evaluated just before the event, the untied Cox partial likelihood isEach ratio is the conditional probability that the next single failure belongs to the observed subject, given its event time and current risk set. Substituting the hazards into this ratio cancels their common baseline hazard . With three subjects whose scalar covariates are , the probability that the third subject fails next is .
A risk set includes subjects who have entered observation and remain event-free and uncensored at that instant; delayed entry and time-dependent covariates must be represented accordingly. The usual inference requires appropriate independent censoring conditional on the modeled information. Tied recorded event times require a specified treatment, such as the Breslow approximation for tied event times, the Efron approximation for tied event times, or an exact tied-set conditional likelihood for its discrete-time model. These need not give the same objective as an arbitrarily ordered sequence of failures.[ref]
Cox–Snell likelihood pseudo-R-squared 2026-10-14
A likelihood-based analogue of the coefficient of determination compares the fitted and intercept-only log-likelihoods and :For a Cox proportional-hazards model, these are maximized partial likelihood logarithms with and without the covariates. The expression measures improvement in fit, rather than the fraction of variation in event times explained. Its attainable maximum can be below one. It does not test the proportional hazards assumption or establish predictive calibration.
Doubly robust estimation Created 2026-09-24 Updated 2026-11-05
Doubly robust estimation combines two nuisance functions so that either one can be correctly estimated while the other is misspecified. For example, let indicate treatment, covariates, , and . Under conditional exchangeability, positivity and the usual consistency of observed and potential outcomes, is the mean potential outcome under treatment .
For candidate functions with denominators bounded away from zero, the augmented signal isConditioning on shows thatThe bias vanishes if either nuisance function is correct. This algebra explains Double robustness and the second-order product bias. It does not protect against both models being wrong, failed Causal identification, or nearly zero denominators. cross-fitting helps when flexible functions are estimated from the same sample; valid confidence intervals require further rate and moment assumptions. The average treatment effect is .[ref]
Double/Debiased Machine Learning for Treatment and Structural Parameters by Victor Chernozhukov and others. arXiv v6, Section 5.1, equation (5.3), orthogonal average-treatment-effect score
With signed active covariate columns and their positive-definite Gram matrix , the displayed direction has unit norm and . Thus it makes equal angles with unit-length signed active covariates, and movement along it reduces their signed residual correlations at the common rate . The regression coefficient direction is , with inactive components zero.
Gaussian regression score Created 2026-10-07 Updated 2026-10-25
For a regression function , let . With independent centered normal distribution error of known variance , the parametric score function is . It has zero conditional expectation given the covariate, so unknown covariate-density nuisance directions do not remove any of its Fisher information.
G-computation Created 2026-09-28 Updated 2026-11-05
G-computation calculates the outcome distribution under a specified intervention from conditional laws identified under a causal model. For a single binary treatment, pretreatment covariates , and outcome , the G-formula isIt follows by averaging over , using conditional exchangeability to replace the conditional potential outcome mean by the mean among recipients of , and using consistency in causal inference to replace by observed . Positivity ensures the required conditional outcome laws are represented in the target strata.[ref]
Estimating causal effects from epidemiological data by Miguel A. Hernán and James M. Robins. Standardisation; Bibliographical notes on the g-formula; Appendix A.1
For an illustrative binary outcome, suppose target weights are and in two baseline strata. Untreated risks give intervention risk . Treated risks give , so the standardized causal risk ratio is and the risk difference is . Both strategies use the same target weights.
With repeated treatments and time-varying covariates, the longitudinal G-formula integrates products of the covariate transition laws while setting each treatment according to the intervention strategy. This requires sequential exchangeability, longitudinal positivity and consistency in causal inference. Simply conditioning on every observed intermediate variable can block part of the intended effect; the sequential intervention calculation specifies which laws are averaged.
Grouped proportional-hazards model 2026-10-14
When event times are observed only in intervals and the covariate vector is constant within an interval, a proportional hazards model gives . Thus the interval event probability has a complementary log-log link, with an interval-specific intercept. The person-period Bernoulli likelihood models several events in one interval directly, without inventing their order. It needs appropriate independent censoring assumptions and a consistent account of interval entry and observation.