Augmented inverse-probability-weighted estimator Created 2026-09-24 Updated 2026-11-05
An augmented inverse-probability-weighted estimator averages a regression prediction plus an inverse-probability-weighted residual. In the treatment setting of doubly robust estimation, let estimate the conditional outcome mean and the probability of receiving treatment . ThenThe first term predicts outcomes for everyone; the weighted residual corrects prediction errors using observed outcomes from the corresponding treatment group. The conditional-expectation calculation in doubly robust estimation makes the remaining bias a product of outcome-regression and propensity-score errors. An exactly correct outcome regression makes the residual correction mean zero even with an incorrect propensity score; a correct propensity score makes that correction repair the regression bias.
The nuisance estimates are commonly obtained by cross-fitting, with each observation evaluated using functions trained on other observations. Both treatment probabilities must remain positive on the population being studied, and small fitted probabilities can make the variance very large. Double robustness concerns consistency under one correct nuisance model; it does not automatically deliver valid finite-sample or asymptotic confidence intervals.
Doubly robust estimation Created 2026-09-24 Updated 2026-11-05
Doubly robust estimation combines two nuisance functions so that either one can be correctly estimated while the other is misspecified. For example, let indicate treatment, covariates, , and . Under conditional exchangeability, positivity and the usual consistency of observed and potential outcomes, is the mean potential outcome under treatment .
For candidate functions with denominators bounded away from zero, the augmented signal isConditioning on shows thatThe bias vanishes if either nuisance function is correct. This algebra explains Double robustness and the second-order product bias. It does not protect against both models being wrong, failed Causal identification, or nearly zero denominators. cross-fitting helps when flexible functions are estimated from the same sample; valid confidence intervals require further rate and moment assumptions. The average treatment effect is .[ref]
Double/Debiased Machine Learning for Treatment and Structural Parameters by Victor Chernozhukov and others. arXiv v6, Section 5.1, equation (5.3), orthogonal average-treatment-effect score
Past exam of the mathematics course of the University of Cambridge 2021 iii Paper 221 2 c Solution 2026-09-28
If Assumption 1 holds, put . Then , so conditional instrument independence givesConsequently both population estimating equations vanish at for any probability limit of .
If Assumption 2 holds, choose the linear-projection coefficientThen , whileThe first term is zero by conditional instrument independence and the second by the definition of . Thus solves the population equations. Under the nonsingularity condition from part b, the root is unique, so standard estimating equation consistency proveswhenever either Assumption 1 or Assumption 2 holds. This is double robustness.
Past exam of the mathematics course of the University of Cambridge 2025 iii Paper 221 4 b ii Solution Created 2026-09-24 Updated 2026-09-25
If both outcome models are correct, each residual term in the preceding conditional expectations has mean zero regardless of the working propensity model. Thus for , and their difference is again . This proves double robustness.