Backfitting algorithm (source code)

= Backfitting algorithm
{wiki}

= Backfitting
{synonym}

The backfitting algorithm estimates each additive mean function by smoothing its <partial residual>, obtained after subtracting the current fits of all other terms, and cycling through terms until convergence. Centering each smooth separates its constant part from the intercept. For fixed quadratic smoothness penalties it is block coordinate minimization of a penalized least-squares objective; identifiability and positive definiteness of the constrained problem ensure a unique converged fit. Non-Gaussian <generalized additive models> can use weighted backfitting inside <iteratively reweighted least squares>.