Catastrophic interference (source code)

= Catastrophic interference

= Catastrophic forgetting
{synonym}

A severe loss of previously learned performance when updating a shared representation on new material. Overlapping parameters allow transfer but also let a new objective change computations needed for older examples. Interleaving and representation design can reduce the problem; the mere presence of a <neural network> does not imply inevitable catastrophic forgetting.