Compositional generalization (source code)

= Compositional generalization

Generalizing known components or operations to combinations not encountered during training. A held-out combination split tests a different ability from random train–test splitting when both sets contain nearly identical constructions. A failure of a particular neural training setup does not prove a limitation of every network architecture.<Generalization without Systematicity: On the Compositional Skills of Sequence-to-Sequence Recurrent Networks by Brenden M. Lake and others>[Abstract and experiments; PMLR 80, pp. 2873–2882, systematic versus ordinary SCAN <generalization>]{ref}