Solution

ID: past-exam-of-the-chemistry-course-of-the-year-4-of-the-natural-sciences-course-of-the-university-of-cambridge/2022/paper-3/section-f/47/a/solution

Let be the input to output weight for datum , including for the bias. With identity output activation, . The chain rule gives
The are held fixed when differentiating an output-layer weight; they may be hidden-layer activations rather than raw descriptors. Hidden-weight derivatives require backpropagation through the preceding layers.

New to topics? Read the docs here!