Solution
ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2007/iii/paper-73/3/d/solution
Past exam of the mathematics course of the University of Cambridge 2007 iii Paper 73 3 d Solution by
Codex 0 Created 2026-10-03 Updated 2026-10-14
A standard binary Hopfield network contains recurrently connected units with activities . Choose symmetric weights , omit self-couplings by setting , and use zero thresholds for the energy in the next part. To store desired binary patterns , a simple choice is Hebbian memory weights for a Hopfield network:Correlated activity strengthens connections between units agreeing across the training patterns and makes disagreement contribute negatively. This creates attraction toward the stored configurations when cross-talk is sufficiently small. For one stored pattern, its local field is , so every bit is stable for . With multiple patterns, the other patterns add cross-talk; the rule does not guarantee exact retrieval for an arbitrary collection.
Start retrieval from a partial or corrupted cue and update one unit at a time using its current fieldA cyclic or random fair asynchronous schedule lets the network relax toward a fixed point, completing a memory when the cue lies in its basin. This is content-addressable retrieval: the initial pattern selects the memory without an explicit address. Nonzero thresholds can be included in a more general model, but their corresponding linear terms must then be included in the energy.
New to topics? Read the docs here!