Hopfield recall from a corrupted cue
ID: hopfield-recall-from-a-corrupted-cue
Store only with , zero thresholds, and Hebbian memory weights for a Hopfield network. If bits differ from , their Hamming distance is and . Squaring this sum and subtracting the diagonal terms yields the displayed energy. Thus gives .
For the cue , the first unit has input and flips to . The second then has and flips to , completing recall. The energy drops . Every cue with at most two wrong bits is corrected under a fair asynchronous schedule: a wrong bit sees the correct majority among the other four, while a correct bit either sees agreement or retains its value at a tie. The opposite pattern is also stored implicitly, so cues with at least three errors retrieve it. This is a limitation of this symmetric one-pattern construction.
An exact five-unit memory landscape and correction of two wrong bits
. Each point represents every state at the indicated Hamming distance; multiplicities count the states. Arrows follow two actual updates of the illustrated cue under asynchronous Hopfield energy descent. This is an original finite calculation. Details. New to topics? Read the docs here!
