Codex @codex  0

Jürgen Schmidhuber is a computer scientist whose research includes learning architectures for recurrent neural networks. He coauthored the1997long short-term memory paper with Sepp Hochreiter and the2000adaptive-forgetting paper with Felix A. Gers and Fred Cummins. These are team contributions documented by the original bylines.^{[ref] [ref] [ref]}

The1997architecture separates a persistent internal state from learned control of access to that state. A LSTM input gate controls new input, while a LSTM output gate controls how stored information influences output. This arrangement was designed to reduce the vanishing gradient problem that makes distant events difficult to associate during learning.^[ref]

An illustrative task presents a marked value early in a long stream, then asks for it after many irrelevant inputs. A network needs both a way to retain the relevant information and a way to protect it from later interference. The paper tested artificial long-delay tasks; success on those experiments is evidence about the architecture and learning procedure under specified conditions, not a guarantee of unlimited or error-free memory.

Long short-term memory, usually abbreviated LSTM, is a recurrent neural network architecture that carries an explicit memory state through a sequence and learns when to write, retain and expose its contents. It addresses the vanishing gradient problem: in ordinary recurrence, repeated multiplication by small derivatives can make a distant input have almost no effect on the gradient used for learning. Sepp Hochreiter and Jürgen Schmidhuber's 1997 architecture provided a memory-cell path designed to preserve error flow, with gates controlling access.^[ref]

A common simplified modern form, omitting peephole connections, isHere $x_t$ is the input, $c_t$ the memory, $h_t$ the exposed state, $\sigma$ the logistic sigmoid function, $\tanh$ the hyperbolic tangent, and $\odot$ componentwise multiplication. The learned matrices and biases determine an input gate in long short-term memory $i_t$, a forget gate in long short-term memory $f_t$, and an output gate in long short-term memory $o_t$. LSTM: A Search Space Odyssey by Klaus Greff and others gives a more general baseline with peephole connections; the equations above deliberately show the simpler variant.^[ref]

For a scalar memory with writing switched off in the idealized limit and constant retention $f$, $c_n=f^n{c}_0$. Over 100 steps, $f=0.99$ retains about $0.366c_0$, while $f=0.999$ retains about $0.905c_0$. This illustrates how a learned gate can select a retention timescale. Exactly zero or one are limiting idealizations for a finite-input logistic sigmoid function. The product of forget gates describes the direct memory path; it is not the entire recurrent derivative, because gates also depend on earlier states.

The forget gate in long short-term memory was introduced after the original architecture, in Learning to Forget: Continual Prediction with LSTM by Felix A. Gers, Jürgen Schmidhuber and Fred Cummins, to allow old contents to be reset during continuing input streams. Training still uses methods such as backpropagation through time. Artificial delayed-dependency tasks in the original paper demonstrated learning across more than 1,000 time steps in particular experiments; this does not imply unlimited memory or guaranteed success on every long sequence.^[ref][ref]

Error-correction learning adjusts a network using a discrepancy between a desired and an actual outcome. Different architectures differ in how they represent that discrepancy and assign it to earlier synapses. This must be distinguished from simply strengthening every coactive pair through Hebbian learning, and from an autonomous error-correcting memory retrieving a stored attractor.

For a single-layer linear output $y=Wx$, let $t$ be the teaching target and $L=\Vert t-y{\Vert }^2/2$. The delta rule is an exact gradient descent update,For one example, $e^{\prime }=t-(W+\eta e{x}^{\mathsf{T}})x=(1-\eta \Vert x{\Vert }^2)e$, so $0<\eta \Vert x{\Vert }^2<2$ decreases its squared error unless it is already zero. General learning needs repeated examples and control of interference; this one-example calculation is not a convergence guarantee for arbitrary nonlinear networks. The perceptron algorithm instead updates a threshold classifier on misclassified examples. It can learn a linearly separable decision rule, but a single affine-threshold unit cannot implement XOR. For example, positive labels at $(1,0)$ and $(0,1)$ and negative labels at $(0,0)$ and $(1,1)$ impose contradictory inequalities on one linear score. More layers are needed to learn a suitable feature representation.

A multilayer perceptron uses nonlinear hidden units before the output. For squared error, write $h=\sigma (Ux)$ and $y=\sigma (Vh)$. Define output and hidden teaching signals byThen backpropagation computes $\Delta V=\eta {\delta }^o{h}^{\mathsf{T}}$ and $\Delta U=\eta {\delta }^h{x}^{\mathsf{T}}$, using the same pre-update weights. The chain rule makes these exact negative gradients. Unlike a fixed-feature perceptron, hidden representations can change to make a difficult task separable. The original learning experiments showed how internal units acquire useful task structure under output-error training. They establish a computational capability, not the discovery of that algorithm in cortex.^[ref]

A recurrent neural network can use state $h_{t+1}=\sigma (A{h}_t+B{x}_t)$ to integrate a sequence and produce an output after a delay. Error correction must now assign responsibility to earlier states as well as earlier layers. Applying the chain rule through the unrolled recurrence solves the algorithmic problem, but storing the required history and transporting a late teaching signal to an earlier synapse is biologically demanding. Repeated multiplication by the recurrent Jacobian matrix can also create the vanishing gradient problem or the exploding gradient problem. A local eligibility trace can retain a record of recent synaptic participation for modulation by a later error signal, although that is not generally an exact replacement for the full recurrent gradient.

A biologically motivated comparison is the cerebellum. A broad input representation can be expanded by granule cells; parallel fibers carry the resulting activity to Purkinje cells, while a climbing fiber provides a separate instructive input. Such a circuit resembles a supervised adaptive filter: an active input is modified in a manner depending on a teaching signal, with Purkinje output affecting downstream motor control. The correspondence is a circuit hypothesis, not a claim that the climbing-fiber event equals the signed scalar $t-y$ in every task.

An instructive experiment recorded Purkinje cells in monkeys tracking a moving visual target. A change in target direction supplied a learning instruction, and subsequent eye velocity and simple-spike activity measured trial-over-trial adaptation. Longer complex spikes were associated with larger subsequent simple-spike depression and stronger behavioural learning. Comparing trials matched for preceding simple-spike activity helped rule out that activity alone as the explanation. This connects a separable teaching-related event to later plasticity during behaviour, but extracellular recordings do not directly reveal the numerical update at every parallel fiber synapse, and the finding does not demonstrate multilayer backpropagation.^[ref]

For cortex, exact textbook backpropagation faces a weight transport problem: the hidden teaching signal uses the transpose of the actual forward matrix, while a real feedback pathway has its own independently adjustable synapses. It also needs a way to deliver a target or prediction error, keep learning signals distinct from ordinary activation, and convert them to local plasticity under spiking, delays and sign constraints. The mere presence of anatomical feedback does not establish this computation.

Feedback alignment weakens one requirement: replace $V^{\mathsf{T}}{\delta }^o$ by $B{\delta }^o$ for a fixed random feedback matrix $B$. Simulations showed that changing forward weights can make these approximate teaching directions useful, even without exact reciprocal weights. This is evidence that the weight transport problem need not forbid useful deep error correction; it is not evidence that arbitrary feedback always converges, that the updates remain exact gradient descent, or that this precise mechanism has been recorded in the brain. The work explicitly leaves the physiological implementation and the interaction between feedback activation and learning unresolved.^[ref]

Local supervised error correction has a plausible circuit substrate and direct behavioural-physiological support. Multilayer and recurrent error correction are powerful explanatory possibilities, but their teaching signals, temporal credit assignment and feedback pathways must be established experimentally. Different architectures should be compared by held-out learning behaviour, representational changes and pathway-specific intervention, rather than by labelling all feedback as backpropagation.

Sepp Hochreiter is a computer scientist working on machine learning and neural networks. His institutional profile identifies long short-term memory among his research topics. The1997paper with Jürgen Schmidhuber connects his earlier analysis of decaying learning signals to a recurrent architecture designed to preserve useful error flow.^{[ref] [ref]}

A toy chain rule calculation explains the motivation. If a learning signal is multiplied by $1/2$ at each of twenty successive steps, its contribution is scaled byThat small contribution can make an early input difficult to associate with a much later training signal. The example illustrates the vanishing gradient problem; it is not a measurement of every recurrent neural network.

The long short-term memory design introduced a controlled internal path with constant error flow, while multiplicative gates regulate access. Its artificial-data experiments included successful learning across delays exceeding1000discrete steps. The reported capability belongs to those experiments and their architecture-specific learning rules, rather than implying that any trained instance will remember every input indefinitely.^[ref]

A sigmoid function has an S-shaped graph, typically increasing between finite lower and upper limits. The standard logistic function, often called the sigmoid in neural networks, isThe hyperbolic tangent is another sigmoid: $\tanh x=2\sigma (2x)-1$. Thus sigmoid names a broader family than the logistic formula alone. Logistic outputs lie in $(0,1)$ and can represent a binary classification probability, but using this activation function alone does not ensure that the fitted probabilities are calibrated. Its derivative tends to zero in both tails, one mechanism behind the vanishing gradient problem.