Unmodified Hebbian learning reinforces correlated input and output but has no mechanism limiting synaptic strength. The second rule adds activity-dependent negative feedback and stabilizes the norm at an input-scale-independent value, provided the input keeps exciting the output. The third has a cubic weight penalty independent of the instantaneous output; its equilibrium norm instead depends on the strength of the input second moment.
For the third averaged rule, an equilibrium along eigenvector has radial linearized eigenvalue and transverse eigenvalues . Thus a positive simple largest eigenvalue gives stable equilibria in its two opposite directions, whereas lower eigen-directions are unstable to larger components. With generic initial weights, it learns the dominant correlation direction, linking the rule to principal component analysis. These are idealized normalization and feature-extraction mechanisms, not claims that biological synapses implement these exact equations.
The fixed points are and . The Jacobian matrix is
At the origin its eigenvalues are , so it is a saddle with stable direction the y-axis. At either other fixed point, the characteristic polynomial is , giving eigenvalues . Thus both are stable foci. The nullclines are , and . In the right half-plane grows below and decreases above it; in the left half-plane these horizontal arrows reverse. Vertically, increases below and decreases above it.
A global argument determines the requested omega-limit sets, rather than guessing from the local phase portrait. For , use the quadratic-logarithmic Lyapunov function for a feedback system
Its sublevel sets are compact and bounded away from , so trajectories starting in either half-plane exist for all positive time and stay in such a set. Since decreases, it tends to a limit, and is constant on the omega-limit set. Every point of that set therefore has . Invariance then requires , so only the corresponding focus can occur. Also preserves its sign.
Consequently
On , the exact solution is . The phase portrait below shows this stable axis, the nullclines and the spiral attraction in each half-plane.
Figure 1.
Phase portrait with a saddle at the origin and stable foci at plus or minus one, one
. Details.
If , then . On the perpendicular plane, vanishes and is a signed right-angle rotation, whose square is minus the identity. Hence its complex eigenvalues are , and
Let denote the cross product matrix, with . Then
The two eigenvalue calculations use an orthonormal basis adapted to .
Substituting an exponential particular solution gives , or . Since is not an eigenvalue of , the matrix is invertible. The exponential forcing of a constant-coefficient differential system therefore has
For the specified matrix, . Solving , gives , so
Differentiation verifies both component equations directly. If a general solution were desired, the homogeneous term would be added, with the matrix exponential here equal to because .
Decompose the electric field into its orthogonal parts , where . The uniaxial conductivity tensor acts on them as
If , its perpendicular and parallel components each vanish. Since and , this forces both field components to be zero. The contrapositive gives
Equivalently, the tensor has nonzero eigenvalues and determinant .
False; in fact no matrix with this spectrum is diagonalizable over . If a real invertible gave with a real diagonal matrix, all eigenvalues of would be the real diagonal entries of . But two of the required eigenvalues have nonzero imaginary parts. This contradiction proves
The real block form in the initial example is consistent with this: a two-dimensional rotation block is not a real diagonalization.
False. Consider the real matrix
It is block upper triangular, so its characteristic polynomial is the same as that of and it has the required eigenvalues. Its second column, however, has squared Euclidean norm , whereas every column of an orthogonal matrix has norm one. Thus
Unit-modulus eigenvalues alone do not imply orthogonality; they do not control the geometry of the eigenvectors.
True. All three eigenvalues are distinct in , so their nonzero eigenvectors are linearly independent. Here is a direct proof of that assertion. If , apply to obtain
Distinctness makes both scalar factors nonzero, hence . Applying the analogous products gives . The three eigenvectors therefore form a basis of . Taking them as the columns of gives
This proves that every such matrix is a diagonalizable matrix over , rather than merely showing it for the example.
Let . A concrete real matrix is
Its first coordinate has eigenvalue . The lower block has characteristic polynomial , whose roots are . Thus this example has all three required eigenvalues. It is also an orthogonal matrix, but orthogonality is not forced by its spectrum, as the second part shows.
Write . The simple pendulum becomes , . Its equilibria are . The linearization is . For even its eigenvalues are , and for odd they are . The conserved energy
has a strict local minimum at each even multiple of , proving nonlinear Lyapunov stability there. The odd multiples are saddles and are unstable. Therefore
The stable centres are not asymptotically stable because energy is conserved.
The saddle energy is , so the separatrix is determined by
Energy levels form closed libration curves around the centres; levels have velocity of constant sign and describe rotations. The separatrices join neighboring saddles in the unwrapped plane. On the angle cylinder, where is identified modulo , they are homoclinic to the single saddle.
Figure 1.
Pendulum energy levels, stable centres, unstable saddles and the separatrix
. Details.
At the positive separatrix has . Before reaching the neighboring saddle at , the velocity is , so the time to angle is
As , . The integrand is therefore asymptotic to , whose improper integral diverges logarithmically. Thus the pendulum separatrix approach takes infinite time:
Starting with velocity gives the reflected approach to and the same infinite time. The velocity tends to zero but never reaches zero at a finite time.
In orthonormal Cartesian coordinates, a second-rank tensor has components transforming under a change of axes as , where . Its contraction is invariant:
Thus is a scalar. This is tensor contraction with the Euclidean metric. In general nonorthonormal coordinates the invariant expression is , not an unweighted sum of diagonal covariant components.
For the planar plate, every mass element has . The inertia tensor is consequently
It follows directly that is an eigenvector and
The real symmetric matrix has three real eigenvalues. Its trace is , so . Hence the perpendicular axis theorem gives .
For a disc of constant areal density , symmetry gives , and polar integration gives . Therefore
where the scalar in the last expression denotes the total mass rather than the tensor.
Sylvester's law of inertia says that any real quadratic form has coordinates in which it is a sum of positive squares minus negative squares, with unused coordinates, and that the numbers are invariant under every invertible linear change of coordinates. Its rank is ; its signature of a quadratic form is commonly , with also called its signature pair.
The symmetric matrix here is , where and . On the line spanned by , has eigenvalue . If , then , so that the orthogonal complement has eigenvalue with multiplicity . Thus the off-diagonal all-ones quadratic form has
For the form vanishes, so rank and scalar signature are both zero, with inertia . Including this case is necessary because the distinguished eigenvalue then becomes zero.