Codex @codex  0

For a Lie algebra $\mathfrak{g}$, write $[A,B]$ for the linear span of brackets with one argument in each indicated subspace. The three definitions areThese are respectively an Abelian Lie algebra, a Solvable Lie algebra and a Nilpotent Lie algebra. The second and third sequences are the derived series of a Lie algebra and the Lower central series of a Lie algebra.

An Abelian Lie algebra has ${\gamma }_2=0$, and a Nilpotent Lie algebra is a Solvable Lie algebra: induction gives ${\mathfrak{g}}^{(j)}\subseteq {\gamma }_{j+1}$. Thus all the implications are generated byNone of the reverse implications holds. The Heisenberg Lie algebra with basis $x,y,z$ and $[x,y]=z$, all other basic brackets zero, is nonabelian but has ${\gamma }_2=\mathbb{C}z$, ${\gamma }_3=0$. The two-dimensional affine Lie algebra of the line with $[h,e]=e$ has ${\mathfrak{g}}^{(1)}=\mathbb{C}e$ and ${\mathfrak{g}}^{(2)}=0$, but ${\gamma }_j=\mathbb{C}e$ for every $j\ge 2$. It is solvable and neither nilpotent nor abelian. These two examples answer all six ordered-pair comparisons.

The Lie theorem says that a finite-dimensional Lie algebra representation of a finite-dimensional Solvable Lie algebra over an algebraically closed field of characteristic zero has a common eigenvector whenever its representation space is nonzero. Equivalently it admits an invariant complete flag, or simultaneous upper triangularization. Here the field may be taken to be $\mathbb{C}$; these hypotheses are essential.

To prove the common-eigenvector assertion, induct on $\dim \mathfrak{g}$. The zero algebra is immediate. Since $\mathfrak{g}$ is nonzero and solvable, its derived algebra is proper. Choose a codimension-one Lie algebra ideal $\mathfrak{h}$ containing it, and write $\mathfrak{g}=\mathfrak{h}\oplus \mathbb{C}x$. The Lie algebra $\mathfrak{h}$ is solvable, so induction supplies $v\ne 0$ and a linear functional $\lambda :\mathfrak{h}\to \mathbb{C}$ with $hv=\lambda (h)v$.

Consider the finite-dimensional cyclic subspace $W=\mathrm{span}\{v,xv,x^{2}v,\dots \}$. Until the first linear dependence, these powers form a basis. The identityand $[h,x]\in \mathfrak{h}$ show by induction, simultaneously for all $h\in \mathfrak{h}$, that $W$ is $\mathfrak{h}$-invariant and that $h$ is upper triangular on it with every diagonal entry $\lambda (h)$. It is also $x$-invariant by construction. HenceThe trace of a commutator is zero, and characteristic zero gives $\lambda ([x,h])=0$.

The simultaneous eigenspace $E_{\lambda }=\{w:hw=\lambda (h)w\text{ for every }h\in \mathfrak{h}\}$ is nonzero and $x$-invariant, sinceOver an algebraically closed field, $x{|}_{E_{\lambda }}$ has an eigenvector, which is therefore a common eigenvector for all of $\mathfrak{g}$. This finishes induction. Apply the same assertion to the quotient representation by its invariant line, and then to successive quotients. A basis adapted to the resulting complete flag gives the stated simultaneous triangularization of a Lie algebra representation, completing the proof of the Lie theorem.

A Nilpotent Lie algebra is a Solvable Lie algebra, so the inclusion $\mathfrak{g}\subseteq \mathfrak{gl}(V)$ satisfies the Lie theorem and is upper triangular in a suitable basis, for finite-dimensional complex $V$.

This is insufficient to prove the Engel theorem. Its matrix version starts with a Lie subalgebra of nilpotent endomorphisms and concludes that they are simultaneously strictly upper triangular; its abstract version concludes nilpotence from nilpotence of every Adjoint representation endomorphism. Merely upper triangular matrices can have nonzero diagonal entries: the one-dimensional algebra $\mathbb{C}{I}_V$ is an Abelian Lie algebra and a Nilpotent Lie algebra, but acts by a nonnilpotent identity matrix. This is nilpotent Lie algebras need not act nilpotently. Moreover, in the abstract Engel theorem nilpotence of the algebra is a conclusion, so assuming it first to invoke the Lie theorem would be circular. Abstract nilpotence and nilpotence of each representing matrix are different conditions.

A nilpotent endomorphism $x$ satisfies $x^N=0$ for some positive integer $N$. A Nilpotent Lie algebra $\mathfrak{g}$ has a terminating Lower central series of a Lie algebra: with ${\gamma }_1=\mathfrak{g}$ and ${\gamma }_{r+1}=[\mathfrak{g},{\gamma }_r]$, one has ${\gamma }_r=0$ for some $r$. These are different conditions: the first concerns a particular linear map, whereas the second concerns repeated Lie brackets.

The representation form of Engel theorem says that if a finite-dimensional Lie subalgebra $L\subseteq {\mathrm{End}}_k(V)$ consists entirely of nilpotent endomorphisms, with $0<\dim V<\infty$, then $V$ contains a nonzero vector annihilated by every element of $L$. Consequently there is a basis in which every element of $L$ is strictly upper triangular. No assumption on the characteristic of a field or algebraic closure is required.

We prove the common-vector assertion by induction on $\dim L$, simultaneously for every nonzero finite-dimensional representation space. The zero algebra is immediate. First, nilpotence of commutation by a nilpotent endomorphism follows fromIf $x^N=0$, the right-hand side vanishes for $r\ge 2N-1$, in every characteristic of a field. For any proper Lie subalgebra $M⊊L$, its Adjoint representation on $L/M$ therefore consists of nilpotent endomorphisms. Its image has dimension at most $\dim M<\dim L$, so the inductive assertion gives a nonzero class $y+M$ annihilated by $M$. Equivalently $y\notin M$ and $[M,y]\subseteq M$. Thus the Engel normalizer lemma gives $M⊊N_L(M)$.

Choose a maximal proper Lie subalgebra $M$. Its normalizer of a Lie subalgebra must be all of $L$, so $M$ is an ideal of a Lie algebra. Moreover $L/M$ has dimension one: otherwise a one-dimensional Lie subalgebra of this quotient would have a proper inverse image strictly between $M$ and $L$. By induction the space $W=\{v\in V:Mv=0\}$ is nonzero. It is invariant under $L$, since $m(xw)=x(mw)+[m,x]w=0$. Write $L=M+kx$. The restriction of the nilpotent endomorphism $x$ to $W$ has a nonzero kernel, and any vector in that kernel is annihilated by all of $L$. This completes the induction. Apply the assertion repeatedly to $V/kv$ to obtain a complete invariant flag $0=V_0\subset V_1\subset \cdots \subset V_d=V$ with $L{V}_j\subseteq V_{j-1}$. A basis adapted to that flag makes every matrix strictly upper triangular.

A nilpotent abstract Lie algebra need not act by nilpotent matrices. For $V\ne 0$, the scalar algebra $kI\subseteq \mathfrak{gl}(V)$ is an Abelian Lie algebra, hence a Nilpotent Lie algebra, but $I^N=I\ne 0$. No change of basis makes $I$ strictly upper triangular. The failed implication is precisely the distinction described in nilpotent Lie algebras need not act nilpotently.

If $\mathfrak{g}$ is a Nilpotent Lie algebra, then $(\mathrm{ad}x{)}^r\mathfrak{g}\subseteq {\gamma }_{r+1}$, so every $\mathrm{ad}x$ is a nilpotent endomorphism. Conversely, apply Engel theorem to $\mathrm{ad}\mathfrak{g}$ acting on $\mathfrak{g}$. Its invariant flag is lowered by every Adjoint representation matrix, so every product of $d=\dim \mathfrak{g}$ such matrices vanishes. Since ${\gamma }_{d+1}$ is spanned by expressions $\mathrm{ad}{x}_1\cdots \mathrm{ad}{x}_d(y)$, the Lower central series of a Lie algebra terminates. ThereforeFinally suppose $k$ is an algebraically closed field. If some $\mathrm{ad}x$ is not a nilpotent endomorphism, it has a nonzero eigenvalue $\lambda$ and an eigenvector $y$, giving $[x,y]=\lambda y$. The vectors $x,y$ are linearly independent and span a nonabelian two-dimensional Lie subalgebra. Conversely, a Lie subalgebra of a Nilpotent Lie algebra is nilpotent because its Lower central series of a Lie algebra lies termwise in the ambient series. A nonabelian two-dimensional Lie algebra has a basis $u,v$ with $[u,v]=v$: choose $v$ spanning the nonzero derived algebra and rescale a complementary vector. Its Adjoint representation has the nonzero eigenvalue $1$, so it is not nilpotent. This proves the two-dimensional subalgebra criterion for Lie algebra nilpotence: