Because is finite, choose with and an integer . Define
An equality of -term sums in plainly gives equality after applying this linear map. Conversely, equality of the images gives
where . Therefore , and then . The same estimate with one term on each side shows that is injective on . Hence is a Freiman s-isomorphism from to the subset .
For points , the restriction of to those points is the set of binary vectors
The shattering coefficient is
The VC dimension is
with value infinity when arbitrarily large finite sets are shattered.
If , then for every choice of points,
Thus every set shattered by is also shattered by , and
Now put and suppose that are shattered by
Consider the linear map
If , the rank-nullity theorem shows that is a proper subspace of . Choose a nonzero
and replace by if necessary so that at least one coordinate is positive.
Ask for the labeling that assigns label zero when and label one when ; coordinates with may be labeled arbitrarily. Shattering would supply such that
Every product is then nonnegative, and at least one is strictly positive. Hence
contradicting . Therefore , proving
This is the VC dimension of a vector space argument.
Finally, a closed Euclidean ball with center and radius is
where
Every such function lies in
whose dimension is at most . Applying the result just proved gives the VC dimension upper bound for Euclidean balls
Write . The generalized eigenspace decomposition of the linear map is
for any sufficiently large . Because is a derivation, the generalized-eigenspace bracket lemma gives
Consequently is a Lie subalgebra.
The set is the normalizer of a Lie subalgebra . Certainly . Conversely, if , then gives
On the direct sum of the nonzero generalized eigenspaces, is invertible. Hence the nonzero-eigenvalue component of vanishes, and
Now let be a Lie subalgebra containing . Since , the subspace is -invariant. The generalized zero eigenspace of the induced map on is the image of , hence is zero. If , then , so lies in that zero eigenspace. Thus and
A nilpotent Lie algebra is one whose lower central series
eventually reaches zero. Suppose is nilpotent and . Choose the least for which . Then , and any
satisfies . Therefore , proving the normalizer condition for a nilpotent Lie algebra
It remains to prove the converse needed here. The Engel lemma states that if a finite-dimensional Lie algebra of linear maps consists of nilpotent maps, then the maps have a common nonzero vector in their kernels. To prove it, induct on the dimension of the algebra. For a maximal proper subalgebra , induction applied to the action of on produces with . Thus is an ideal of codimension one. Induction also gives a nonzero common kernel
The ideal property makes invariant under ; a nilpotent representative of a basis of has a nonzero kernel on , yielding a vector killed by all of .
Apply the lemma to the Adjoint representation. It produces a nonzero element of the center of a Lie algebra. Induction on , followed by passage to the quotient by this center, proves Engel theorem: if every is nilpotent, then is nilpotent. The hypothesis says exactly that every is nilpotent, so
On the unit ball, part 1 controls the norm. Outside it, , so
Hence , proving that the embedding is continuous.
For compactness, let be bounded in . On each ball, it is bounded in , so the Rellich-Kondrachov compactness theorem gives a subsequence convergent in local . The tail estimate
is uniform in and tends to zero as . A diagonal argument therefore gives convergence in all of . This is the compact embedding of a confining-potential energy space.
Let be a Cauchy sequence in the operator norm. For each ,
so is a Cauchy sequence. Completeness of the Banach space permits the definition
. Pointwise passage to the limit proves that is a linear. A norm-Cauchy sequence is a bounded sequence, say , and therefore
, so is bounded. Finally, letting in
gives
. Thus in operator norm and
is Banach.
Choose bases of and , of dimensions and . A linear map is uniquely determined by the arbitrary images of the basis vectors, each with coordinates, so
Put and , and extend bases of to bases of . The condition forces the matrix entries from to a complement of to vanish and imposes no other restriction. Hence
For the last part let . Choose
A map in sends into itself, into , and into , with these choices independent. Therefore
Evaluating the function at the endpoint gives the displacement
Therefore
The force-induced displacement is a linear map of .
For , the function is differentiable at if there is a linear map such that
The linear map is unique and is the Frechet derivative . The function is continuously differentiable at if it is differentiable on a neighbourhood of and the map , with values in the space of linear maps equipped with the operator norm, is continuous at .
If is linear, then
Consequently at every . The derivative is a constant function of , hence is continuous, so every linear map is continuously differentiable everywhere.
The mean value inequality says that if the line segment lies in and
then
To prove it, put . The claim is immediate if . Otherwise set and apply the one-dimensional mean value theorem to the real-valued function
For some , the chain rule gives
as required.
Now suppose that is open and connected and that for every . Every point has an open ball contained in . The mean value inequality with shows that is constant on each such ball, so is locally constant. Fix . The level set
is nonempty and open in ; its complement is also open because is locally constant. Since is connected, . This proves the zero derivative on a connected open set result: is constant.
The inverse function theorem states that if is continuously differentiable, , and is an invertible linear map, then there are open neighbourhoods of and of such that is a bijection whose inverse is continuously differentiable.
For the curve in the question, define the continuously differentiable function
Then
The implicit function theorem, which follows from the inverse function theorem applied to , therefore gives an open interval containing , an open neighbourhood of , and a continuously differentiable, hence continuous, function such that
A bilinear form on is nondegenerate when
In finite dimensions this is equivalent to nondegeneracy in the first argument.
Define the linear map
Nondegeneracy makes injective. Since and its dual space have the same finite dimension, is an isomorphism. Similarly define and set
Then is linear and
If , this identity gives for every . Conversely, if for every , then for every , so nondegeneracy gives . Hence
This is the representation of a bilinear form relative to a nondegenerate bilinear form.
Write an element of the Integer Heisenberg group as . Matrix multiplication gives
The subgroup
is normal and isomorphic to . If , then
Thus, on the coordinate column , conjugation by is the linear map with matrix
Every element has a unique expression , so
The commutators fill the central subgroup of matrices , while the quotient by this subgroup is generated freely and abelianly by the images of and . Equivalently, is the second coordinate axis. Therefore the abelianization is
Write and . Expanding
gives
The off-diagonal terms in the first equation cancel. By the optimality condition for the proximal operator,
The second equation then becomes the explicit linear update
Thus each step of this preconditioned proximal point algorithm uses only one evaluation of the proximal operator of , together with applications of the linear map and its transpose .
Write for the all-one column vector. The parity-check extension of a linear code is
The defining map is linear, so is a binary linear code. If is a generator matrix and a parity-check matrix for , then one may take
The punctured code in, say, the last coordinate is
Coordinate deletion is a linear map, so is linear. Its generator matrix is obtained by deleting the last column of . If the minimum distance is at least two, deletion is injective on , and hence has the same dimension as .
For its parity-check matrix, first use invertible row operations on to make its nonzero last column a coordinate vector. The last column is nonzero because otherwise the weight-one word supported there would belong to , contrary to . Delete the pivot row and the last column; the resulting matrix is a parity-check matrix for . Equivalently, is obtained by shortening the dual code at the deleted coordinate.
Finally, the shortened code in the last coordinate is
It is linear whenever is linear, because it is the puncture of the subspace .
The rank-nullity theorem states that for a linear map with finite-dimensional domain,
Here the domain is , and the preceding parts give
which verifies the theorem.
For a linear map , its rank is and its nullity is . The rank-nullity theorem states that, when is finite-dimensional,
To prove it, take a basis of and extend it to a basis
of . The vectors span . They are also linearly independent: if , then , and independence of the chosen basis forces every to vanish. Thus the rank is and the nullity is .
For the given subspace, row reduction of the coefficient matrix gives
Taking and therefore gives
Hence
is a basis of .
The dual space is
the vector space of linear functionals on . If is a basis of a finite-dimensional , define . Every has the unique expansion
so the dual basis proves
For , its annihilator of a vector subspace is
If is a basis of and is extended to a basis of , then
Consequently
If , this dimension is positive, giving a nonzero functional that vanishes on .
For a linear map , the dual map is
Now
so
Every vanishes on , hence
The two spaces have the same dimension, since
Thus
Let be the quotient map. Since is onto, is injective, and the preceding identity gives
Therefore
For the inclusion , the map is restriction to . It is onto and has kernel
The first isomorphism theorem now gives the other duals of a subspace and its quotient:
Fix . The map is a linear functional, so the finite-dimensional Riesz representation theorem gives a unique vector such that
For scalars ,
Uniqueness gives
so is linear.
For , apply this result to
It produces a unique linear map satisfying
which proves existence and uniqueness of the adjoint.