Growth bound for homogeneous linear classifiers Created 2026-09-24 Updated 2026-09-24
The signs of homogeneous linear forms on have VC dimension at most . The Sauer-Shelah growth bound therefore gives
The Sauer-Shelah lemma states that if , then
In particular, the Sauer-Shelah growth bound gives .
A convex polygon with sides is an intersection of affine half-planes. Affine half-plane indicators in have VC dimension at most , so the Sauer-Shelah growth bound gives at most labelings on points. An intersection corresponds to the coordinatewise product of its half-plane indicators. Repeated use of part (c) therefore gives
Condition on the sample. The set of vectors
has at most distinct members, each with Euclidean norm at most . The Massart finite-class lemma, the Sauer-Shelah growth bound, and give
Taking expectations and substituting this into part (i) yields