Dual norm

A dual norm measures how strongly a bounded linear functional can respond to a unit-sized input. If $p$ is a bounded linear functional on a normed vector space $X$, write $⟨p,x⟩=p(x)$ and defineIt is the operator norm of $p$ when its scalar output is measured by absolute value. On ${\mathbb{R}}^n$, represent $p(x)=a^{T}x$ using a coefficient vector $a$. The unit ball is symmetric, so maximizing $|a^{T}x|$ gives the same value as maximizing $a^{T}x$: negate an input whenever its output is negative.^[ref]

For an original two-coordinate example, fix $a=(2,-1{)}^T$, so $p(x)=2x_1-x_2$. The input norm changes the allowable unit ball and hence the dual norm:Under the L1 norm, $|2x_1-x_2|\le 2(|x_1|+|x_2|)\le 2$, and $(1,0{)}^T$ attains the bound. Under the Euclidean norm, the Cauchy-Schwarz inequality gives $|a^{T}x|\le \Vert a{\Vert }_2\Vert x{\Vert }_2\le \sqrt{5}$, with equality at the displayed normalized vector. Under the maximum norm, each coordinate can reach unit absolute value, so $|2x_1-x_2|\le 2+1=3$; $(1,-1{)}^T$ attains it. Thus the dual norms of these three vector norms are respectively the maximum norm, the Euclidean norm, and the L1 norm. For $1\le p\le \infty$, Lp norms on a finite coordinate space pair with their Holder conjugate exponents.^[ref]

This geometry explains the usefulness of a dual norm: it translates a bound on inputs into the sharp bound on a linear output. The support function of the unit ball gives its value in the coefficient direction $a$. Changing the input budget changes the set of possible inputs; the three different answers do not conflict. In finite dimensions a closed unit ball is compact, so a continuous linear functional achieves its maximum absolute value. In an infinite-dimensional normed vector space, the supremum remains the definition and need not be achieved.