The smooth dual consists of the smooth vectors of the algebraic contragredient representation. Their union is a vector subspace because finite intersections of open stabilizers remain open; it is invariant because translation conjugates stabilizers.
New to topics? Read the docs here!