Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2024/iii/paper-205/1/b/solution

Suppose a feature map represented the Gaussian kernel. Choose , a unit vector , and points for . Their kernel matrix is
For sufficiently large , hence sufficiently small , every row satisfies
Thus is a symmetric strictly diagonally dominant matrix with positive diagonal and is therefore a positive-definite matrix, so .
On the other hand, if is the matrix whose th row is , then and , a contradiction. Hence every feature-space realization of the Gaussian kernel requires an infinite-dimensional vector space.

New to topics? Read the docs here!