Solution
= Solution
The <generalized characteristic polynomial> is
$$
\det(A-\lambda B)=-(\lambda-2)(\lambda-4)(3\lambda-10).
$$
The <generalized Rayleigh quotient> is maximized by the largest generalized eigenvalue, $4$. Solving $(A-4B)\mathbf v=0$ gives
$$
\boxed{\max_{\mathbf v\ne0}F(\mathbf v)=4,\qquad \mathbf v\propto(-1,2,0)^T.}
$$