 Solution

For the Sheaf of relative Kähler differentials on $X={\mathbb{P}}_{\mathbb{C}}^3$, the cotangent form of the Euler sequence isThe last arrow is onto because at least one homogeneous coordinate is invertible on each standard affine chart. Locally its kernel is the rank-three module generated by the differentials of the three affine coordinates, yielding the displayed Sheaf of relative Kähler differentials. The cohomology of twisting sheaves on projective space gives $H^q(X,{\mathcal{O}}_X(-1))=0$ for every $q$, while $H^0(X,{\mathcal{O}}_X)=\mathbb{C}$ and its positive-degree groups vanish. The long exact sequence in sheaf cohomology therefore gives the cotangent-sheaf cohomology of projective space in this dimension:The isomorphism for $q=1$ is the connecting map from the constant global sections of ${\mathcal{O}}_X$. The Euler characteristic of a coherent sheaf is the alternating sum of dimensions, explaining the minus sign.

For the curve, put $S=\mathbb{C}[t_0,t_1,t_2,t_3]$. It is a unique factorization domain, so irreducibility of $F$ makes $(F)$ a prime ideal. Also $F$ does not divide $G$: otherwise irreducibility of $G$ would make them associates, contrary to their distinct degrees. Thus the image of $G$ is a nonzero element of the integral domain $S/(F)$. It follows that $(F,G)$ is a regular sequence. Its Koszul complex is an exact sequence, and graded sheafification giveswhere $i:Z\hookrightarrow X$ is the closed immersion. The signs make the composite $F(-G)+GF=0$. The shifts come respectively from $5+7$, $5$, and $7$.

Let ${\mathcal{I}}_Z$ be the ideal sheaf of a closed subscheme. Split this Koszul resolution intoFor all integers $d$, $H^1(X,{\mathcal{O}}_X(d))=H^2(X,{\mathcal{O}}_X(d))=0$. Also $H^1(X,{\mathcal{O}}_X)=H^2(X,{\mathcal{O}}_X)=0$. The two long exact sequences in sheaf cohomology, together with sheaf cohomology under a closed inclusion, consequently identifyBy Serre duality, $H^3(X,{\mathcal{O}}_X(-m))\cong S_{m-4}^{\ast }$ for $m\ge 4$. Counting degree-$d$ monomials in four variables gives $\dim S_d=\left(\genfrac{}{}{0ex}{}{d+3}{3}\right)$. Thus the source has dimension $\left(\genfrac{}{}{0ex}{}{11}{3}\right)=165$, and the two target spaces have dimensions $\left(\genfrac{}{}{0ex}{}{4}{3}\right)=4$ and $\left(\genfrac{}{}{0ex}{}{6}{3}\right)=20$. The rank-nullity theorem proves the requested bound:

In fact equality holds. Under the Serre duality pairings, the dual of this map isIf $Ga=Fb$, primeness of $F$ and $F\nmid G$ imply $F\mid a$. But $a$ has degree one and $F$ has degree five, forcing $a=0$, and then $b=0$. The dual map is injective, so the original map is surjective and its kernel has dimension $141$. Thus the lower bound is attained for every pair allowed in the question. No smoothness assumption is needed. The regular sequence cuts out a projective complete intersection of dimension one. Also $H^0(X,{\mathcal{I}}_Z)=H^1(X,{\mathcal{I}}_Z)=0$, by the negative twists and the intermediate cohomology vanishing in the first short exact sequence, so the second gives $H^0(Z,{\mathcal{O}}_Z)=\mathbb{C}$. This is the genus of a complete-intersection space curve: the first cohomology has dimension $141$, equal to its arithmetic genus.