 Solution

With downward position as the vertical coordinate, the full potential energy isThe equilibrium tensions are $2k(a-\ell )=6mg$, $k(b-\ell )=3mg$ and $k(c-\ell )=mg$. On expanding, these relations cancel every term linear in the displacements, leaving $V=k{x}^2+k(x-y{)}^2/2+k(y-z{)}^2/2+V_0$. Newton's second law therefore givesFor a normal mode $\mathbf{q}=\mathbf{v}{e}^{i\omega t}$, set $s=m{\omega }^2/k$. The generalized eigenvalue problem isIts determinant is $2(1-s)[3(1-s{)}^2-2]$, so the angular frequencies and mode directions areThe square roots of these positive values give the requested frequencies. Only the lowest mode has all components of the same sign, so all three particles oscillate in phase at the lowest frequency. The mode shapes are shown below.

For release from rest with $Y$ remaining at equilibrium, chooseThis excites only the middle-frequency mode, so $y(t)=0$ for all time. It is a stationary middle mass in a three-mass spring chain: the equal and opposite adjacent spring forces cancel on $Y$.