 Solution

Start at any integer $x\ge 2$, for example two. Propose $x+1$ or $x-1$ with probability $1/2$ each; if the proposal is one, reject it immediately. Between distinct valid neighboring states the proposal is symmetric. The Metropolis–Hastings acceptance probability for an upward proposal isFor a downward proposal from $x\ge 3$, it isThese are exactly the ratios of the supplied negative binomial distribution probabilities; the factor $p^2$ cancels. The rejection at the boundary supplies a self-loop at two. All neighboring positive states communicate, so the chain is irreducible and aperiodic. Detailed balance gives the desired stationary law. Rejecting the invalid move, rather than forcing an upward move at two, preserves the proposal symmetry used in these ratios.