The lamplighter group
is generated by one lamp switch and one translation. It is metabelian, hence solvable. Its base subgroup is not finitely generated. Every subgroup of a polycyclic group is finitely generated, so the lamplighter group is not polycyclic.