Most commonly known as a byproduct radioactive decay.
Their energy is very high compared example to more common radiation such as visible spectrum, and there is a neat reason for that: it's because the strong force that binds nuclei is strong so transitions lead to large energy changes.
A decay scheme such as Figure "caesium-137 decay scheme" illustrates well how gamma radiation happens as a byproduct of radioactive decay due to the existence of nuclear isomer.
Gamma rays are pretty cool as they give us insight into the energy levels/different configurations of the nucleus.
They have also been used as early sources of high energy particles for particle physics experiments before the development of particle accelerators, serving a similar purpose to cosmic rays in those early days.
But gamma rays they were more convenient in some cases because you could more easily manage them inside a laboratory rather than have to go climb some bloody mountain or a balloon.
The positron for example was first observed on cosmic rays, but better confirmed in gamma ray experiments by Carl David Anderson.
Figure 1. . Source. Several points of the Uranium 238 decay chain are clearly visible.
The following cobalt-60 diagrams suggest that some lines are clearly visible in specific nuclear reactions:
Also this one:

Articles by others on the same topic (1)