Discovering them was not so easy because they don't form chemical compounds. So they exist only as gases. And Helium disperses off into space.
Argon was the first to be found by density considerations because it is so abundant on Earth's atmosphere (~1%): Argon is abundant on Earth's atmosphere because it comes from the decay of Potassium-40.