So we really have to do ALL of the season challenges in order to graduate early or at all?
If you want to early graduate, you have to finish the season pass, yes.
Even if you did not do that, you can graduate automatically at the end of the season.