By playing sports and being active one can add years to his or her life, and thereby have more time to learn/do chessed in later years. It’s not a waste of time, it’s an investment.
I know the gedolim don’t spend their time playing sports, but they don’t spend time in the CR either – does that make it assur? If yes, why are you commenting?