Some say that’s why we repeat the request for yiras shamayim – after receiving osher v’chavod, its a whole new ballgame !
Chazal say if you run from kavod, it will run after you. As quoted in certain seforim, clear that its not an observation, but a promise. Same ‘question’ applies.
Think its pretty clear that these things are tools that can be used either way.