I once heard a quote (I think in the name of some great Rav, but I can’t remember who), I can’t remember the exact quote, but it was something along the lines of “A leader who has no enemies is not a leader.”
If a leader has no enemies, it shows that he must be giving into everyone all the time, and that would make him a follower, not a leader. A true leader has to be able to be strong enough to act against the tide and do things that are not popular!
You may mean this:
“You have enemies? Good. That means you’ve stood up for something, sometime in your life.”