“because that was the minhag”
It seems that this minhag is still followed.
“The reason why Lubavitch doesnt shave is because they pasken like the tzemach tzedek who holds that it is assur min hatorah to shave due to the issur of Lo Silbash.”
Well women don’t shave their either, so by this reasoning lo silbash might require men to shave.