intellegent:
That is not to say they should be in the street/Shuk! That falls under “Kol Kavod”. Driving is a personal thing with no interaction.
If you are from EY, as we have seen (in the news with the bochrim kicked out of yeshiva) the Gedolim there don’t allow men to drive, so there it is some other sort of svorah.