We Jews are supposed to look different than the Goyim.
Well, plenty of non-Jews wear black suits with white shirts (a ton at my office do). And generally, older black men wear hats. If we take the styles of the goyim and emulate them (even if some things are out of style), then its not “Jewish clothing.”
Jewish clothing (at least to me) is a kippa or tzitzit. Its exclusively Jewish (if you neglect the Pope).