” I wear white, not because I think it’s a halachic issue, but because wearing colored would cause people to associate me with the leftern hemisphere of the community.”
Thankfully, for the most part the USA doesn’t suffer from the societal shallowness of other places and one isn’t automatically pegged as “leftern” (whatever that is) simply for wearing a colored shirt.