Sorry, I had no idea this was an old Minhag tznius amongst Yidden! I can only think of one person I know who does this and he is davka from a very modern background.
To me, it davka felt less tznius, although I realized his point was to be more tznius.
Is it really an old minhag?