that any clothes that are too attracting are not allowed”
Anything that attracts undue attention is not good. Correct? Then I would say that the garb worn by certain groups of frum Yidden, would seem to be problematic as well, as they surely cause a great deal of attention to be paid to their wearers. An argument could be made for ANYTHING, if one wants to argue. My daughter was told she could not wear a floor length completely tzniusdig black skirt, because people were looking at those skirts along with the too short ones that others wore.