I have strong doubts that the fine Egyptian linen of 2000 years ago was created with any less improper intentions than modern denim. However, it was used by the Kohain Gadol on Yom Kippur.
We can not ban a material from being used to create clothing that are now associated with modest orthodox Jewish women.