There is a concept in Halacha that “sicha” is like “achila”. That is why there are people who are makpid not to use non-kosher products to apply to their body, such as ointments, oils, perfumes or make up and the like.
I have never heard that “levisha” being considered like “achila”. There is no reason to refrain from wearing objects from non kosher animals, while there is a reason to refrain from spreading animal products from non kosher animals on one’s body.