Just as far as your logic goes, I’m left a little confused. If you are saying that in order to appreciate the colors that Hashem created, one must dress in them, does that mean if a man would wear all the colors of the rainbow except pink or purple it shows he lacks appreciation for those colors? What about the non-visual spectrum? If someone doesn’t use an x-ray on a regular basis, does that show he doesn’t appreciate x-rays, ultraviolet, infrared?
Or perhaps there is room to say that it is possible to appreciate certain elements of Hashem’s creation from afar? Such as by using red brick in your house or painting a room blue.