Sam, you wrote earlier, “Spiritually uplifting” is entirely subjective. This, and the implication that spiritually harmful would also be entirely subjective, is what I am disagreeing with you about. These qualities can be inherent in the music.
I also suspect that WIY meant that although we are not sensitive enough to feel the negativity in music when it’s more subtle, we should be choshesh for it when the source is impure.