The Bach and the Chida are talking about the halacha; we’re talking about hashkafa. Les man di’palig that listening to non-jewish music is halachicly muttar, the question is if it’s good idea.
The kasha from Rashi is also not a kasha; listening to non-jewish music is bad, but not bad enough to turn somebody into a complete rasha.