He replied that it is because he never once heard a non-jewish song in his life
That’s demonstrably untrue. In fact, there are at least two songs he recorded which were non-Jewish: Kumbaya, and the second part of Ki Va Moed.
It’s amazing that this myth keeps being repeated.