It’s actually better not to know these things. If you know the original words, and if they are assur, then it becomes assur to listen to the Jewish song if you end up thinking about the original words. So says R’ Matisyahu Salomon, Shlita, in one of his books. Otherwise, it’s not a problem.
I have no plans to listen to the Simcha Leiner song again.
Down Under by Men at Work.
That’s the Piamentas’ “Asher Bara” you’re thinking of.