Avi K – good post. And it’s not just Rav Soloveichik who hold that way. I’ve heard the same opinion many times over the years from many sources. This “They’re not even Jewish” business is something that’s fairly new, and only seems to have gained popularity with the current “us vs them” mentality that’s crept into our speech in the last 2-3 decades.
Maybe those of us who are frum should be properly grateful that we were born into/joined the ranks of the Torah observant, and not been stuck in some place where we never had a chance to learn Torah. It’s not kochi v’otzem yadi that brought us here, it was the kindness of HaShem.