Perhaps the Chazon Ish waas talking in the context of his time and place, where they all knew the score and it can never be considered completely innocent by first generation OTDs.
America might be different, though. It doesn’t cross a goy’s mind that something is wrong with a formal handshake.
I understand that it has to do with Halachic opinions, but the Halacha depends on how normal it is and how integrated you are. Therefore, it usually follows the ‘wings’.