TLKY,
They said it was a kiddush Hashem? When and where? Are they aware of how it looks from the outside? Are they aware of the way it is perceived by Jews and non-Jews in America? Maybe it would make a difference if someone let them know about the Chillul Hashem.
I don’t expect you to just stop listening, but I do expect you to question and ask yourself whether you are satisfied with the answer. If you aren’t, ask again explaining why you are not satisfied. Gedolim are not oracles they are teachers, rabbeim.
If you are learning a gemara and your Rebbi gives an answer to a kasha and you don’t understand it, what do you do? Do you just accept it or do you ask again until either you understand or you come to the conclusion that your Rebbi is wrong and try to come up with a different pshat?