It’s a good question and I don’t think there’s a simple answer to it.
According what organizations and activists like the ADL have considered anti-Semitism, we would have to include many frum Jews under that umbrella.
According to what more extreme activists have considered anti-Semitism, Hitler yemach shemo was only criticizing the Zionist movement.
I think the answer has to be looked at on a case by case basis.