That’s how I was taught in yeshiva. If something doesn’t make sense, you say how it doesn’t make sense. That’s how you figure out the truth.
If you read a tosfos and it doesn’t make sense, you say it doesn’t make sense. Then, you figure out how it really does make sense, or how you are misinterpreting it and if you read it correctly then it does make sense.
It does not make any sense to say that you think people who believe in it are harmed, but that you don’t believe in it. Because if you think people are harmed by it, that means you do believe. So the way you quoted the rov makes no sense.
Perhaps he said that it only harms people who think about it a lot, or only people who do lots of stuff to avoid it. That could make sense and not be contradictory.