I agree it is disrespectful. However, I do it. I am sitting behind the mechitzah, so the rav can’t see me. And everyone knows I don’t know Hebrew well enough to follow what he is saying.
However, there is another shul where I go and a woman gives a shiur to the women. In that case I do pay attention even though I catch about one word of every ten.