“Why not just stay home and daven b’yechida?”
So now you are saying that the fact that you can’t see everything as well when you can daven at home perfectly well instead is reason to be over an issur deoreisa of lo sasuru? If the action was reversed, it would be a kol isha problem, yet another example of how men and women are attracted differently. A male visual machshava is much faster.