uneeq –
First, even if there is an issur with a woman having lewd thoughts a man who is an ervah, that doesn’t mean that she is as likely to have those lewd thoughts simply by looking at men, as men are by looking at women. I’m not saying they aren’t, but if you want to make issurim you have to prove it.
Second, the three sources you cite are not generally regarded as the most authoritative sefarim when it comes to halacha. How about a Gemara, a Rif, a Rambam, a Rashba, a Rosh, a Mechaber, a Rema? Is this halacha missing from all those places?