Most Poskim hold and any regular man understands that certain parts cause hirhurim even if many women are accustomed to reveal them.
As far as your “common sense” svorah goes, look in Brochos 24A and in Rashi there — it is befeirush not like you said.