As long as the ultimate goal of the trip is permissible, and one is trying to accomplish the goal in the most efficient way (i.e. no pritzus free equivalent “darka acharina”), I would find it hard to make a blanket issur on going even to places where you KNOW there is pritzus. If you KNOW that you will have hirhurim it’s a different story.
While there are SOME clear rules when it comes to shmiras einayim, the vast majority of the avodah is subjective, IMHO. Everyone should work on moving toward the “no hirhurim” side of the continuum, and no one but God is perfect.