the gemara in bava basra daf 57 says that if someone opts to walk near the river where the women wash their clothing – if there was another way to go he is called a rasha even if he closes his eyes.
based on that it would seem that removing your glasses is no solution if you could find a separate beach/pool.