This has nothing to do with sefardim/ashkenazim. The baba sali was known to never let himself be exposed to untznius women. He would walk with his eyes covered, guided by talmidim.
Someone once asked him how he was able to see things in ruach hakodesh. He said, if you guard your eyes like i do, you will automatically see things the way i do.