Hi sushe.
Great question!
I don’t know the background of ayin hora, but I am looking forward to the responses.
It is my understanding that Yosef was impervious to the ayin hora. I think he merited that by standing in front of, and guarding, his mother from being seen by someone with wrong intentions.
If I am wrong, I hope someone will correct me.