Ujm, “Yid” is a pejorative. Archie Bunker used it. It is certainly not the language of Sepharadim or the Eidot haMizrach.
Always is correct. When one of my Sephardic relatives married an Ashkenazi her parents refused to believe he was Jewish. Not only did his name sound Italian (actually it was Arabic) but he did not know a word of Yiddish. Golda Meir also said this about Moroccan Jewish protesters.