Yes. Avraham did come from there. therefore I have less of a problem “re”adopting the dress of the Temanim or the Beduin than see Mizrachim and Sephardim dressing like they came from Volozhin. It is this precisely this ethnocentric thought that has defined black suits and fedoras as “Jewish” dress.
My Rav who has semicha from Chofitz Chaim was medakdek to not where a black hat (he wore gray) as he was taught that a black hat was gaivadik as people wore them to look “frummer”. Twenty years later he is now wearing a black hat. Why? Because his daughters all married Yeshivish guys and he was pressured.
FYI, i am black hat on Shabbos. Why? My wife’s cousins in Monsey guilted me into getting one.
Again, all I am saying is that we are Middle eastern and thus perhaps our dress should reflect Rav Amnon Yitzchak Shlita’s rather than mobsters from the 1940s.