I think the key phrase is, “??? ??? ????? ????? ??? ??????”.
There are things which are inherently feminine, and the ???”? holds that ????? ??? ??? ???? is inherently feminine. The poskim who asser trousers feel the same way about trousers, possibly because of the ????? ????? issue.