From wiki:
“After Prince Edward of Britain started wearing them in 1924, it became popular among men for its stylishness and its ability to protect the wearer’s head from the wind and weather.”
Apparently, it was not in style for men to wear a fedora before 1924, only for (some) women.