Real brisker,
there is acertain adelness that the people that wear the hat down. It is the same geder of not putting the hands in the pocket. When I was a Boucher my father repeattedly requested from me to wear the brim down. I quote you his loshen “you won’t find a rosh yeshiva or godal wearing the brim up!” it’s a status quota.