It has to depend on the demographic of the person he is answering the shaaloh to or who he is expecting to learn his sefarim. Obviously Avraham Avinu did not wear a hat for davening. For the yeshivisher olam wearing a hat is equivalent to being dressed properly.
Menu