Ari z”l says one should wear it that way the whole davening. Hat is also called a covering
Shtreimel by Laining may be that Shtreimel is malchus and one dons malchus clothing for event reminicent of Kabbolas HaTorah as we became a “princely nation” then.