Wolfish, There is no way anyone here can advise the OP the appropriate course of action. That is something between him and his spiritual advisor.
BTW even today if you were to visit the Oval Office or the Queen of England you would wear a jacket (one would certainly hope.) So [putting hats aside for the moment] what is the heter for this missing jackets that is unfortunately so prevalent in some shuls??