My point was using the emotional argument of “One wouldn’t come to a formal invitation to visit the Oval Office”
Is childish and wrong. since the reality is if I went to the oval office 3 times daily I would most definitely not wear a jacket. (That doesnt mean I would necessarily wear pajamas or even shorts)
Furthermore, the mechaber you cite does not say one should dress as if in front of a king (unless I am misunderstanding), if he did it would mean no hat today and suits and ties not just a jacket.
Again, the halachah is that one dresses as one would in front of important people. What is wrong with using the Oval Office as an example?