Yes that is overkill. You do not have to sit in a hat and jacket in your own home, nor in anyone else’s home. I doubt the Rabbonim named sit with their hats on in their own home or even in their own office. There is a time and a place for everything and you need to use your seichel at ALL times. Would you wear your hat and jacket while playing with your kids on the floor, or while feeding them or changing them? Do you wear your hat and jacket when you are eating or do you really just need it for benching?
If a man has his sneakers on and is going for a walk for his health do you think it is appropriate to have a hat and jacket on as he is building up his heart rate? It is kovod Hashem to wear the proper livush, but if you wear the livush at inappropriate times then is it a kovod or a busha?