I think there are a few issues here…
1) I don’t see why it should bother the next person if they see someone wearing a suit and a hat… What’s it it you? Let them be hot- it was obviously their conscious choice. Goyim have seen Yidden, they know this is the way some dress, and they are pretty accepting of it.. (It doesn’t bother them) I think it bothers their Jewish “brethren” (for lack of a better word) Who don’t necessarily wear the same levush who have more of an problem, and who are more sensitive. –> Which gets me to my second issue.
2) I believe that people who see these men wearing hats and jackets out of the beis medrash or shul, don’t necessarily have their best interests at heart. What’s bothering them is not that they look hot and they feel bad that they are wearing a few extra layers. They are self conscious that they themselves choose not to dress that way (not making a statement that they should or shouldn’t) and that because these men are making a statement, they feel that it reflects poorly on them and their level of frumkeit. The problem is when people think that the hat and jacket creates the ben torah… And that if you are missing the hat and the jacket then you can’t possible be a ben torah (Which is not true)
People see it as these men are looking to be superior and better because they are dressing in a certain way. (Which my or may not be true depending on the person)
But the most important thing is that however you dress YOU ARE DRESSING TO IMPRESS THE SHECHINA, NOT THE SHECHUNA and as “heilige” as you want to dress on the outside, make sure that your insides match…
Just my 2-sense
Take it for what its worth..
But, I feel like worrying about the hat and jacket isn’t what’s going to make moshiach come sooner, rather we should be working on becoming better and growing in our Yiddishkeit, and be accepting of other Yidden who are being Ovdei Hashem, but maybe not the exact way as you.