The Taz was the first to suggest that men going with an uncovered head was chukat hagoy.
Maybe this would true in a house of worship, but even that is a stretch. The Vilna Gaon says that a man need only cover his head for the Amidah.
Reb Moshe holds like the Taz, yet allows men to uncover for work purposes.