DAAS: I couldn’t find a halacha on coming on-time to shul so I doubt they would ask that.
Even if they do, my ahavas yisroel of not wanting to disturb other Jews from davvening will trump my selfishness of coming on-time and talking.
I’m not worried 🙂