“Talking in shul is one of my pet peeves. I personally cannot stand it when people talk in shul (although, to be brutally fair and honest, I am one of the worst offenders during krias haTorah).”
If it bothers you that much stop talking. Or are you happier being a hipocrit who is mad at people for talking when you do it yourself.