The one time I said something to someone about it, I immediately regretted it. As a result, I don’t protest anymore… I just sit and simmer.
Back in my brash teenage days, I actually went over to an older gentleman in shule who sat in the midst of a talking group. I asked him, respectfully, if he could stop talking. He then gave the whole shtick, saying I was being chutzpadik, yada yada yada. Then he asked me why I singled him out from the group, and I said, “You have smicha, you know better.”
At mincha that afternoon he came over to me and apologized, telling me I was right, and that he would work on not talking during davening.