If nobody leined, then nobody in the congregation could talk during leining. So, by your leining, you are doing lifnei iver for the whole shul.
Had I davened in a different shul, you might have a point. Fortunately, however, I happen to daven in a shul where I am the only one who talks during laining.
Sounds like you should switch to a shul where everyone talks during leining.