Rachel thought that she was doing right by stealing her father’s gods. The brothers thought they were doing right when they sold Yoseph to the Yishmaelim. There are countless more instances where the Torah instructs us not to violate the law, even when we believe someone is guilty of a sin.
Last year when a store across from Chaim Berlin displayed certain photos that were objectionable, the Rosh Yeshiva did not instruct the bochrim to burn down the store but rather to boycott it. The store got the message. This is the Torah way.