I suspect that the issue here is that some people abuse the concept of halacha for evil purposes. The observers see something that they know is evil but hear the evil-doers or their supporters claiming halacha as a shield for their evil activities. Since the Observers are not learned enough on their own do demonstrate why the halachic claims are incorrect and pernicious, they instead lash out and say: “if that is what halacha says, I don’t care.”
There are two solutions to this problem that I see: 1. Don’t presume that everything said by talmud chochom is halacha. No matter how learned someone is, they can sin, make mistakes, and be corrupted. 2. Learn! Become a talmud chochom in your own right, so that you don’t need to rely on the opinions of others.