“Would you think it’s a good thing to be “secure enough in your own Judaism” to not be perturbed if somebody is doing something “less frum” than you? What’s the difference?”
If “less frum” means that they are doing something against the Torah, then you should be bothered by it. Otherwise, you shouldn’t.