Moish, the difference is that you are not fooling yourself. You know you should be inside, and you know it should be for the full time. The difficult part is doing so. And I wish you hatzlacha in doing so.
The others believe they are justified in being outside. They fool themselves into believing they are “done”. There is no growth there.