Everyone seems to have different experiences with their c”y, even in the same city in terms of spoilage. Some of us are zoche to the nes of it not spoiling, some of us not; just like some of us have their Shabbos candles stay lit 168 hours, others only for 4 hours.
Back to reality: For those used to eating and snacking dairy products, being fully Makpid on Cholov Yisroel is a major Avodah of self improvement. And as I have heard from those with real teaching and guidance responsibility, especially close to Yom Kippur, one has to prioritize the areas he or she will work on. For most of us, me included working on what comes out of the mouth is more important.