Ujm – klal yisroel accepted on themselves to keep glatt in America (many in Europe did not), as part of strengthening kashrus…cholov stam by contrast was accepted in most yeshiva communities, with the exception of giving it in yeshivos as per the psak of rav moshe. The chazon ish is said to have been maskim to the heter as well. Eating non-glatt would be a total pritzas geder, whereas cholov yisroel was not universally accepted. In out of town communities, the majority of yerei’im veshlaymim dl not keep cholov yisroel (this is changing in places with larger communities, such as baltimore)….the comparison is off in my opinion.
Having known many fine lower east side kolel families, talmidim of rav dovid zt”l who eat cholov stam, I can’t judge people who are maikil, though if someone is maikil in cholov stam, he should be following a rov like rav dovid (they are in the minority) who do not hold that it is an important chumra in every aspect, and not shop around for convenient opinions. I personally am makpid on cholov yisroel, as my rebbeim held to be.