A lot of times it also depends on where you live.
Many people in out of town communities have a very small selection of chalov yisroel.
Additionally, in this day, the Federal government has many legal requirements for listing ingredients (primarily due to allergies) and it has to list what type of milk. Food companies are scared enough that they would generally not be tempted to switch ingredients and a lot of people and reliable poskim rely on this.