I think if Cholov Stam and Cholov Yisroael were simply different levels of kashrus with nothing more to it, It would seem strange then that Rav Moshe Feinstein (sp) A’H’, wrote a section especially on Cholov Stam and Cholov Yisroael.
I am not scholarly enough to go into the whole argument about what he said, that is for scholars (and I am no scholar) to debate.
But it is undeniable that The Rav spent time to address the issue, so just form that, it seems to me to be a bigger issue then simply whether you eat meat strictly from a Heimishe Hescher, or not.