“There is the fact that a baal nefesh should refrain from CS even though its muttar.”
1: I think that people should stop referring to it as chalav stam. It is a pejorative term created by those who disagreed with r’ moshes psak. His psak covers what he calls chalav hacompanies.
2: the discussion should not focus on the milk or ice cream one consumes, but how to reach the level of baal nefesh where r’ moshes charge to baalei nefesh applies.