If you arent sure why you avoid it, you can eat.
Incorrect. Just because someone isn’t sure doesn’t give license to eat. His posek’s reasoning for not eating cholov stam, even if he isn’t aware of the reasoning, may well be because he rules it to be cholov akum.