” I am going thru a tough time now ”
I am not sure how chalav stam fits in.
If it is a tough time religiously and you want to “scale back” I agree with rebyid, since the issue isnt the chalav Stam
If it is a tough time avoiding Chalav Stam since you feel it is tastier, then go for it (though discuss with YLOR regarding possible need for hataras Nedarim)
If it is a tough time in other areas and Chalav Stam will help you feel better then also go for it (though again discuss with YLOR regarding possible need for Hatars Nedarim, this is easier than the previous scenario)
Regardless, hatzlacha with your tough time