Sam2 -M80: I quoted that there is a very good Heter for married people”
I used to think like you, but a lot of Poskim don’t like this Heter. As a matter of fact I just saw a Poisek saying even if your wife won’t have a good nite’s sleep because she will toss and turn because she is alone, it’s not enough to Patter the husband.
Cold is also not so Poshut because you can sleep with a heater or a sleeping bag. If you still are uncomfortable, then you can go into the house to sleep.