mommamia: I’m all of 18, and I don’t think I am capable of advising you what to do. IMHO though, I think that if he’s a good, patient, and loving father, he probably is a good person who needs a little guidance. He’s probably not stable and still struggling with some unfinished issues of his first marriage. Perhaps you need to involve a third party (NOT your best friend. Go to a proffesional.). Try going for help. I highly doubt he’s presently enjoying the relationship as is. Maybe he’s willing to make it work. Talk to him. After all, he’s your husband. Put out your cards on the table and ask him what he suggest you do in this situation. Tell him you’re willing to change and make this work, but he has to put in his effort too.
This is just my very humble opinion based on what you said. I think that aside from getting the opinions of anonymous posters on here you should seek advice from a Daas Torah. Especially since you mentioned he’s struggling with Yiddishkeit as well. Hatzlacha rabba.