If you were only “lukewarm” about the second, you should not have been proposing. Forget about not being fair to you, it’s not fair to the girl.
How do expect to maintain a marriage if you’re only “lukewarm” and there while your pining after someone else?
If that’s the case, work it out before you drag someone into your emotional morass.