getzel: It is much rarer for a woman to refuse a Get than for the man to refuse to give (though I believe ORA tells men to sign the prenup because they have cases of men who are “Agunim” as their wives won’t accept a Get).
But a man has a recourse of a Heter Meah Rabbonim (sometimes legitimate, sometimes not). Also, many men care a lot less because their kids won’t be Mamzerim. Yes, they may have violated a Cherem (and they try to get out of it by quoting Acharonim that the Cherem is over etc.), but that’s nowhere near the level of the Issur of Eishes Ish D’oraisa.