Sam, obviously that is if it is warranted.
If a parent regularly attempts to give drugs and alcohol during visitation to his children, such a parent would rightly be denied visitation. Obviously this is a rare situation but one that can happen.
If a spouse has no obligation to give/accept a Get, and one isn’t halachicly obligated to give/accept a Get simply because the other demands or wants it, then there can be no taaina against him/her for exercising their halachic and moral right to remain married should they so choose.