On the flip side, who gave that Beis Din jurisdiction? I can go to my local corrupt Beis Din and have them issue a hazmanah against you. You can then go to your local corrupt beis din and issue a hazmanah against me.
Refusing to go to a beis din is not in and of itself wrong. Did he also refuse to go to any beis din? I actually know of someone who was advised by his rav not to respond to a beis din hazmanah because the beis din is a known bribery-enforced beis din.