As long as the man isn’t a mamzer himself (which would be very rare) there is no problem unless the woman was married to someone else. He’s violating a good many Jewish (and American) laws, but the man’s marital status is irrelevant. There wouldn’t be a reason to ask a shailoh, and given the man’s disreputable behavior, he wouldn’t want to be anywhere’s need someone to ask the shailoh to.
If the woman was married had been married to someone else, then there are complex issues.