If we’re the ones doing the inviting, I’ll call the other husband on Thursday night or Friday afternoon, and I’ll tell him where I’m davening, what time I expect to be home, and what time I’d like to start the meal. That way everybody’s on the same page, and we have minimal delays.
My wife knows I like to get started as soon as everyone’s home, so we try to minimize the conversation until after we make homotzee.
If we’re the ones going out, I try to find out where the other person’s davening, and we try to time our arrival so they have a minimal delay.