The seforim hakedoshim say not to call your wife by her first name when in public. While this isn’t a universally followed custom, it is cited as a middos tznius. This is where the widely utilized (in some communities) “??? ???” directly comes from.
Which brings us back to the initial issue in this OP. If there’s an issue calling your wife (in public) by her first name, how much more so your neighbour’s wife or colleague or other woman!