יד ליד לא ינקה, IIRC, is interpreted by Chazal to refer to someone who is מרצה מעות מידו לידה so he will have a chance to interact with her.
It sounds like if it’s done innocently, there’s no problem. I can definitely see how a custom to circumvent the potential problem would develop.