D Bar M- You just got some seriously bad advice from downandin. Really bad!
Please do not ever “consider collecting with your wife and child” (4).
Never take your child(ren) with you. And if that means your wife can’t come along, then leave them in her care and go alone.
This is wrong on so many levels; I will leave it to certified mental health professionals with experience in childhood development to respond with specifics. If none join the discussion here, then perhaps you are acquainted with someone who can discuss this subject with you, or seek guidance from your Rav or Rebbetzin before undertaking such an ill-advised course of action.