MorahRach-
First of all, a belated Mazel Tov! for your bechor.
May he be a continuing source of nachas for you and your husband.
I do think it’s mentchlich to do everything reasonably possible (hold/rock your baby, go to a different room, etc.) to ensure your neighbor’s children aren’t woken up.