Mosherose- please bring a source that there are some things that you may not do with your wife.
Look into a shulchan aruch and you will see that everything is muttar to do with your wife, except of course halachos that are forbidden.
Mixed swimming is forbidden, but if a couple ALONE is swimming- its muttar.