tbt-good point about the Rambam-it was completely misrepresented.
As far as halachik sources there cannot possibly be a blanket rule on such a grey area-what if the man is simply nasty , does the wife then have to acquiesce to his whim?it is degrading to even suggest so. But you are right, this is not really a coffee room topic.