Sure the Mitzva is to Enjoy! Hence it is called ברכות הנהנין
ברכות הנהנין נאמרות גם בהזדמנויות שונות הקשורות לחושים אחרים
Bringing up Mussar Sforim that were written under the influence of the Monastics and Churchs is no argument, Chazal do talk about it but it is a view of people who hated life, and they served God by hating life, including not getting married or holding a child out of exclusive love for GOD
It is very important that Rabonim point out these people who are masochists and sadists as not coming from Torah but suing it to Quote mine