There are many Chazals that say it is a mitzvah to enjoy what Hashem has given us. Example, one who doesn’t taste every food possible will have to give a din vcheshbon. Also, lo dayecha mah sheasra Torah.
Why should we think the RBSH is angry at us if we enjoy his food? Is that how you treat your kids? When they enjoy a meal at home, you make them feel guilty?
The point is not to overdo it so he forgets what his main job is in this world and gets distracted, and not to make it one’s primary pursuit, so that it interferes with learning and other responsibilities.