It’s irrelevant that the actual physcological essence of these feelings are self serving.
Of course it’s relevant. It is precisely this that implies that these feelings are not inherently/naturally good. Because, since they are self serving, one whose values are not in line with the Torah’s or who’s reasoning isn’t up to par will not just be naturally a selfless giver.