Also, if someone is rich, then Hashem obviously thinks he is worth such a hard challenge, so even if he is not fully up to it, he deserves some respect and owe, especially from people whom Hashem does not want to trust with more than $100 at a time. You surely have no idea what their taavos are and how you will behave there. And if he is a self-made person, then he was in your place …
For example, many rich people have hard time finding friends and partners, as everyone is there “for the money”. Some of my “filthy rich” friends really enjoy a conversation with a friend from the time they were poor. I feel the same with hoshuve people from the Jewish community – there is a difference between those with whom I was learning when I had nothing, and those who are inviting a person from whom they can potentially benefit. I can’t even imagine how sad is the life of people who were born into rich families – do they even have real friends?!