I heard that when R’ Meir Shapiro went around raising money for what was essentially the first modern yeshiva (with all of the bochurim’s needs in regards to sleeping, eating, etc. being taken care of) people asked/challenged him with the above Mishna that seems to indicate that poverty is beneficial to Torah study. Supposedly he responded that the Mishna is only trying to show us how far one must be willing to go to study Torah; but is it doesn’t have to get that point, it shouldn’t.
Also I seem to remember a Gemora that says that Rebbi learnt with bars of gold on his table (supported by Antinenus) so he felt reassured and could learn better.