Please tell me (and provide sources) which gedolim said that if the wife needs help and asks the kollel husband to take the garbage out that he should refuse because of Kavod HaTorah.
If I may add:
And even if there is such an opinion, explain why, other than selfish reasons, you would want to follow it rather than the opinion of other gedolim that one should not act that way.