Rav Hutner ZT”L once said “Better for someone at work to regret not being in Bais Medrash than C”V the other way around.”
Why? because that can negate all the learning he did! That’s why he allowed boys to go to college.
I heard this from Rabbi Perlow at a Daf Yomi Shiur, nephew of the Novominsker Rebbe at a Daf Yomi Shiur he gave recently.
Based on this we can apply the following: Kollel is only for those with a thirst for learning. Once that thirst is “satisfied” it’s time to go to work. This way it will be less likely for one to think such things, because he will not (less likely to) regret the learning he did when he “needed” to learn.