Kollel should only be for those with true potential and talent, the future gedolei hatorah.
Most in kollel don’t make the cut. If they were all special, than the concept of gadol would become diluted.
The point is that there is a hierarchy and not everyone is cut out to be a great talmid chacham.