Learning is better than working. If one can learn all day, then college is bitul Torah. However, learning is only shayach for people who can do the following: 1) learn every minute of every seder that they are supposed to (any minute in seder not learning is geneivah) 2) they must be able to support the family at their level with the money they bring in (whether that’s in addition to the wife working, having a wealthy father or father in law, or a family with really really low physical standards- a person should not learn full time at the expense of the physical and psychological well-being of his family). Once you have to get a job, then one should put in the hishtadlus that he needs to be prepared in such a way that he has time to learn and enough money to support his family at their level. If you can do that without college… great! If you need college, that’s also great!
Additionally, I assume being a wordly person is a positive thing (as long as this worldly knowledge comes at the expense of time that would be wasted, not Talmud Torah). Understanding G-d’s wisdom in science, math, and history, understanding how the world works in terms of politics and economics, and knowing skills to succeed in general like how to write and speak are positive things to know.