I really think this argument is moot, since there are plenty of ways to get a degree that the majority of the yeshivish world acknowledges.
And even if you DO go to a secular college, while doing so could theoretically drive you off the derech, the act itself can’t really be defined as such. Some MAY perceive it as not yeshivish/not done, but only someone really extreme would condemn a person as “OTD.” I know plenty of people who are in this situation, and B”H their Yiddishkeit is holding up nicely.
I’m not condoning this, of course. I just don’t think people should be so quick do condemn it.