It is possible to avoid these things in the real world. Almost everyone I know including myself does. You can live in EY or have a job that involves working only or mainly with Yiddin or working from home. Plenty of people do.
It is definitely always better to go to school or work in a Frum environment if possible – and not for the reasons mentioned. Even if you do ultimately end up having to work with goyim (which you might not), at least during your college years you won’t have to.