I can only try:
Its not only affinity, its also exposure. Without exposure, children will not be aware of the possibilities out there.
In addition, for the yeshivish world, anything labeled an elective will be dismissed by rabbaim who will push for learning instead. The only possibility is an either/or, and that takes money (as you point out).