Can not, and will not are two very different things. Can not is something that just is. Will not can be changed. May I ask what it is about mathematics that makes you so unhappy?
Personally, although it is not my field of interest, I do find mathematics fascinating in it’s perfection. The incredible ways that math and science interacts constantly increase my awareness as to the amazing world Hashem has given us. So to me, math can be used to serve Hashem as well as many other subjects.