Your whole argument against the draft is that those who learn torah should not go to the army as they are protecting Klal Yisroel, Since these people are not learning and may even be doing danger to themselves or others.
The charedi Oilem seems not to want to take responsibility for these people “They arent charedim and they wont listen to anyone anyway” , so someone needs to take responsibility for them and save them from themselves