The basic concept of Derech eretz kadma ltorah dictates that it doesn’t make any sense to say that someone has to do your basic responsibility because YOU hold that by sitting in a bais medrash it is equivalent.
Actually, Chazal do, and there are enough people in the armed forces without the b’nei Torah, and the army ruins people’s ruchniyus.
Everyone has a responsibility to the tzibur, true, but arguing that everyone needs to fulfill that obligation in the same way is ludicrous. Should I consider you lacking in basic responsibility if you’re not on Hatzolah, or not a garbage collector, or not an accountant? After all, we need Hatzolah, the garbage needs to be picked up, and taxes filed. If you don’t do all of those, are you a bum?
And if you don’t think learning Torah is a benefit to the tzibur, you’re not just not agreeing with me or even gedolim such as Rav Shach (etc.), you’re arguing with Chazal.