“The Gemorah Bava Basra and L’havdil, the Gedolim in Eretz Yisroel disagree with you.”
I personally asked Harav Moshe Heinemann, shlita, this very question. He replied that supporting able-bodied people who choose to learn in kollel, while laudable, is not considered tzedaka, which is mandatory. It’s considered hachzakas haTorah, which is completely voluntary.
The Gemara in Bava Basra is discussing tzedaka, which is mandatory and therefore ch”v taken by force if not given willingly. Tzedaka is to help those who can’t otherwise help themselves. Not to help those who choose not to help themselves, whatever the reason.