If non-citizens are exempt from taxes, that might be a workable solution. But be aware than anyone, including someone with substantial income, can choose that option. If you are going to tax someone, his family and community is entitled to government services.
I don’t believe that to be true. You can have taxes on income earned in the country without providing services or being a resident. See IRS pub. 519.