They are not giving money to the collector. The collector is merely an agent for the Torah, and not the beneficiary.
Do you really believe that?
If you were collecting for [insert favorite cause here] and someone gave you a donation for that cause, you wouldn’t say “thank you?” even if you aren’t a beneficiary of the cause?
The Wolf