maybe give him a loaf of bread.
funny story- my mother once rolled down the window to give money to a non-jew who was collecting at a stoplight. he thanked her as the light turned green, and she pulled away and called “dont spend it on booze and cigarettes!”