Most cats are lactose intolerant. Giving them milk will only create a bigger mess.
If you do want to feed the cats (which by the way, will almost guarantee that they will not go away), the best thing to do would be do by cat food at your local pet store.