Tashlich is different. In all the places I know the people only go to tashlich in a place where there is no swimming. There are many such available places in NYC, being NYC is situated on three different islands.
Even if dressed tzniusly, there would be a problem with being in public in wet clothing. Also, isn’t there a safety concern when there’s no lifeguard?