Go to a hotel lobby or a lounge near some sightseeing areas. This way if either of you get bored sitting to long (which happened in my case) you can always take a walk and see something.
My first date ever, (with my husband) started in the Grand Hyatt Hotel lobby and ended up in Grand Central Station.