Since the mods would never (and should never) allow the horor stories of what has happened with overly “friendly” men in the workplace, I will just repeat “if what they said made you feel uncomfortable you did the right thing”
Never do something your intuition feels is wrong.