Their is a halacha for a guest to not start a conversation with the avel and the avel should initiate. The man was giving you a pen so you will start the conversation, “Huh, what is this for???”. At that point he has the right to respond.
There are no bad motives in this story.