In most cases I do not call back.
Leaving a message is not associated with any difficulties, leave a message so that the person you called should know that you are expecting his call-back.
Otherwise, assume that this person belongs to the group of people that does not return calls if you tried calling them.
When I see that someone tried calling me multiple times over a short period of time, I do call them back, as it might be an urgent matter.