1) Not every yodle who was given smich somewhere is a talmid chochom. 2) Many talmidei chachomem don’t have smicha. You should give respect, including with the honorific, to talmidei chachomim without smicha and you need not honor a non-talmid chochom who has smicha – including refraining from giving him the honorific.
Also, a true rov can be called Rav, which means more than Rabbi. And even larger talmidei chachomim (yes, some rabbis are of greater stature than other rabbis) can be referred to with additional honorifics, i.e. Maran, HaGaon, etc.