People used to not have last names. You were Ploni ben Ploni Mi Yehupitz. Adding second names was a way for each person with the same name in the same locale to have a more distinct nomenclature.
Some combinations became very popular, such as Daniel Yehuda and Menahem Mendel.