The Rambam in Hilchos Ishus Perek ?? Halacha ? discusses one who is so attached to the Torah like Ben Azzai that he is patur from getting married and having children. The Rambam says that if his Yetzer harah is overcoming him causing him to be attracted to women he must get married to subdue his desires. I considered this amazing that someone at such a madreigah can still have such problems. This is a chizuk to those who have done aveiros and feel that this makes them “nobodies”
P.S. Note even the Vilna Gaon got married.
P.S.S. I thought that love of Torah and physical desires contradict each other?
P.S.S. Note even Moshe Rabeinu got married and only separated because of his prophetic status.