DaMoshe: It is a purely political decision of the perverts to describe men who never had any relations with any other man as a homosexual. And it is a relatively new political decision; until about the 1970s such men were never called or considered to be homosexual. They changed the terminology for political purposes to legitimize their deviancies in the eyes of the public.
Having an attraction for married women (the Gemora talks about this, by the way, that some men are especially attracted to married women) is no different than having an attraction for other men. Or of men attracted to children. If they do not act upon those deviant urges and taaivas, they are normal people with no special or different sexual description.
And, absolutely, if a man has specific taaivas for either children, men or for married women, he definitely should seek help.