As someone who is essentially a male carbon copy of what you described, i had no problems being rehdt to choshuve families in the Yeshiva world. It’s more about your current association, the company you keep, and how much you’ve integrated into the community. Going the right seminary matters a lot – the same way the Yeshiva a boy chooses does as well.
If you’re only recently becoming more frum post seminary years, then you might find some difficulty, but ultimately the right person won’t care, and there are plenty of young men who are in your situation.