Sorry for what you are going that. If you are in a community where just about everyone does one thing and you are doing something else there will be people who will take that as a red flag and not look into it. If they are being redt enough shidduchim that may work for them. Whether right or wrong I think that’s how it is. Same with someone who works in a learning community or someone who goes to a different type of yeshiva.
It’s unfortunate that there isn’t more flexibility to allow for more differences after all some boys would be better off getting married at 20 and other and 23 and still others aren’t ready at 25.