@Singlemomof4 I’m sorry for you pain. Unfortunately this is not the only thing that has stigma in the frum community. Abuse, mental illness, coming from a neglectful home, and so so much more are also that way. There’s many things that need to change.
Remember though although the community or society can feel and seem messed up and unfair, Hashem runs the world. He will send your children fiends, you friends, shidduchim, etc.