many people feel that baalei teshuva are not set in their ways- they are still finding their place. mnay ffbs feel that is not for them.
also i have heard the taharas hamishpacha reason from many people. many times their parents did not have a kosher wedding and did not keep the halachos of taharas hamishpacha- this is a big concern for many people