Its totally the opposite.
Its hard to reject everything youve known from childhood for what you know is the truth, but the fact is youve seen how empty and wrong it is and you know you are choosing something better.
On the other hand, people who have not been exposed find it hard not to be tempted by things they see that look like fun, and they want to try it. To be able to withstand those temptations, thinking you are probably missing out, but still holding back because you know Hashem wont be happy, is much more special.
Another point – most adults who live a frum lifestyle, do so by choice, not copycatting.