if you’re nervous about it, that’s a good sign that there IS some problem with it, for you. While other people may be able to do this and stay frum, some people are affected more than others.
To me, the problem is – Why do you not feel like you can socialize with other frum people? Are you comfortable with Baalei Teshuva who have integrated with the community?
We need friends and should have as many as possible, but we also need to develop friends, adn that takes effort. It says knei lecha chaver, buy yourself a friend, and having a friend is just as important as having a rabbi.
Please keep us updated how your relationship is going adn how youa re developing new friends int he frum world.
Have a wonderful shabbos!