It’s good to have a friend / relative / rebbi / wise person / confidant to discuss these questions with and help you decide if your concern(s) are legitimate.
You also need to have confidence in your own judgement. If you’re always not able to decide yes or no about the person you’re dating, you’re defeating the purpose of dating. That doesn’t mean people don’t have uncertainties – almost all of us do – but to be unsure about everyone is a problem.
A good start might be discussing this with your rebbi / shadchan.
Hatzlocha.