While I certainly understand the symbolism behind the manner of dress, I think people should put more emphasis on the internal than external factors.
I know plenty of people who wear a kippa seruga that are “Frummer” than others I know who wear a black hat.
While this is an extreme example, the guy selling treif chickens, as kosher, in Monsey wore a black hat, gave shiurim and was a very well respected member of the community. He may look the part, but that’s where it ended.
People shouldn’t be so hasty to judge and pigeonhole others by the external.