Charedim tend to be very isolationist. They do not mingle with outsiders much. So outsiders dont get much of an opinion of them.
One can say mingling with dati leumi, Chilonim and goyim is bad so positive or neutral exchanges are rare.
They ONLY time non charedim will generally mingle with non charedim is when they are forced and usually under negative circumstances , which makes it worse and unfortunatly does not help.
Would you have a positive view of a group of people who you dont know personally, but have them throw stones at you?
If there was some more mingling the outside world would realize the stone throwers are not the majority and just a bunch of crazy people, which people will accept.