People like to live with like minded people. People who have the same general outlook on things . While they may not agree 100% on things, they generally will agree. People you will go over to each others houses, Have your kids play with their kids etc.
It is sinas Chinam to say I wont live with THOSE people. Like the poster who said If you want to live like a Nochri move to Teaneck. However its NOT Sinas chinam to say I want to live with these people. ie I want to live in an area with lots of Chassidish velt, lots of Shteibels. Yiddish widely spoken. etc.
Decide who you want to live with, not who you DONT want to live with