People tend to like living near people of their own color.

This is true, but the affinity is not really about color, it is more about similarity and already knowing some of the people. America has always had towns and neighborhoods with majority Irish, Italian, Portuguese, or whatever. We didn't used to see that as an evil to be destroyed.