In my opinion, I say embrace it. Whether we are called radical or racist, neither has any true meaning any more because of its flippant use. So accept the label and move on. Don't be afraid of their inaccurate labels - just turn around and shove them in their face by not giving them examples to prove them right, but wearing the labels as a badge anyway.