That's because whites are the only race that cowers and grovels when someone calls them racist. All other cultures/races will basically tell you to go fuck yourself if you call them racist, therefore the label has no power over them.

They call whites racist because it's a proven method of control over whites.