That guest is right, white people do need to stop giving a fuck if they look racist or not. Saying "im not racist" never does anything but make you look defensive.

State facts and speak the truth. If youre truly not racist you dont have to care that somebody is calling you that.