This exactly. Using even the most hateful, vile language doesn't rise to the level of violence. I can call your mother every name under the sun and you can punch me in the jaw for it, but if I decide to press the issue, you're the one who's getting the assault charge.

It's also not okay to punch a Nazi. It's not okay to punch a real Nazi, if you saw one in full Nazi regalia on the side of the street, acting peacefully. And it's certainly not okay to punch a person you subjectively claim to be a Nazi because you disagree with their politics.