That's exactly what it means unfortunately. This is why someone can sue for slander because the Freedom of Speech only protects you from Government backlash, not from someone that you piss off with what you say. It's also why If one were to attack someone for what they say, the aggressor in the case, is the one that attacks, not the one talking shit.

This is why I say that the Freedom of Speech is akin to Cruise control, You still have to control yourself.