It does. But no one with a brain ever said that wearing a hat is speech so I've no idea what your point is. If your idea is that people should not be physically beaten in the street for wearing a hat then, err, yeah, well done. It's called assault and is common law since forever.