Err... have you ever read 1984? The entire concept is that once we let the government take away small freedoms like that, even extremely subjectively, they will begin to do more and more very slowly. People won't even notice because they will be numbed to the effect.
With your argument, sleepy jack, how would me saying that I hate a particular group of people affect the personal safety of anyone? That's not how most people feel anyway; those that make statements like that are usually not very well liked anyways. And like Janszoon said, think how easily the government could use a rule banning, say, the KKK to shut down whatever they want? It would be up to the ruling body to determine what is considered inappropriate. For example, they could decide to say that criticism of music is insulting to musicians
that should put the point home here.
And I read one and realized it wasn't worth my time.