Why "Black Hat"? Is there something specially evil in the hat?

Of course there is! The hat is the symbol of my organization, it represents me! And there's nothing more evil than me!