I think we have indeed seen him without his had. One skit had him tasting something that was soo hot that his hat popped right off the top of his head and steam came out his ears.
That's the only time I can really think of off the top of my head, but I'm pretty sure there were others.
~Beth C