caperjack - that removes the big calendar button, but it doesn't remove calendar from the "Favorite Folders" list.

With normal folders, you can right click them and say "Remove from favorite folders, as per here: http://office.microsoft.com/en-us/outlook/HA011176721033.aspx

However, Calendar and Contacts don't...