To minimize it to the system tray, start regedit and follow the steps below:

HKEY_CURRENT_USER \ Software \ Microsoft \ Office \ 10.0 \ Outlook \ Preferences
New Data Type: REG_DWORD
Value Name: MinToTray
Data: 1 (0 to disable MinToTray)

Close regedit and your good to go.