To minimize it to the system tray, start regedit and follow the steps below:
HKEY_CURRENT_USER \ Software \ Microsoft \ Office \ 10.0 \ Outlook \ Preferences
New Data Type: REG_DWORD
Value Name: MinToTray
Data: 1 (0 to disable MinToTray)
Close regedit and your good to go.