Sometimes you just have to learn to let go. If I had a good backup of my data I would just toss the pain in the rear hard-drive and get another. Storage is cheap and you don't need the aggravation.
...

When you go to shutdown your computer close everything down to your desktop. Open "Task Manager" and see if the "Process" Outlook.exe is still running.

To open taskmanager: Rightclick on bottom...