A small update: if I end the "explorer.exe" task via the Task Manager, then restart it manually, the files can be deleted thereafter. This is a lot better than rebooting into Safe Mode each time, but it's still pretty annoying! So, any better ideas?
Thanks muchly.