you can't delete it. it is incorporated into IE. You have to go to the properties by right clicking the links folder and clicking hidden to make it go away, but still remain latent.
Set the String value of "LinksFolderName" to equal a blank string. Open IE and delete the Links folder from the Favorites menu. The next time you start Internet Explorer the Links folder will not be recreated.