Go to project properties, click Signing, then Create Test Certificate.

You need to renew your certificate using the renewcert thing you can find here:
http://support.microsoft.com/kb/925521


You can create a new certificate, but if this is a problem see the topic under the topic Words of Warning in the below link:

http://www.infoq.com/articles/ClickOnce-Versioning