I'd imagine that you have your DNS settings in your OS to obtain IP and DNS servers automatically.

One thing to check - what's the DNS settings on the router set to? I've found that sometimes you need to explicity set the DNS servers for your ISP within the router rather than letting the router pick them up automatically otherwise nothing will resolve and you'll get the error messages that you describe.

Regards,

Martyn