943,866 Members | Top Members by Rank

Ad:
Dec 13th, 2007
0

Is there anything out there that can check multiple URL's for errors?

Expand Post »
I am a web marketer, I'm worried that one of the websites I do work for could have links to error pages that are getting clicked on and accruing cost for my customer with no return.

Is there anything out there that could check URL's on mass as I have about 8000 to check and don't fancy doing it one at a time?

Thanks
Similar Threads
Reputation Points: 10
Solved Threads: 0
Newbie Poster
markybthedaddy is offline Offline
2 posts
since Dec 2007
Dec 14th, 2007
0

Re: Is there anything out there that can check multiple URL's for errors?

Welcome to daniweb

This might help you!!!

http://validator.w3.org/checklink

Good luck!
Reputation Points: 1054
Solved Threads: 28
Nearly a Senior Poster
The Dude is offline Offline
3,425 posts
since Dec 2005
Dec 14th, 2007
0

Re: Is there anything out there that can check multiple URL's for errors?

Click to Expand / Collapse  Quote originally posted by The Dude ...
Welcome to daniweb

This might help you!!!

http://validator.w3.org/checklink

Good luck!
Thanks, I tried it but it seems to be only one URL at a time, and it kicked up 59 errors on the homepage alone so I think it is checking the validity of the html and not the validity of the link itself.
Reputation Points: 10
Solved Threads: 0
Newbie Poster
markybthedaddy is offline Offline
2 posts
since Dec 2007
Dec 16th, 2007
0

Re: Is there anything out there that can check multiple URL's for errors?

I'm sure there are some more commercial products with wizard-type interfaces to help you, but I don't know what they are. I do know that if you are geeky enough, you could build a script that incorporates Wget to find this out.

Wget is a non-interactive command-line utility that can retrieve web content (http/https/ftp).
http://www.gnu.org/software/wget/

In it's simplest form:
wget http://www.google.com
This will retrieve the Google home page and save it to a file in the local directory.

Wget has a recursive download option. You can specify the "depth" level of links to retrieve.
http://www.gnu.org/software/wget/man...rsive-Download

You can query the status of each request to see if you get 200 or something else--like a 404, etc.

So it's not exactly out-of-the-box plug & play for you, but a solution could be built around Wget.
Reputation Points: 36
Solved Threads: 6
Posting Whiz
Troy is offline Offline
354 posts
since Jun 2005
Jan 5th, 2008
0

Re: Is there anything out there that can check multiple URL's for errors?

Hi, I can do it with a program... I have my programs do it all the time, to make sure "image links" i use on websites are valid, otherwise i fill in the image with a generic image. if you still need help, stenson1 at gmail dot com.
Team Colleague
Reputation Points: 14
Solved Threads: 29
Posting Whiz in Training
ericstenson is offline Offline
293 posts
since Dec 2007

This thread is more than three months old

No one has posted to this discussion for at least three months. Please let old threads die and do not reply to them unless you feel you have something new and valuable to contribute that absolutely must be added to make the discussion complete. Otherwise, please start a new thread in this forum instead.
Message:
Previous Thread in IT Professionals' Lounge Forum Timeline: 2008 CES Should Be a Wireless Affair
Next Thread in IT Professionals' Lounge Forum Timeline: Unusued books





About Us | Contact Us | Advertise | Acceptable Use Policy
Forum Index | Build Custom RSS Feed


Follow us on Twitter


© 2011 DaniWeb® LLC