| | |
Is there anything out there that can check multiple URL's for errors?
![]() |
•
•
Join Date: Dec 2007
Posts: 2
Reputation:
Solved Threads: 0
I am a web marketer, I'm worried that one of the websites I do work for could have links to error pages that are getting clicked on and accruing cost for my customer with no return.
Is there anything out there that could check URL's on mass as I have about 8000 to check and don't fancy doing it one at a time?
Thanks
Is there anything out there that could check URL's on mass as I have about 8000 to check and don't fancy doing it one at a time?
Thanks
•
•
Join Date: Dec 2007
Posts: 2
Reputation:
Solved Threads: 0
Thanks, I tried it but it seems to be only one URL at a time, and it kicked up 59 errors on the homepage alone so I think it is checking the validity of the html and not the validity of the link itself.
I'm sure there are some more commercial products with wizard-type interfaces to help you, but I don't know what they are. I do know that if you are geeky enough, you could build a script that incorporates Wget to find this out.
Wget is a non-interactive command-line utility that can retrieve web content (http/https/ftp).
http://www.gnu.org/software/wget/
In it's simplest form:
wget http://www.google.com
This will retrieve the Google home page and save it to a file in the local directory.
Wget has a recursive download option. You can specify the "depth" level of links to retrieve.
http://www.gnu.org/software/wget/man...rsive-Download
You can query the status of each request to see if you get 200 or something else--like a 404, etc.
So it's not exactly out-of-the-box plug & play for you, but a solution could be built around Wget.
Wget is a non-interactive command-line utility that can retrieve web content (http/https/ftp).
http://www.gnu.org/software/wget/
In it's simplest form:
wget http://www.google.com
This will retrieve the Google home page and save it to a file in the local directory.
Wget has a recursive download option. You can specify the "depth" level of links to retrieve.
http://www.gnu.org/software/wget/man...rsive-Download
You can query the status of each request to see if you get 200 or something else--like a 404, etc.
So it's not exactly out-of-the-box plug & play for you, but a solution could be built around Wget.
![]() |
Similar Threads
- Winsock Multi-Client Servers (C++)
- Tutorial: An introduction to Test Driven Development (Computer Science)
- memory management in wndows 2000 (Windows NT / 2000 / XP)
- Net Addict's Reality Test (Geeks' Lounge)
- no more connections can be made to this remote computer (Windows NT / 2000 / XP)
- I have a bad virus Please Help? (Viruses, Spyware and other Nasties)
- FREE Win32 RAD Assembly Tool (Assembly)
- Hard Disk Suddenly full? (Windows NT / 2000 / XP)
- a few search engine optimization questions (Search Engine Optimization)
Other Threads in the IT Professionals' Lounge Forum
- Previous Thread: website submission help...
- Next Thread: Unusued books
| Thread Tools | Search this Thread |
1gbit advertising advice amazon answers archive british broadband business businessprocesses career carrier censorship cern china cio collectiveintelligence connectivity consumer consumers corporateearnings datatransfer debtcollectors dictionary digg digital ebay ecommerce email employment environment facebook food government grid high-definition hottub infodelivery infotech intel internet interview ipod isp japan kindle lhc library malware marketing mit moonfruit news onlineshopping piracy piratebay pope porn program questions r&d religion remoteworking research retail security sex shopping simple skype smallbusiness smb sms socialmedia socialnetworking software softwareengineer spam speed spending startrek statistics stocks study stumbleupon survey tabletpc technology touch-screen touchscreen twitter uk videoinprint voips web webdeveloper windows words







