I am looking for a script that can crawl specified sites at retrieve data, something sophisticated enough to parse and ignore unwanted tags.
If it can do more that would be great but that is the foundation. Does anyone know where I can get such a script.