I am looking for a script that can crawl specified sites at retrieve data, something sophisticated enough to parse and ignore unwanted tags.

If it can do more that would be great but that is the foundation. Does anyone know where I can get such a script.

Try wget and curl.

Be a part of the DaniWeb community

We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.