Im pondering creating a large database of items each with 10 or so variable values attached for a database with some advanced searching features. All of this item information is allready available on the internet but this would require me manually entering a LOT of information. How hard a task would it be to write a bot which would go through each page of information writing it in a suitable format into a file.
Haze 0 Newbie Poster
pritaeas 2,211 ¯\_(ツ)_/¯ Moderator Featured Poster
Check out the new browser Kirix Strata. It is designed to gather and store information from the internet. It's quite useful. (http://www.kirix.com/) You could write a bot, but I think you can better put your energy in adjusting the scripts and let the browser do the work for you.
Be a part of the DaniWeb community
We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.