Im pondering creating a large database of items each with 10 or so variable values attached for a database with some advanced searching features. All of this item information is allready available on the internet but this would require me manually entering a LOT of information. How hard a task would it be to write a bot which would go through each page of information writing it in a suitable format into a file.
Haze
0
Newbie Poster
pritaeas
2,194
¯\_(ツ)_/¯
Moderator
Featured Poster
Check out the new browser Kirix Strata. It is designed to gather and store information from the internet. It's quite useful. (http://www.kirix.com/) You could write a bot, but I think you can better put your energy in adjusting the scripts and let the browser do the work for you.
Be a part of the DaniWeb community
We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.