I am interested in starting to work on a recipe search engine. The problem is though, is getting the recipes. I would like to access the ones in the top online recipe search engines, but I am not sure what way would be the most efficient and most legal way to do this.
Here are the options I am considering:
- On-the-fly screen scraping
- Screen scraping in advance and creating a massive database
- A combination of the two, scraping on-the-fly and then saving it to a database that will be checked along with the other sites
- Finding some free API
Which of these would be the best, in your opinion, as well as being legal?
To see some sites that do something similar to this see SNIP, SNIP and SNIP