| | |
How to extract data from web databases?
Please support our Database Design advertiser: PostgreSQL or MySQL? Compare and contrast the two most popular open source databases
![]() |
•
•
Join Date: Aug 2004
Posts: 1
Reputation:
Solved Threads: 0
Hi all, anyone know how to extract data from a web database. For example, how can I extract movie information from http://www.imdb.com/ into a relational database? Is there any existing tools to do this? Or need I write some codes?
Thanks a lot!
Thanks a lot!
Their database has to be open to the public which no serious company would ever do due to security reasons. Instead some create a web service where you can access their data through XML. Amazon.com does this. I'm not sure about imdb.com. In any case, you can still extract html data from pages on the imdb server using your favorite server language. You'd then have to parse the data. It's a dirty way to do it, but it's doable.
Check out my blog at http://www.shinylight.com for more stuff about web dev.
•
•
Join Date: Nov 2004
Posts: 1
Reputation:
Solved Threads: 0
Hi
Iam a professional web data extractor.
We can do in Visual BAsic for web data extraction by automatically submitting some input and extract results in to MS Access
If required, I can quote for the site you specify
Contact at raathisoft@hotmail.com
Venkat
Iam a professional web data extractor.
We can do in Visual BAsic for web data extraction by automatically submitting some input and extract results in to MS Access
If required, I can quote for the site you specify
Contact at raathisoft@hotmail.com
Venkat
Remember that doing what you intend could well be viewed as data theft and/or a violation of the terms of service of the site.
You are effectively bypassing whatever mechanism the site has (usually sponsorship through advertising) in ripping the information.
Before you bring any such service live be sure to get permission from the site owners.
You are effectively bypassing whatever mechanism the site has (usually sponsorship through advertising) in ripping the information.
Before you bring any such service live be sure to get permission from the site owners.
•
•
Join Date: Oct 2005
Posts: 7
Reputation:
Solved Threads: 0
Hi all, anyone know how to extract data from a web database. For example, how can I extract movie information from http://www.imdb.com/ into a relational database? Is there any existing tools to do this? Or need I write some codes?I m in need of movie information since I m doing a project named as recommender system for movie.
•
•
Join Date: Oct 2005
Posts: 7
Reputation:
Solved Threads: 0
Hi all, anyone know how to extract data from a web database. For example, how can I extract movie information from http://www.amazon.com/ into a relational database? Is there any existing tools to do this? Or need I write some codes?I am in need of movie information since I am doing a project in recommender system for movie.Please reply me for this
![]() |
Other Threads in the Database Design Forum
- Previous Thread: Which software will work best
- Next Thread: Country ID Proof for India ,
| Thread Tools | Search this Thread |





