RSS Forums RSS
Please support our Database Design advertiser: Programming Forums
Views: 24593 | Replies: 21
Reply
Join Date: Aug 2004
Posts: 1
Reputation: bei is an unknown quantity at this point 
Rep Power: 0
Solved Threads: 0
bei bei is offline Offline
Newbie Poster

How to extract data from web databases?

  #1  
Aug 30th, 2004
Hi all, anyone know how to extract data from a web database. For example, how can I extract movie information from http://www.imdb.com/ into a relational database? Is there any existing tools to do this? Or need I write some codes?

Thanks a lot!
AddThis Social Bookmark Button
Reply With Quote  
Join Date: Feb 2002
Location: Long Island, NY
Posts: 1,134
Reputation: samaru is just really nice samaru is just really nice samaru is just really nice samaru is just really nice 
Rep Power: 12
Solved Threads: 4
Colleague
samaru's Avatar
samaru samaru is offline Offline
a.k.a inscissor

Re: How to extract data from web databases?

  #2  
Sep 2nd, 2004
Their database has to be open to the public which no serious company would ever do due to security reasons. Instead some create a web service where you can access their data through XML. Amazon.com does this. I'm not sure about imdb.com. In any case, you can still extract html data from pages on the imdb server using your favorite server language. You'd then have to parse the data. It's a dirty way to do it, but it's doable.
_.:: my websites ::._
blog @ www.samaru.net * engi No Jutsu @ www.narutorp.net * portfolio @ shinylight.com
deviantART: inscissor
Reply With Quote  
Join Date: Nov 2004
Posts: 1
Reputation: raathisoft is an unknown quantity at this point 
Rep Power: 0
Solved Threads: 0
raathisoft raathisoft is offline Offline
Newbie Poster

Re: How to extract data from web databases?

  #3  
Nov 19th, 2004
Hi
Iam a professional web data extractor.
We can do in Visual BAsic for web data extraction by automatically submitting some input and extract results in to MS Access
If required, I can quote for the site you specify
Contact at raathisoft@hotmail.com
Venkat
Reply With Quote  
Join Date: Nov 2004
Location: Netherlands
Posts: 5,752
Reputation: jwenting is a jewel in the rough jwenting is a jewel in the rough jwenting is a jewel in the rough jwenting is a jewel in the rough 
Rep Power: 19
Solved Threads: 200
Colleague
jwenting's Avatar
jwenting jwenting is offline Offline
duckman

Re: How to extract data from web databases?

  #4  
Nov 19th, 2004
Remember that doing what you intend could well be viewed as data theft and/or a violation of the terms of service of the site.

You are effectively bypassing whatever mechanism the site has (usually sponsorship through advertising) in ripping the information.

Before you bring any such service live be sure to get permission from the site owners.
Reply With Quote  
Join Date: Oct 2005
Posts: 7
Reputation: kalpana is an unknown quantity at this point 
Rep Power: 0
Solved Threads: 0
kalpana kalpana is offline Offline
Newbie Poster

Re: How to extract data from web databases?

  #5  
Mar 14th, 2006
Hi all, anyone know how to extract data from a web database. For example, how can I extract movie information from http://www.imdb.com/ into a relational database? Is there any existing tools to do this? Or need I write some codes?I m in need of movie information since I m doing a project named as recommender system for movie.
Reply With Quote  
Join Date: Oct 2005
Posts: 7
Reputation: kalpana is an unknown quantity at this point 
Rep Power: 0
Solved Threads: 0
kalpana kalpana is offline Offline
Newbie Poster

Re: How to extract data from web databases?

  #6  
Mar 14th, 2006
what is a semantic web?
Reply With Quote  
Join Date: Oct 2005
Posts: 7
Reputation: kalpana is an unknown quantity at this point 
Rep Power: 0
Solved Threads: 0
kalpana kalpana is offline Offline
Newbie Poster

Re: How to extract data from web databases?

  #7  
Mar 14th, 2006
how to extract rdf documents into a relational database
Reply With Quote  
Join Date: Oct 2005
Posts: 7
Reputation: kalpana is an unknown quantity at this point 
Rep Power: 0
Solved Threads: 0
kalpana kalpana is offline Offline
Newbie Poster

Re: How to extract data from web databases?

  #8  
Mar 14th, 2006
Hi all, anyone know how to extract data from a web database. For example, how can I extract RDF documents into relational database
Reply With Quote  
Join Date: Oct 2005
Posts: 7
Reputation: kalpana is an unknown quantity at this point 
Rep Power: 0
Solved Threads: 0
kalpana kalpana is offline Offline
Newbie Poster

Re: How to extract data from web databases?

  #9  
Mar 14th, 2006
Hi all, anyone know how to extract data from a web database. For example, how can I extract RDF documents into relational database since I am doing a project in semantic web
Reply With Quote  
Join Date: Oct 2005
Posts: 7
Reputation: kalpana is an unknown quantity at this point 
Rep Power: 0
Solved Threads: 0
kalpana kalpana is offline Offline
Newbie Poster

Re: How to extract data from web databases?

  #10  
Mar 14th, 2006
Hi all, anyone know how to extract data from a web database. For example, how can I extract movie information from http://www.amazon.com/ into a relational database? Is there any existing tools to do this? Or need I write some codes?I am in need of movie information since I am doing a project in recommender system for movie.Please reply me for this
Reply With Quote  
Reply

Only community members can participate in forum threads. You must register or log in to contribute.

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)

 

Thread Tools Display Modes
Forums | Blogs | Tutorials | Code Snippets | Whitepapers | RSS Feeds | Advertising
All times are GMT -4. The time now is 8:05 am.
Newsletter Archive - Sitemap - Privacy Statement - Contact Us
Forum system based on vBulletin Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
©2003 - 2008 DaniWeb® LLC