hi forum,
i m developing a simple web crawler in java.upon entering an URL, the crawler downloads the corresponding web page and continues this process.but i m having problem in accessing web pages which are redirected to a diferent URL.one such example is www.telegraphindia.com ,in which a new part gets added to the original URL. can anybody help.thanks in advance.
Dark Master
0
Newbie Poster
Recommended Answers
Jump to PostLet's look at the response when requesting this page:
HTTP/1.1 302 Object moved Date: Tue, 13 Sep 2005 16:06:26 GMT Server: Microsoft-IIS/6.0 X-Powered-By: ASP.NET Location: section/frontpage/index.asp Content-Length: 148 Content-Type: text/html Set-Cookie: ASPSESSIONIDACTBSRRB=FALIOKOCIJNCLJAPOONLFLCF; path=/ Cache-control: private <head><title>Object moved</title></head> <body><h1>Object Moved</h1>This object may be found <a HREF="section/frontpage/index.asp">here</a>.</body>
The header …
All 3 Replies
Reply to this topic
Be a part of the DaniWeb community
We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.