HELP! Return URLs in redirect chain

Expand Post »

Hi,

I'm stuck with a certain problem. I'm using URLLIB2 to get the end url of a list of links. This was pretty straightforward. Some of the links I'm probing pass through 1 or more other urls before landing the user at the end destination.

For example, the start url might be 1, but then you only end up at 3 after a quick and probably unnoticeable redirect to 2:

Python Syntax (Toggle Plain Text)
http://click.someurl.net/script?query=somedata
http://bridge.url.net/redirect?url=http://thenewurl.com
http://thenewurl.com
http://click.someurl.net/script?query=somedata
http://bridge.url.net/redirect?url=http://thenewurl.com
http://thenewurl.com

In my code url 1 is passed to my function, and url 3 is returned, but how do I capture/return any URL in between the start and end points?

Thanks in advance for any help!

LB

Similar Threads

vBulletin mod_rewrite in PHP
I want google to index forum threads in Search Engine Optimization
Take part of URL, put into form, post to database. in PHP

LB22

Reputation Points: 10

Solved Threads: 0

Newbie Poster

Offline

1 posts
since Nov 2009

Permalink

Nov 11th, 2009

Use a generator function/method

Your post does not provide many details, but I think what you are looking for is a generator function., Instead of returning an URL, yield each URL, like this:

Python Syntax (Toggle Plain Text)
def generateURLs(startingURL):
    url = startingURL
    ...
    while url:
        yield url
        url = getNextURL(url)
...
for url in generateURLs(http://click.someurl.net/script?query=somedata):
    print url
def generateURLs(startingURL):
    url = startingURL
    ...
    while url:
        yield url
        url = getNextURL(url)
...
for url in generateURLs(http://click.someurl.net/script?query=somedata):
    print url

pythopian

Reputation Points: 20

Solved Threads: 25

Junior Poster in Training

Offline

81 posts
since Nov 2009

This thread is more than three months old

No one has posted to this discussion for at least three months. Please let old threads die and do not reply to them unless you feel you have something new and valuable to contribute that absolutely must be added to make the discussion complete. Otherwise, please start a new thread in this forum instead.

Previous Thread in Python Forum Timeline: Tasparent window inside a visible frame

Next Thread in Python Forum Timeline: A newbie question of sorts

DaniWeb Message

Cancel Changes

User Name
Password