im currently writing a program in python to parse a log file..
this log file is expected to be very big - (70MB - 250MB ) in size..
in the file there's this whole bunch lines of internet activity..
i supposed to parse each line and extract some information..
i dont want to read all lines in the file at once.. and im pretty sure there is a better way to do it...
is there any site or any guidelines in dealing with large text file..
could someone post a reasonable tutorial/efficient algorithm to parse a very big text file..
or if there is someone in here that have already had this experience of dealing with a files like this, some tips/tricks would be very appreciated..
i really am a newbie in python...thanks