Ad:

Python Discussion Thread
Marked Solved
Views: 38153

May 30th, 2008

Working with files in os.walk

Expand Post »

I am still reading the learing python o'reilly book and not sure the best way to approch my problem.

Given c:\dir1\dir2\dir3.

I want to zip all files in dir3 if those files are older than 30 days using 1 zip file (ie. dir_3_files.zip). If all files in dir3 are older 30 days, I want to zip the directory (ie. dir3.zip). I want to recursively keep doing this until I reach the top.

This is what I have so far, but I don't know where to interrupt os.walk to work with files in a directory. I hope this makes sense.

Python Syntax (Toggle Plain Text)
import os, os.path, stat, time
from datetime import date, timedelta
 
dirsNotUsed = []
 
def getdirs(basedir, age):
    for root, dirs, files in os.walk(basedir):
        basedate, lastused = datecheck(root, age)
        if lastused < basedate:             #Gets files older than (age) days
            dirsNotUsed.append(root)
 
def datecheck(root, age):
    basedate = date.today() - timedelta(days=age)
    used = os.stat(root).st_mtime    # st_mtime=modified, st_atime=accessed
    year, day, month = time.localtime(used)[:3]
    lastused = date(year, day, month)
    return basedate, lastused
 
def archive():
    pass
 
def main():
    basedir = raw_input('Choose directory to scan: ')
    age = raw_input('Only scan files older than... (days): ')
    getdirs(basedir, int(age))
 
if __name__ == '__main__':
    main()
import os, os.path, stat, time
from datetime import date, timedelta

dirsNotUsed = []

def getdirs(basedir, age):
    for root, dirs, files in os.walk(basedir):
        basedate, lastused = datecheck(root, age)
        if lastused < basedate:             #Gets files older than (age) days
            dirsNotUsed.append(root)

def datecheck(root, age):
    basedate = date.today() - timedelta(days=age)
    used = os.stat(root).st_mtime    # st_mtime=modified, st_atime=accessed
    year, day, month = time.localtime(used)[:3]
    lastused = date(year, day, month)
    return basedate, lastused

def archive():
    pass

def main():
    basedir = raw_input('Choose directory to scan: ')
    age = raw_input('Only scan files older than... (days): ')
    getdirs(basedir, int(age))

if __name__ == '__main__':
    main()

Similar Threads

How do you install files in general on linux any operating system in Linux Applications and Software
CD's burned only play in computer...HELP!!! in Storage
Am i writing my code properly? in Python
5th IE Security Zone in Windows tips 'n' tweaks
Timing and limiting threads in Linux with pascal in Pascal and Delphi

ccandillo

Reputation Points: 10

Solved Threads: 0

Newbie Poster

Offline

16 posts
since May 2008

Permalink

May 30th, 2008

Re: Working with files in os.walk

This will traverse all of the subdirectories and do what I think you want it to do. I have added some print statements which is probably enough by itself to answer your question as is shows what the root, dirs, and files contain. If you want to limit it to 3 levels, then you will want to store root and the first 2 dirs and pass them as basedir and then just use the files for that particular directory. If you are on a Linux system, pipe the output to a file if there are a lot of files and dirs. It will be easier to read. There are other ways of doing this using an os.path.walk() callback but I assume you want to continue down this road as you are following the book.

Python Syntax (Toggle Plain Text)
import os, os.path, stat, time
from datetime import date, timedelta
 
dirsNotUsed = []
def getdirs(basedir, age):
    for root, dirs, files in os.walk(basedir):
        print "root =", root
        print "dirs =", dirs
        print "files =", files
 
        found = 1
        for file in files:
           found_file = datecheck(root, file, age)
           if not found_file :             #At least one file is not old enough
               found = 0
 
           """ or backup all of the files that are old enough
           if found_file:
              backup_list.append(os.path.join(root, file))
           """
 
        if found:
           archive(root, files)
 
def datecheck(root, file, age):
    basedate = date.today() - timedelta(days=age)
    fname = os.path.join(root, file)
    used = os.stat(fname).st_mtime    # st_mtime=modified, st_atime=accessed
    year, day, month = time.localtime(used)[:3]
    lastused = date(year, day, month)
    if lastused < basedate:             #Gets files older than (age) days
       return 1
    return 0                                  # Not old enough
 
def archive(root, files):
   for file in files:
      fname=os.path.join(root, file)
      print "archiving", fname
 
if __name__ == '__main__':
    basedir = raw_input('Choose directory to scan: ')
    age = raw_input('Only scan files older than... (days): ')
    getdirs(basedir, int(age))
import os, os.path, stat, time
from datetime import date, timedelta

dirsNotUsed = []
def getdirs(basedir, age):
    for root, dirs, files in os.walk(basedir):
        print "root =", root
        print "dirs =", dirs
        print "files =", files

        found = 1
        for file in files:
           found_file = datecheck(root, file, age)
           if not found_file :             #At least one file is not old enough
               found = 0

           """ or backup all of the files that are old enough
           if found_file:
              backup_list.append(os.path.join(root, file))
           """

        if found:
           archive(root, files)

def datecheck(root, file, age):
    basedate = date.today() - timedelta(days=age)
    fname = os.path.join(root, file)
    used = os.stat(fname).st_mtime    # st_mtime=modified, st_atime=accessed
    year, day, month = time.localtime(used)[:3]
    lastused = date(year, day, month)
    if lastused < basedate:             #Gets files older than (age) days
       return 1
    return 0                                  # Not old enough

def archive(root, files):
   for file in files:
      fname=os.path.join(root, file)
      print "archiving", fname

if __name__ == '__main__':
    basedir = raw_input('Choose directory to scan: ')
    age = raw_input('Only scan files older than... (days): ')
    getdirs(basedir, int(age))

Last edited by woooee; May 30th, 2008 at 5:29 pm.

woooee

Reputation Points: 741

Solved Threads: 691

Nearly a Posting Maven

Offline

2,302 posts
since Dec 2006

Permalink

Jun 2nd, 2008

Re: Working with files in os.walk

For my first script, I thought I didn't do to bad. This makes much more sense to me now. By simply adding the extra print statements, found flag and the returns from the datecheck funtion really helped!

Thanks!

ccandillo

Reputation Points: 10

Solved Threads: 0

Newbie Poster

Offline

16 posts
since May 2008

Permalink

Jun 2nd, 2008

Re: Working with files in os.walk

Quote ...

By simply adding the extra print statements

That solves a lot of problems. You can also use os.path.walk with a callback.

Python Syntax (Toggle Plain Text)
def processDirectory ( args, dirname, filenames ):                              
    print 'Directory',dirname                                                   
    for filename in filenames:                                                  
       print '     File',filename                                               
 
top_level_dir = "/usr/local"                                                    
os.path.walk(top_level_dir, processDirectory, None )                            
 
##os.path.walk() works with a callback: processDirectory() will be              
##called for each directory encountered.
def processDirectory ( args, dirname, filenames ):                              
    print 'Directory',dirname                                                   
    for filename in filenames:                                                  
       print '     File',filename                                               
                                                                                
top_level_dir = "/usr/local"                                                    
os.path.walk(top_level_dir, processDirectory, None )                            
                                                                                
##os.path.walk() works with a callback: processDirectory() will be              
##called for each directory encountered.

Last edited by woooee; Jun 2nd, 2008 at 7:14 pm.

woooee

Reputation Points: 741

Solved Threads: 691

Nearly a Posting Maven

Offline

2,302 posts
since Dec 2006

This thread is solved

Either the thread starter or a moderator has marked this thread as solved. You can most likely trust the responses and answers given. There is most likely no reason for any further responses to be posted here. If you have a related question, please start a new thread in this forum instead.

This thread is more than three months old

No one has posted to this discussion for at least three months. Please let old threads die and do not reply to them unless you feel you have something new and valuable to contribute that absolutely must be added to make the discussion complete. Otherwise, please start a new thread in this forum instead.

Previous Thread in Python Forum Timeline: Beginner Needs Help PYTHON student

Next Thread in Python Forum Timeline: problems with pygame

DaniWeb Message

Cancel Changes

User Name
Password