CODEWITHSUNDEEP
pythonftplib
Divya Nagandla
Divya Nagandla

Reputation: 97

Pulling out the files from directories by connecting to ftp using python

task: I need to connect to clients FTP, where we have many directories and each directory may or may not have .csv files in it. Now I need to go to each directory and open the files in all directories and if the file is according to the given format then dump in a server.

Presently I'm able to connect to FTP do this much I'm able to get the directories list but not the files inside the directory.

from ftplib import FTP
from sqlalchemy import create_engine
import os
import sys
import os.path


ftp=FTP('host')
ftp.login('user','pwd')

for files in ftp.dir():
    filenames=ftp.nlst(files)
    ftp.retrbinary("RETR " + a, file.write)
    file.close()


ftp.close()  #CLOSE THE FTP CONNECTION
print "FTP connection closed. Goodbye"

I know that is not at all up to the mark.

Upvotes: 0

Views: 407

Answers (1)

alec_djinn
alec_djinn

Reputation: 10789

Looks like you are looking for a way to get a list of the files in a given directory. Here is a function I often use to solve this task in unix system (macOS included). It should be a good starting point if not the final solution you are looking for.

import glob, os
def list_of_files(path, extension, recursive=False):
    '''
    Return a list of filepaths for each file into path with the target extension.
    If recursive, it will loop over subfolders as well.
    '''
    if not recursive:
        for file_path in glob.iglob(path + '/*.' + extension):
            yield file_path
    else:
        for root, dirs, files in os.walk(path):
            for file_path in glob.iglob(root + '/*.' + extension):
                yield file_path

Also, you can use ftp.cwd('..') to change directory and ftp.retrlines('LIST') to just get the list of files of that directory. Check the docs for some useful code snippet.

Upvotes: 3

Related Questions