CODEWITHSUNDEEP
pythonpython-2.7sftpparamiko
Cian
Cian

Reputation: 1629

IOError: [Errno 2] No such file - Paramiko put()

I'm uploading a file via SFTP using Paramiko with sftp.put(localFile, remoteFile). I make the necessary directory first if needed with 

    makeCommand = 'mkdir -p "' + remotePath + '"'
    ssh.exec_command(makeCommand)

this was works sometimes but I'm occasionally getting the following error:

    sftp.put(localFile, remoteFile)
    File "build/bdist.macosx-10.8-intel/egg/paramiko/sftp_client.py", line 565, in put
    File "build/bdist.macosx-10.8-intel/egg/paramiko/sftp_client.py", line 245, in open
    File "build/bdist.macosx-10.8-intel/egg/paramiko/sftp_client.py", line 635, in _request
    File "build/bdist.macosx-10.8-intel/egg/paramiko/sftp_client.py", line 682, in _read_response
    File "build/bdist.macosx-10.8-intel/egg/paramiko/sftp_client.py", line 708, in _convert_status
    IOError: [Errno 2] No such file

despite the fact that the local file definitely exists (and localFile is the correct path to it) and the remote path is made. There is discussion here and here on a similar problem but none of the points raised there have helped me. My server supports the df -hi command. Has anyone any advice on this or a possible solution?

EDIT

After suggestions below I tried changing the working directory with sftp.chdir(remoteDirectory) but this call produced the exact same error as above. So it seems this isn't just an upload issue. Any ideas?

Upvotes: 11

Views: 38746

Answers (6)

Alpa
Alpa

Reputation: 291

Had the same issue. In my case it was a timing problem:

self.mkdir(remote_dir)
sftp.put(local_file, remote_file)

The mkdir() function, which had

ssh.exec_command(f"mkdir -p {remote_dir}")

in it, didn't finish fast enough.

Changing the original code to

self.mkdir(remote_dir)
sleep(0.01)
sftp.put(local_file, remote_file)

fixed it.

Upvotes: 1

Amit
Amit

Reputation: 13

I faced the same issue. it was a silly mistake.

  • Just use sftp.stat(your remote directory) to check if it's there.
  • then use sftp.put(localfileabsolutepath, remotedir+filename)

It will work for sure.

Upvotes: 1

Timmah
Timmah

Reputation: 2121

The put method has a confirm parameter which is enabled by default, which will do a stat on the file after transfer.

In my case, the remote server i was transferring the file to, immediately moved any transferred files to another location to get processed which was causing the stat to fail. Setting the confirm parameter to False resolved this.

def put(self, localpath, remotepath, callback=None, confirm=True):

From the paramiko source sftp_client.py:

:param bool confirm: whether to do a stat() on the file afterwards to confirm the file size (since 1.7.7)

Upvotes: 20

Cian
Cian

Reputation: 1629

It seems to be a remote folder permission problem. Although the remote folder was made before the file was uploaded, it appears the permissions on the folder were preventing an upload.

The problem is linked to this issue - if I set open permissions on the folder I'll be uploading to before I upload, the program can upload fine. Although for a permission issue I should be getting IOError: [Errno 13] Permission denied, since I made the changes I haven't encountered any errors.

I'm not sure if it's the response the server is giving Paramiko which is the issue, or a bug in Paramiko itself which is causing IOError: [Errno 2] No such file instead of a Errno 13, but this appears to have solved the problem.

Upvotes: 14

Brian
Brian

Reputation: 21

Are you sure the directory has been created and it is your remote working directory? Paramiko has its own methods for creating new directories and navigating the remote file system. Consider using something like:

sftp.mkdir(remotedirectory)
sftp.chdir(remotedirectory)
sftp.put(localfile, remotefile)

Upvotes: 2

danodonovan
danodonovan

Reputation: 20343

The IOError is local, so (for whatever reason) it seems that your local python cannot find localFile. Safety checking this before the call might help tracking down the problem:

if os.path.isfile(localFile):
    sftp.put(localFile, remoteFile)
else:
    raise IOError('Could not find localFile %s !!' % localFile)

If you're positive that localFile does exist, then this could just be a path problem - is localFile on an absolute or relative path? Either way, the if statement above will catch it.

EDIT

Tracing through the paramiko files shows that line 245 of sftp_client.py (the one throwing the exception) is actually

fr = self.file(remotepath, 'wb')

which is quite misleading as paramiko throws an IOError for a remote file! My best guess now is that remoteFile is either a missing directory or a directory you don't have access to.

Out of interest, can you list the remote dir

sftp.listdir(path=os.path.dirname(remoteFile))

to check that it's there (or maybe it's there and you can write to it)?

Upvotes: 2

Related Questions