CODEWITHSUNDEEP
amazon-s3apache-nifi
Greg
Greg

Reputation: 141

How to create directories in AWS S3 using Apache NiFi putS3Object

I have a working config to push files from a directory on my server to an S3 bucket. NiFi is running on a different server so I have a getSFTP. The source files have subfolders my putS3Object current config does not support and jams all of the files at the root level of the S3 bucket. I know there's a way to get putS3Object to create directories using defined folders. The ObjectKey by default is set to ${filename}. If set to say, my/directory/${filename}, it creates two folders, my and the subfolder directory, and puts the files inside. However, I do NOT know what to set for the object key to replicate the file(s) source directories.

Upvotes: 0

Views: 2342

Answers (1)

Ashaman Kingpin
Ashaman Kingpin

Reputation: 1577

Try ${path}/${filename} based on this in the documentation:

Keeping with the example of a file that is picked up from a local file system, the FlowFile would have an attribute called filename that reflected the name of the file on the file system. Additionally, the FlowFile will have a path attribute that reflects the directory on the file system that this file lived in.

Upvotes: 1

Related Questions