CODEWITHSUNDEEP
encryptionlets-encryptpublic-key-encryption
VALDO VALERO
VALDO VALERO

Reputation: 1

Encryption data or files while transfer from HDFS to S3 with distcp

Hi I would ask your help, I have many files in HDFS, but I would like copy to S3 and before the copy, encrypt the data and after the encryption upload them to S3, I would like to use disctp hdfs command, I have a current process: "copy a file from hdfs to a temporal path, I do the encryption y before upload the encrypted file to s3", but I want to skip that step and do it directly, i don't want copy to a temporal path, any idea?

I try create a safe zone in ranger, but I don't have the necessary administrator permissions.

Upvotes: 0

Views: 10

Answers (0)

Related Questions