CODEWITHSUNDEEP
hadoopmapreducehdfssftpcloudera
Saurabh Gokhale
Saurabh Gokhale

Reputation: 46425

Moving files to Hadoop HDFS using SFTP

I've a VPC subnet which has multiple machines inside it.

On of the machine, I've some files stored. On another machine, I've hadoop HDFS service installed and running.

I need to move those files from first machine to HDFS file system using SFTP.

Do Hadoop has some API's that can achieve this goal ?

PS : I've installed Hadoop using Cloudera CDH4 distribution.

Upvotes: 3

Views: 6250

Answers (2)

selle
selle

Reputation: 982

A workflow written in Apache Oozie would do it. It comes with the Cloudera distribution. Other tools for orchestration could be Talend or PDI Kettle.

Upvotes: 1

zhutoulala
zhutoulala

Reputation: 4832

This is a requirement which is much easier to implement on ftp/sftp server side than HDFS.

check out a ftp server works on top of HDFS hdfs-over-ftp

Upvotes: 3

Related Questions