piyush pankaj
piyush pankaj

Reputation: 755

Hadoop -copyFromLocal failing to find file

I am trying to execute -copyFromLocal through oozie shell.

hadoop fs -copyFromLocal '/usr/test/test1'  '/user/hue/oozie/workspaces/shell/'

But it is failing sometimes with error

log4j:ERROR Could not find value for key log4j.appender.TLA
log4j:ERROR Could not instantiate appender named "TLA".
copyFromLocal: `/usr/test/test1': No such file or directory
Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.ShellMain], exit code [1]

Sometimes it is working fine but sometime it is failling to copy. Please help me to short out this problem. Thanks in advance.

Upvotes: 0

Views: 908

Answers (1)

Cipi
Cipi

Reputation: 160

Since I don't have enough reputation to add comment I will respond to your question assuming you have a Hadoop cluster with at least 2 machines/nodes.
If this is true, your action will be executed on an arbitrary node on cluster, each time. This is why sometimes it finds the file (in case it runs on the machine that has the file, probably the namenode) and sometimes it doesn't find the file (in case the action is executed on a different node).
It will work every time only if you make sure the file exists in the same location on each node in the cluster.

Upvotes: 2

Related Questions