CODEWITHSUNDEEP
spring-xd
Priyadarshan
Priyadarshan

Reputation: 31

File path issue while creating simple spring XD stream

I am running spring XD on distributed YARN setup.I am using hortonworks data platform with 6 data nodes and 1 name node. and using name node as a client node.I have invoked xd Shell from name node and admin and containers are running on the data node. So when I create the spring XD stream definition as below:

xd> stream create --name filetest --definition "file | log" --deploy

It looks for the /tmp/xd/input/filetest on the data nodes to which i dont have access to. Is this the normal behavior of spring XD ? I think it should look for the location on the node from which i have invoked the XD shell. Could you please help me on this.

Upvotes: 3

Views: 86

Answers (1)

Gary Russell
Gary Russell

Reputation: 174719

The containers (regardless of whether they are running on Yarn or not) have no knowledge of where the shell is running.

Upvotes: 0

Related Questions