CODEWITHSUNDEEP
apachehadoophdfsmicrosoft-distributed-file-systemmesos
Shiva.manikandn
Shiva.manikandn

Reputation: 21

Need Help for Setup Apache Hadoop on Apache Mesos

I'm trying to setup hadoop on mesos using the document below:

https://docs.mesosphere.com/tutorials/run-hadoop-on-mesos/

I'm facing a problem on step-9

sudo -u mapred ./hadoop-2.0.0-mr1-cdh4.2.1/bin/hadoop dfs -rm -f /hadoop-2.0.0-mr1-cdh4.2.1.tgz
sudo -u mapred /usr/bin/hadoop dfs -copyFromLocal ./hadoop-2.0.0-mr1-cdh4.2.1.tgz /

I am still new to this concept. I have to configure a mesos cluster using this tutorial:

https://www.digitalocean.com/community/tutorials/how-to-configure-a-production-ready-mesosphere-cluster-on-ubuntu-14-04

Now I'm getting errors while performing dfs commands:

root@station1:~# sudo -u mapred ./hadoop-2.0.0-mr1-cdh4.2.1/bin/hadoop dfs -rm -f /hadoop-2.0.0-mr1-cdh4.2.1.tgz
-rm: Expected authority at index 7: hdfs://
Usage: hadoop fs [generic options] -rm [-f] [-r|-R] [-skipTrash] <src> ...

Upvotes: 2

Views: 717

Answers (1)

Adam
Adam

Reputation: 4322

This tutorial assumes you have HDFS already installed on your cluster. You can do this by manually installing HDFS on each node, or you can try out the new HDFS framework: https://github.com/mesosphere/hdfs

Does hadoop fs -ls hdfs:// work on its own? If not, you'll need to install and configure HDFS appropriately.

Upvotes: 1

Related Questions