Reputation: 31526
I have installed Hadoop and HDFS using this tutorial
http://codesfusion.blogspot.com/2013/10/setup-hadoop-2x-220-on-ubuntu.html
Everything is fine.
I am also able to create directories and use them using
hadoop fs -mkdir /tmp
hadoop fs -mkdir /small
I can also say
hadoop fs -ls /
However I am following a tutorial in which the trainer does
hadoop fs -mkdir temp
hadoop fs -ls
now on my machine when I issue the above command it says
ls: `.': No such file or directory
In my training video the command hadoop fs -ls works perfectly. Why should I specify the "/"?
Also I am getting this warning in all my commands
13/12/28 20:23:52 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
But in my trainers video there is no such warning.
My configuration file is exactly as the tutorial above and I can also see all management UIs at
http://abhishek-pc:8042/
http://abhishek-pc:50070/
http://abhishek-pc:8088/
So my question is what is wrong with my configuration and why is my system behaving differently than the training video?
Upvotes: 35
Views: 40027
Reputation: 11
First of all when you want for the first time to put something in your HDFS you should do this steps
hdfs fs -mkdir -p /user/nameuser(the name of user )
hdfs fs -put ~/file
Upvotes: 0
Reputation: 61
after hdfs dfs -mkdir /user/[user name]
do :
hadoop fs -ls /
it's works form me !
Upvotes: -1
Reputation: 436
I faced a similar type of problem during tutorial by hadoop form link-
http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/SingleCluster.html
when i tried command - bin/hdfs dfs -put etc/hadoop input
, it says
mkdir: `input': No such file or directory
then problem solved by adding extra / to input and command should be -
bin/hdfs dfs -put etc/hadoop /input
Upvotes: 1
Reputation: 4832
Well, your problem regarding ls: '.': No such file or directory
' is because, there is no home dir on HDFS for your current user. Try
hadoop fs -mkdir -p /user/[current login user]
Then you will be able to hadoop fs -ls
As per this warning WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
, please see my answer at this question
Upvotes: 102
Reputation: 571
This could also happen due to bad carriage return characters. Run `dos2unix' on all your hdfs executable (shell script) and if required all other related shell scripts as well.
Upvotes: 0
Reputation: 21
Solved this. Run hadoop fs -ls as hdfs user(not as root user). #su - hdfs.
Upvotes: 2
Reputation: 61
First:
hdfs dfs -mkdir /user
then perform
hdfs dfs -mkdir /user/hduser
Upvotes: 6