Knows Not Much
Knows Not Much

Reputation: 31526

Hadoop 2.2 Installation `.' no such file or directory

I have installed Hadoop and HDFS using this tutorial

http://codesfusion.blogspot.com/2013/10/setup-hadoop-2x-220-on-ubuntu.html

Everything is fine.

I am also able to create directories and use them using

hadoop fs -mkdir /tmp
hadoop fs -mkdir /small

I can also say

hadoop fs -ls /

However I am following a tutorial in which the trainer does

hadoop fs -mkdir temp
hadoop fs -ls

now on my machine when I issue the above command it says

ls: `.': No such file or directory

In my training video the command hadoop fs -ls works perfectly. Why should I specify the "/"?

Also I am getting this warning in all my commands

13/12/28 20:23:52 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

But in my trainers video there is no such warning.

My configuration file is exactly as the tutorial above and I can also see all management UIs at

http://abhishek-pc:8042/
http://abhishek-pc:50070/
http://abhishek-pc:8088/

So my question is what is wrong with my configuration and why is my system behaving differently than the training video?

Upvotes: 35

Views: 40027

Answers (7)

majdouline
majdouline

Reputation: 11

First of all when you want for the first time to put something in your HDFS you should do this steps

  1. hdfs fs -mkdir -p /user/nameuser(the name of user )
  2. hdfs fs -put ~/file

Upvotes: 0

dTatlvi
dTatlvi

Reputation: 61

after hdfs dfs -mkdir /user/[user name]

do :

hadoop fs -ls /

it's works form me !

Upvotes: -1

naveen dahiya
naveen dahiya

Reputation: 436

I faced a similar type of problem during tutorial by hadoop form link-

http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/SingleCluster.html

when i tried command - bin/hdfs dfs -put etc/hadoop input , it says

mkdir: `input': No such file or directory

then problem solved by adding extra / to input and command should be -

bin/hdfs dfs -put etc/hadoop /input

Upvotes: 1

zhutoulala
zhutoulala

Reputation: 4832

Well, your problem regarding ls: '.': No such file or directory' is because, there is no home dir on HDFS for your current user. Try

hadoop fs -mkdir -p /user/[current login user]

Then you will be able to hadoop fs -ls

As per this warning WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable, please see my answer at this question

Upvotes: 102

Pushkar
Pushkar

Reputation: 571

This could also happen due to bad carriage return characters. Run `dos2unix' on all your hdfs executable (shell script) and if required all other related shell scripts as well.

Upvotes: 0

Gautam Pal
Gautam Pal

Reputation: 21

Solved this. Run hadoop fs -ls as hdfs user(not as root user). #su - hdfs.

Upvotes: 2

user3364393
user3364393

Reputation: 61

First:

hdfs dfs -mkdir /user

then perform

hdfs dfs -mkdir /user/hduser

Upvotes: 6

Related Questions