CODEWITHSUNDEEP
macoshadoop
frmsaul
frmsaul

Reputation: 1362

Extremely slow Hadoop CLI

I installed hadoop via brew on my OS X 10.12.3. Everything looks great and Hadoop seems to be running. I have an issue though:

Whenever I run an hadoop CLI command, it takes roughly 50 seconds to finish. Is this normal? What is the issue and how can I correct it?

Examples: enter image description here enter image description here

Upvotes: 0

Views: 273

Answers (1)

Terra Field
Terra Field

Reputation: 71

Try this example command:

export HADOOP_ROOT_LOGGER=DEBUG,console hdfs dfs -ls

And you should be able to see what step it gets stuck on (potentially something like group resolution or DNS). If the output is too much, you can redirect it to a file.

Upvotes: 4

Related Questions