CODEWITHSUNDEEP
apache-sparkspark-shellspark-webui
Fitz
Fitz

Reputation: 41

Spark-shell: Web UI doesn't change when I execute process

I use Spark in local mode. I run spark-shell and use a file as a data set. All work very good (for example, I ask spark-shell to count the number of words which begin by "a" in the file and I have the good result), but when I see at the web UI, it doesn't change at all.

Do you have any idea why the web UI doesn't evolve when I run a process?

enter image description here

Upvotes: -1

Views: 327

Answers (2)

Ged
Ged

Reputation: 18003

When you start the spark-shell in local you are not using Spark Stand Alone. You are running local. You should see a binding to port 404x message. That 404x is what you should use, if memory serves correct.

If you type http://localhost:4040 - or https... or server name or IP-address instead of local host, you will be taken to 4040/jobs and you will see your Jobs, Apps.

If you start using Stand Alone you will see there the App and on port 4040, 4041, etc. whatever is applicable. From Stand Alone you can click to 404x.

Upvotes: 0

david gupta
david gupta

Reputation: 56

It seems, port number will be 8080. Refer doc https://spark.apache.org/docs/latest/spark-standalone.html

Upvotes: 0

Related Questions