CODEWITHSUNDEEP
azureapache-spark
Vzzarr
Vzzarr

Reputation: 5660

Graphic Spark User Interface :4040 in SSH VM

I am executing Spark in cluster mode in 2 Azure VMs. As usual, I'm connected to these machines through SSH and I can access to http://localhost:4040 through a command line browser and "see" job progress.

Since command line browsers are really poor, I'd like to see the classical Web User Interface offered by Spark, in order to appreciate the Graphical details. Is there a solution to reach this goal?

Upvotes: 2

Views: 245

Answers (2)

stefanobaghino
stefanobaghino

Reputation: 12794

I believe the most straightforward way to go is to open port 4040 and just connect from your browser locally to the Web UI on the remote machine.

Be advised, of course, that you may want to pay extra-attention to how the node is secured once it's open for connection from the external world.

As mentioned in a comment, opening ports on Azure is documented here.

Upvotes: 1

parisni
parisni

Reputation: 1152

You might try to run a modern browser via ssh with x11 forwarding. Use the compression option to speed up the experience.

Upvotes: 2

Related Questions