Reputation: 970
Is there a way to manually specify the port for the dashboard when creating a dask cluster using dask-jobqueue? When 8787 is taken, it randomly picks a different port, which means that one needs to set up a different tunneling every time.
from dask_jobqueue import PBSCluster
cluster = PBSCluster() # ideally here dashboard_port=
cluster.scale(10)
from dask.distributed import Client
client = Client(cluster) # Connect this local process to remote workers
Upvotes: 6
Views: 2129
Reputation: 5389
According to the dask-jobqueue docs, additional kwargs
are passed to LocalCluster
so you should be able to pass the dashboard_address
e.g.
cluster = PBSCluster(dashboard_address=':1234')
Have you tried that?
Upvotes: 8