Reputation: 58
Scikit-Learn already provides parallel computing on a single machine with Joblib.
But l want to use Dask how can l achieve this?
from dask.distributed import Client
client = Client()
how do l proceed from this?
Upvotes: 3
Views: 214
Reputation: 1515
There is a snippet from the dask documentation, you can use both the dask syntax and sk"Scikit-learn" code
import dask_ml.joblib
from sklearn.externals.joblib import parallel_backend
with parallel_backend('dask'):
# Your normal scikit-learn code here
Additional documentation here: http://dask-ml.readthedocs.io/
Upvotes: 3