CODEWITHSUNDEEP
pythonpandasdaskdask-dataframecudf
user3448011
user3448011

Reputation: 1599

dask cudf has no access to map_partitions

I tried to create a dask_cudf dataframe but got an error.

import dask_cudf
import cudf


# Example pandas DataFrame with a datetime string column
pdf = pd.DataFrame({'datetime_str': ['2024-03-19 12:00:00', '2024-03-19 10:00:00', '2024-03-19 11:00:00']})

# Convert the pandas DataFrame to a cuDF DataFrame
cdf = cudf.from_pandas(pdf)

# Convert the cuDF DataFrame to a Dask cuDF DataFrame
ddf = dask_cudf.from_cudf(cdf, npartitions=2) # error

I got an error:

AttributeError: DataFrame object has no attribute map_partitions

I found that

cudf.core.dataframe.DataFrame # no map_partitions
dask_cudf.DataFrame.map_partitions 
dask_cudf.core.map_partitions
dask_cudf.core.DataFrame.map_partitions
dask.dataframe.map_partitions

How to make "dask_cudf.from_cudf" access map_partitions ? thanks

Upvotes: 0

Views: 65

Answers (0)

Related Questions