CODEWITHSUNDEEP
airflowdaskmwaa
Khaled
Khaled

Reputation: 11

importing python dask package on aws MWAA airflow not working

I am trying to import dask package on AWS MWAA (airflow) using requirements.txt, by adding "dask==2022.6.0" line to the file. Not only the import does not work, the other packages are not imported anymore. It is like MWAA does not recognize requirements.txt file anymore. Anyone encountered this?

Upvotes: 1

Views: 287

Answers (1)

Andrew Nguonly
Andrew Nguonly

Reputation: 2621

MWAA is constrained to installing dask==2021.4.0. Other versions will not install and will break package installation overall. The complete list of package version constraints is here: https://github.com/aws/aws-mwaa-local-runner/blob/main/docker/config/constraints.txt

Upvotes: 2

Related Questions