Logan McNatt
Logan McNatt

Reputation: 1

How to copy data from Amazon AWS S3 Bucket into a MariaDB SQL table in Apache Airflow

In Airflow I know that you can use SQLToS3Operator to copy data from an SQL database to an S3 bucket, but I need it to go the other way; copying data from an S3 bucket into an SQL database. This would specifically be copying keys into a table, one key per table, into a locally hosted MariaDB SQL database just on my computer through Docker. Any ideas?

Upvotes: 0

Views: 515

Answers (1)

Hussein Awala
Hussein Awala

Reputation: 5110

You can use S3ToMySqlOperator which works with mariadb too.

Upvotes: 3

Related Questions