CODEWITHSUNDEEP
amazon-dynamodbaws-glue
Jeff
Jeff

Reputation: 407

how to load dynamodb table with AWS Glue ETL

A simple way to load dynamodb table with AWS Glue is to load with Glue Crawler. This is described in https://aws.amazon.com/blogs/database/simplify-amazon-dynamodb-data-extraction-and-analysis-by-using-aws-glue-and-amazon-athena/ Now I'm wondering if there is a way to load dynamodb table with AWS Glue ETL directly, say, without AWS Glue Crawler. I don't find any related topic so anyone could help is highly appreciated.

Upvotes: 5

Views: 5578

Answers (1)

Jeff
Jeff

Reputation: 407

Finally found connection_options works without a crawler.

ddb_table = glueContext.create_dynamic_frame.from_options(
    connection_type="dynamodb",
    connection_options = {"dynamodb.input.tableName":"table_name", "dynamodb.throughput.read.percent":"0.5"}
)

Upvotes: 8

Related Questions