CODEWITHSUNDEEP
amazon-dynamodb
user1846749
user1846749

Reputation: 2535

DynamoDB Batch Update

Is there any API in DynamoDB to update a batch of items? There is an API to write new items in batches (BatchWriteItem) and update single item using UpdateItem, but is it possible to update multiple items in one call?

Upvotes: 89

Views: 120282

Answers (9)

Jordie Murti
Jordie Murti

Reputation: 1

Not exactly a batch delete but I did this in a python lambda function just now:

    import json
    import boto3

    client = boto3.client('dynamodb')

    def lambda_handler(event, context):
    
    idList = [
        "id1",
        "id2
        ...
        "id100",
    ]

    for itemID in idList:
        test = client.update_item(
                TableName='Your-Table-Name',
                Key={
                    'id': {
                        'S': itemID
                    }
                },
                UpdateExpression="set exressionToChange=:r",
                ExpressionAttributeValues={
                        ':r': {'S':'New_Value'}},
                ReturnValues="UPDATED_NEW")
        
    
    return

To get the idList, I downloaded the values in a CSV, copied them into VSCode and then did a find and replace with regex (CMD-F then click .\*) and set find to ".*" and replace to "$0", which basically replaces every line with itself in quotes and a comma

So basically before:

    id1
    id2
    id3
    ...

And after

    "id1",
    "id2",
    "id3",
    ...

Just replace "idList = [...]" with your ids, "Your-Table-Name", "expressionToChange" and lastly, "New_Value".

Also you will have give your lambda function permission to "Update Item" in DynamoDB or you will get an error

Upvotes: 0

ap14
ap14

Reputation: 4731

I reached this thread on similar query, hope this might help.

DynamoDB supports Batch Statement Execution which is described in documentation. This works with client object rather than resource object. Then I used the PartiQL update statement supported by DynamoDB and described here.

Python code reference looks something like this:

client = boto3.client('dynamodb')

batch = ["UPDATE users SET active='N' WHERE email='<user_email>' RETURNING [ALL|MODIFIED] [NEW|OLD] *;", "UPDATE users ..."]  # Limit to 25 per batch
request_items = [{'Statement': _stat} for _stat in batch]
batch_response = client.batch_execute_statement(Statements=request_items)

This is minimal code. You can use multi-threading to execute multiple batches at once.

Upvotes: 12

Sajed
Sajed

Reputation: 91

With PartiQL you can execute batch insert and update just like SQL.

https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/ql-reference.multiplestatements.batching.html

Upvotes: 9

swarnim gupta
swarnim gupta

Reputation: 231

No there is no batch update currently , you can use a single update Item call and have a workflow over it like AWS SWF or AWS step functions

https://docs.aws.amazon.com/AWSJavaScriptSDK/latest/AWS/DynamoDB/DocumentClient.html

Upvotes: 2

Chris Barrett
Chris Barrett

Reputation: 374

I know this is an old question by now, but DynamoDB recently added a Transaction api which supports update:

Update — Initiates an UpdateItem operation to edit an existing item's attributes or add a new item to the table if it does not already exist. Use this action to add, delete, or update attributes on an existing item conditionally or without a condition.

https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/transaction-apis.html

Upvotes: 32

Clara Justino
Clara Justino

Reputation: 19

I use a dynamoDB update trigger, then I made a template that said to me what items I should modify, I put them on a queue and them read queue messages in other to update one by one

Upvotes: 0

Marian
Marian

Reputation: 387

I use DynamoDBMapper.batchSave(Iterable<? extends Object> objectsToSave) for this purpose.

Upvotes: 2

user3417670
user3417670

Reputation: 37

BatchWriteItem cannot update items. To update items, use the UpdateItem action. BatchWriteItem operation puts or deletes multiple items in one or more tables

Reference: http://docs.aws.amazon.com/amazondynamodb/latest/APIReference/API_BatchWriteItem.html

Upvotes: 2

notionquest
notionquest

Reputation: 39186

There is no batch update item API available in DynamoDB at the moment.

DynamoDB API operations list

Upvotes: 55

Related Questions