CODEWITHSUNDEEP
node.jscassandracassandra-node-driver
Ajaypravin
Ajaypravin

Reputation: 27

Bulk insert in not working in Casssandra with node.js

I am trying to insert more than 100 records using batch() method. 

client.batch(batchQuery, { prepare: true }, function (err, result) {
    if (err) {
        res.status(404).json({ msg: err });
    } else {
        res.json([result.rows][0]);
    }
});

batchQuery has more than 100 insert queries. It is working if the records are less than 7. If its more than 10, then i am getting "Batch too large"

Upvotes: 0

Views: 993

Answers (1)

Alex Ott
Alex Ott

Reputation: 87069

You shouldn't use batches for bulk inserts into Cassandra (in contrast to RDBMS) - this error that you get mean that you're inserting data into different partitions, and it pushes an additional load on the node that receives query. You need to use batches only if you're doing inserts into the same partition - in this case they will be applied as a single mutation.

Otherwise, sending individual insert queries via async execute, will be much faster. You only need not to send too many requests at the same time (see this answer).

You can read more about good & bad use of batches in the documentation and following answer on SO: 1.

Upvotes: 1

Related Questions