CODEWITHSUNDEEP
csvimportcassandra
APDK85
APDK85

Reputation: 23

The most effective way to import large csv files into Cassandra

I have 12 CSV files (~36 GB in total), which I need to load into Cassandra. Currently I'm running a job to parse the CSV files into an object and then run a row by row insert execution on Cassandra and it's taking forever (xx hours - which might be reality as well), but perhaps someone know a far more effective way?

Thank you for the sparring.

Upvotes: 2

Views: 1223

Answers (1)

Mayank Srivastava
Mayank Srivastava

Reputation: 159

You can use Cassandra BulkLoader. The details of how to execute the load is clearly explained here https://www.datastax.com/dev/blog/using-the-cassandra-bulk-loader-updated

Upvotes: 1

Related Questions