CODEWITHSUNDEEP
databaseimportcassandraschema
Rodrigo Oliveira
Rodrigo Oliveira

Reputation: 21

Why cassandra slower to import schema

I exported a schema of my cassandra. Look the case, my environment have 40.000 tables in keyspace (product).

After 4 days importing this schema in a new cluster, I have just 10.000 tables imported. It´s normal? How Can I import this schema faster? Any suggestion?

Regards,

Upvotes: 0

Views: 80

Answers (1)

Chris Lohfink
Chris Lohfink

Reputation: 16410

First off: seriously consider changing your data model. 40k tables is far beyond what Cassandra is designed to handle. Usually people get told to consider changing things at around 1000. Each table has a serious amount of overhead that must remain in memory and there are operations that fire off per-table tasks.

While you should test it something that could work as a hack is to turn a fresh new cluster completely off after starting it. Every node down. Then copy the system_schema tables from any one of your current nodes to all the new clusters nodes. You might need to create the folder structure as well for the keyspaces and tables. Then bring new cluster up. Test it out before trying it though but I believe that will work with 3.x.

Upvotes: 1

Related Questions