CODEWITHSUNDEEP
searchsolrsearch-engine
tan
tan

Reputation: 1569

solr: What is the memory limit for loading data to solr?

What is the memory limit for loading data into solr? I tried loading a 1.1Gigabyte file and ended up with a 500 Server error. Digging the log file showed me this:

ERROR - 2013-11-25 17:26:46.481; org.apache.solr.common.SolrException; null:java.lang.IllegalStateException: this writer hit an OutOfMemoryError; cannot commit

Upvotes: 1

Views: 1600

Answers (1)

Srikanth Venugopalan
Srikanth Venugopalan

Reputation: 9049

Solr runs on JVM, so the java heap space should be large enough to avoid OutOfMemoryException. There are obvious downside to increasing the Heap Space to a value too big, which is pointed out in the reference.

I would revisit the strategy of uploading large files, if I were you, and either do a batch processing by splitting the files or consider doing incremental updates (depending on your use case).

Upvotes: 2

Related Questions