CODEWITHSUNDEEP
springspring-batch
shazin
shazin

Reputation: 21883

Spring Batch Performance Improvement

I am writing a Spring Batch which needs to read from a Database table and then process the read data (while reading more database tables) and then finally write to a database. The performance of the Spring Batch needs to be updated so that 10 files are written every 1 second.

I followed this post and managed to increase some performance by using multi threaded steps.

But still the desired performance goal can not be met. Can anyone guide me on how to get more throughput from Spring batch.

Upvotes: 1

Views: 1342

Answers (1)

Thrax
Thrax

Reputation: 1964

Your performance depends of a lot of factors.

For example :

  • What does your query looks like? Are there any joins/subrequest who could slow down your whole job?
  • What does your processor do?
  • Did you use indexed tables (with a specific index tablespaces on a faster drive)?

Parallel processing, multi-threading and partitionning is only a small part of your performance gain.

Upvotes: 1

Related Questions