CODEWITHSUNDEEP
springmultithreadingspring-batchbatch-processing
Neeraj Gupta
Neeraj Gupta

Reputation: 811

Chunk oriented processing multithreaded?

If I define like this for spring batch:

<chunk reader="chunkReader" 
    writer="chunkWriter" 
    processor="chunkProcessor" 
    commit-interval="#{jobParameters['commitSize']}" />

In this spring batch's chunk-oriented processing, are the chunks processed in parallel? And are the individual items in the chunks processed in parallel?

I am asking mainly to see if I need to worry about multithreading and race conditions.

Upvotes: 3

Views: 3413

Answers (1)

gargkshitiz
gargkshitiz

Reputation: 2168

Unless you instruct Spring, it will be all sequential.

If you decide to use multithreading, a batch job can use Spring’s TaskExecutor abstraction to execute each chunk in its own thread. A step in a job can be configured to perform within a threadpool, processing each chunk independently. As chunks are processed, Spring Batch keeps track of what is done accordingly. If an error occurs in any one of the threads, the job’s processing is rolled back or terminated per the regular Spring Batch functionality.

See: https://docs.spring.io/spring-batch/trunk/reference/html/scalability.html

and

How to set up multi-threading in Spring Batch?

Upvotes: 2

Related Questions