CODEWITHSUNDEEP
azure-eventhub
Bhushan Jagtap
Bhushan Jagtap

Reputation: 131

Even hub checkpoint as resiliency mechanism

I am reading data and processing it further. if processing fails, I will not call checkpoint function. I hope that not checkpointing will stop further processing of events until issue is fixed. Is checkpointing sufficient for resiliency or I need to implement something like dead blob processor to provide failure handling?

Upvotes: 0

Views: 134

Answers (1)

Peter Bons
Peter Bons

Reputation: 29840

Is checkpointing sufficient for resiliency

No not really. The processing will continue until the process hosting the processing logic stops. Say for example you have an azure funtion processing the message this will go on.

What does happen that in the event of a function restart (or whatever process you use to handle event hub messages) the function will start processing messages from the moment of the last checkpoint. Probably not what you want because the messages that caused a failure in the past will be processed again and probably fail again.

There is no dead lettering or retry mechanism out of the box, you will need to define that logic yourself.

So, TL;DR: the checkpoint its only purpose is to tell the processing logic where to start processing message from the backlog.

Upvotes: 1

Related Questions