CODEWITHSUNDEEP
apache-nifi
Vinicius Zolin De Jesus
Vinicius Zolin De Jesus

Reputation: 348

DistributedMapCache speed

How to increase DistributedMapCache speed? So far I'm getting around 1000 fetch per minute and it's a serious bottleneck.

This part of the flow exists to check if a html template has been downloaded from S3 to the cache. I can't get multiple instances going because on the case it hasn't been download that would implicate in several calls to S3.

EDIT: Nifi is 1.4.0 and it's running on a t2.medium

Upvotes: 0

Views: 170

Answers (1)

mattyb
mattyb

Reputation: 12103

As of NiFi 1.5.0 (via NIFI-4589), FetchDistributedMapCache will now issue a single fetch for all desired keys, which should improve the performance. I'm not aware of a workaround for pre-1.5.0 versions.

Upvotes: 3

Related Questions