CODEWITHSUNDEEP
multithreadingmapreducehazelcastinfinispan
Mikhail Golubtsov
Mikhail Golubtsov

Reputation: 6653

hazelcast map-reduce use only one cpu core

I run a map-reduce job on a single-node hazelcast cluster and it consumes only about one CPU (120-130%). I can't find how to configure hazelcast to eat all available CPU up, is it possible at all?

EDIT: While Hazelcast does not support in-node parallelism another competing opensource in-memory datagrid (IMDG) solution does - Infinispan. See this article to learn more about that.

Upvotes: 1

Views: 513

Answers (1)

noctarius
noctarius

Reputation: 6094

The current implementation of Mapping and Reducing is single threaded. Hazelcast is not meant to run as a single node environment and the map-reduce framework is designed in a way to support scale-out and not exhaust the whole CPU. You can start up multiple nodes on your machine to parallelize processing and utilize the CPU that way but it seems to me that you might use Hazelcast for a problem that it is not meant to solve. Can you elaborate your use case?

Upvotes: 1

Related Questions