CODEWITHSUNDEEP
javamemorytransactionsdistributed
Martin Kersten
Martin Kersten

Reputation: 5513

Distributed Transactional Memory with Zookeeper / Hadoop?

I am looking for a Java solution beside big memory and hazelcast. Since we are using Hadoop/Spark we should have access to Zookeeper.

So I just want to know if there is a solution satisfying our needs or do we need to build something ourself.

What I need are reliable objects that are inmemory, replicated and synchronized. For manipulation I would like to have lock support and atomic actions spanning an object.

I also need support for object references and List/Set/Map support.

The rest we can build on ourself.

The idea is simply having self organizing network that configures itself based on the environment and that is best done by synchronized objects that are replicated and one can listen to.

Upvotes: 0

Views: 172

Answers (1)

eminn
eminn

Reputation: 79

Hazelcast, has a split-brain detector in place and when split-brain happens hazelcast will continue to accept updates and when the cluster is merged back, it will give you an ability to merge the updates that you preferred.

We are implementing a cluster quorum feature, which will hopefully available in the next minor (3.5) version. With cluster quorum you can define a minimum threshold or a custom function of your own to decide whether cluster should continue to operate or not in a partitioned network.

For example, if you define a quorum size of 3, if there is a less than 3 members in the cluster, the cluster will stop operating.

Currently hazelcast behaves like an AP solution, but when the cluster quorum is available you can tune hazelcast to behave like a CP solution.

Upvotes: 1

Related Questions