Fastest way of communication between multiple EC2 instances in python

Question

I am looking for the absolute fastest way to submit a short string from one to multiple EC2 Instances of the type t2.nano. Example: Something happens on Instance 1, Instance 2,3,4 should (almost) instantly know about it. Target is < 5ms. For now the instances are all in the same region and same cluster availability zone.

What I have looked at so far:

• Shared drive where instance1 can drop the data and the rest of the instances can check it -> Not possible as this instance type does not support shared drives
• Redis -> I tested this locally and it is pretty slow actually, at least XXms, and sometimes XXXms for one read and one write (just for testing).

Any ideas how to solve this problem?

Answer 1

Consider using Twisted for Publish/Subscribe between your clients, where clients see all messages posted by other clients.

Alternatively, consider Autobahn which builds abstraction layers on Twisted including WebSocket-based pub/sub and WAMP.

Answer 2

You can try AWS EFS

Multiple compute instances, including Amazon EC2, Amazon ECS, and AWS Lambda, can access an Amazon EFS file system at the same time, providing a common data source for workloads and applications running on more than one compute instance or server.

https://docs.aws.amazon.com/efs/latest/ug/whatisefs.html