CODEWITHSUNDEEP
serverload-balancing
A Question Asker
A Question Asker

Reputation: 3323

Is there a way to have a proxied request respond straight to the requestor?

So let's say I have the following (obviously simplified) architecture: I have 10 servers running the same REST API endpoint. I have an intermediate API which fields requests, and then forwards it to one of the servers (a load balancer).

Now let's imagine that this is a really big, streaming response. As such, I obviously don't want the data to have to go back through the load balancer -- because wouldn't this bog down and defeat the purpose of the load balancing server?. What would be the proper way to implement a load balancing system that would delegate a request to node but not force the response back through the load balancing server?

Further, are there any REST frameworks on the JVM that implement this?

Upvotes: 1

Views: 32

Answers (1)

Mircea
Mircea

Reputation: 10566

What you are looking for is called DSR (direct server return). you can attempt to google it a bit. AFAIK most hardware load balancers have this option.
The question is what load balancer are you using? Is it hardware, ELB on AWS, HAProxy? For example: http://blog.haproxy.com/2011/07/29/layer-4-load-balancing-direct-server-return-mode/

If you're not really into load balancers, you could attempt to set this up in 2 stages: first - the client hits the API and gets the ip of the server, second the client talks to the servers. The hard part will be not to overload some servers when leaving others idle (both initial setup and rebalancing workloads as time goes by)

Upvotes: 1

Related Questions