CODEWITHSUNDEEP
airflowgoogle-cloud-composer
user1157751
user1157751

Reputation: 2457

Cloud Composer, Airflow - web_server_worker_timeout environmental variable

I need to get accounts from a web service that might take over the current default of 60 seconds.

It seems that my workers are constantly going into timeout, which can be modified under the web_server_worker_timeout environmental variable in webserver group. However, this variable cannot be modified under cloud composer.

Any way to get around this?

Upvotes: 2

Views: 691

Answers (1)

raphaelauv
raphaelauv

Reputation: 980

There is no way to custom this, but in composer2 you can select the kubernetes limit cpu for the webserver.

with 0.5cpu on a ENVIRONMENT_SIZE_SMALL my webserver usually fail during 5 minutes ( the 2 workers timeout ) before reaching a stable state.

Try setting more than 0.5cpu to your webserver

Upvotes: 0

Related Questions