CODEWITHSUNDEEP
pythongoogle-cloud-platformgoogle-compute-engineairflowgoogle-cloud-composer
howMuchCheeseIsTooMuchCheese
howMuchCheeseIsTooMuchCheese

Reputation: 1780

How can I restart the airflow server on Google Composer?

When I need to restart the webserver locally I do:

ps -ef | grep airflow | awk '{print $2}' | xargs kill -9
airflow webserver -p 8080 -D

How can I do this on Google Composer? I don't see an option to restart the server in the console.

Upvotes: 9

Views: 14366

Answers (3)

GregK
GregK

Reputation: 593

EDIT: Only works for 1.13.1 >= Composer version < 2.0.0

Restarting the Airflow has recently been introduced as a feature in preview here.

TL;DR the command is:

gcloud beta composer environments restart-web-server ENVIRONMENT_NAME
  --location=LOCATION

Upvotes: 7

Romain
Romain

Reputation: 311

A way to restart Composer server is to add a 'dummy variable' into the 'Environment Variables' of GCP Composer UI. After submitting, it will restart to include this change. enter image description here

Upvotes: 25

Rub&#233;n C.
Rub&#233;n C.

Reputation: 1098

Since Cloud Composer is an Apache Airflow managed service, it is not possible to restart the whole service. You can restart though the single instances of the service, as described here, but this will not help to apply to the plugin changes.

To apply the plugin changes, you should install the plugin after loading it into the plugin folder, automatically created when you created the environment: 

gcloud composer environments storage plugins import --environment ENVIRONMENT_NAME \
    --location LOCATION \
    --source PATH_TO_LOCAL_FILE \
    --destination PATH_IN_SUBFOLDER

DAG updates are performed automatically and some other must be applied using

gcloud composer environments update

command.

Upvotes: 4

Related Questions