Dživo Jelić
Dživo Jelić

Reputation: 2143

Google cloud task unreliable / UNUSABLE

I am using google cloud tasks to sync some files from my storage. They have proven to be very unreliable they sometimes queue and don't start executing for few minutes or more. When they do they are not shown in cloud tasks console.

I am using this code to queue tasks

const taskRequest: ICreateTaskRequest = {
  parent: queuePath,
  task: {
    name: taskPath,
    httpRequest: {
      httpMethod: 'POST',
      oidcToken: {
        serviceAccountEmail
      },
      headers: {
        "Content-Type": "application/json"
      },
      url: taskUrl,
      body: Buffer.from(JSON.stringify(taskData))
    }
  },
};
const task = client!.createTask(taskRequest);

Documentation is really scarce thx for any help

enter image description here

EDIT: got the same thing again wtf google ?

EDIT: added logs https://quicknote.io/04fe9570-edb9-11ee-b8cf-a1e741b2cf64

EDIT: After adding new batch of tasks they started working and run 6 out of 7 tasks and now one is hanging forever

enter image description here

EDIT: funniest thing is that gcloud list doesnt even show it hahaha

gcloud tasks list --queue=google-drive-0p0F2CL7NKX1buIVax254c8kbdr2
WARNING: We are using the App Engine app location (europe-west1) as the default location. Please use the "--location" flag if you want to use a different location. Listed 0 items.

Queue setup:

Location europe-west1 Rate limits Max rate 500/s Max concurrent 1000 Max burst size 100 Retry parameters Max attempts 100 Min interval 0.100s Max interval 3600s Max doublings 16 Max retry duration Unlimited

Upvotes: 0

Views: 170

Answers (0)

Related Questions