CODEWITHSUNDEEP
google-bigquerygoogle-cloud-dataflow
Kirk Broadhurst
Kirk Broadhurst

Reputation: 28728

Unable to access bq status from command line during Dataflow + BigQuery job

I'm submitting a Dataflow job that reads from and writes to a BigQuery dataset and table. The Dataflow job seems to work correctly.

During execution of the Dataflow job, the Dataflow UI tells me that I can check the status of the BigQuery export job by running a command using the bq tool.

BigQuery command

When I run that command I get a message that I'm not authorized to see the status. This is with the same authenticated account from which the Dataflow job was submitted.

BigQuery error in show operation: Access Denied: Job
bigquery-public-data:dataflow_job_2795433454065247350: The user
[email protected] does not have permission to access the job
bigquery-public-data:dataflow_job_2795433454065247350.

What incorrect security setting may be in place that causes this to happen?

The command I am running is

bq show -j --project_id=bigquery-public-data dataflow_job_2795433454065247350

Upvotes: 0

Views: 426

Answers (1)

Lara Schmidt
Lara Schmidt

Reputation: 309

We have the wrong project id in this case. You can find it by using the project that the dataflow job was run under as this is where the job will be.

Upvotes: 1

Related Questions