CODEWITHSUNDEEP
pythongoogle-cloud-platformgoogle-bigquerygoogle-cloud-storage
Venkata Gogu
Venkata Gogu

Reputation: 1051

Download data using big query

I have a very big table(around 10 Billion rows) and have access to big query. I tried Select * from table. It returns all values and I want to download this data to my local machine. I don't have any access to buckets. I tried using GUI, there is a limit of 16000 rows only. I tried running a query bq extract table but it needs URI of the bucket.

Can someone point me to right direction to download this data.

Upvotes: 0

Views: 1395

Answers (1)

Felipe Hoffa
Felipe Hoffa

Reputation: 59225

The right way to export data from BigQuery is to export it as files to Google Cloud Storage (GCS) within a bq extract table job.

An URI of the bucket means you need to create a bucket in GCS, so it can host the output files - that you can download later.

It should be all explained on: https://cloud.google.com/bigquery/docs/exporting-data

Upvotes: 2

Related Questions