CODEWITHSUNDEEP
amazon-s3google-bigquery
Pepeluis
Pepeluis

Reputation: 941

Extracting query results from Google BigQuery into AWS s3

I'm checking if there's a better way to run a query on Google BigQuery and export the result to AWS S3. Reading a bit about it I saw there's a way by following these steps:

But my question is, is there a way to avoid the external table creation and just move the query result to GCS? is there another clever/proper way to do the same?

Thanks for your help.

Upvotes: 1

Views: 3114

Answers (1)

Alexey Maloletkin
Alexey Maloletkin

Reputation: 1099

Export of query result is not (yet?) supported in BigQuery - so for you there is only way to materialize result first (it is what you refer as export query result to an external table).

One more potential way is use BQ API and read table using tabledata.list - API ref - so if say result of your query is small (MBs) it may be more easy way of moving data. But even in this case you need to materialize result in new table - but no need to export to GCS.

Upvotes: 2

Related Questions