CODEWITHSUNDEEP
google-cloud-platformgoogle-bigquerybigtable
Alex Man
Alex Man

Reputation: 4886

GCP moving Bigtable data to BigQuery

In GCP I would like to know if it possible to transfer/move data from Bigtable to BigQuery. i.e lets say I want all data greater than 1 year should be moved from Bigtable to BigQuery. Is this doable?

Can someone please help me on this

Upvotes: 0

Views: 2385

Answers (1)

guillaume blaquiere
guillaume blaquiere

Reputation: 75745

You can query the BigTable data from BigQuery thanks to the external table configuration.

Because you are able to query the data from BigQuery, you can perform an INSERT SELECT in a BigQuery table.

EDIT 1

You can't do it automatically. You must perform custom code to copy only the old data and then delete the old ones.

You must have a timestamp field for that. To copy the data from BigTable to BigQuery, you can use external table. But you can't delete the data from BigQuery external connection.

To purge BigTable data, you can use garbage collection feature.

Upvotes: 2

Related Questions