CODEWITHSUNDEEP
google-cloud-platformgoogle-bigquerymaterialized-viewsgoogle-datastream
codechef
codechef

Reputation: 85

Error when creating materialized view on datastream enabled Bigquery tables

We have tables in bigquery that are populated using datastream from postgres. We want to create materialized views on top of these bigquery tables but we run into the following error

Materialized views has a base table with unapplied Change Data Capture(CDC) upsert data within a configured period.

Upvotes: 1

Views: 622

Answers (1)

Dhiraj Singh
Dhiraj Singh

Reputation: 536

As mentioned in this PIT issue and this public documentation, materialized views over the BigQuery table that has upsert data is not supported. The Change Data Capture(CDC) is used to update the BigQuery tables by processing and applying streamed changes to existing data which is also called as upserting the data. Since the MV’s over the table that has upsert data is not supported, you are getting the error.

However, there is a feature request filed for the same. You can vote for this feature by clicking +1 and STAR mark to receive updates on it.

Upvotes: 2

Related Questions