CODEWITHSUNDEEP
google-bigquerygoogle-cloud-dataflow
Graham Polley
Graham Polley

Reputation: 14791

Do 'side inputs' in Cloud Dataflow support reading from BigQuery views?

Tried to point a side-input to a BigQuery view, instead of directly to a BigQuery table. It does not produce an error, but simply returns 0 rows. View works fine inside BigQuery.

For example, given a view referencing a table 'types_test' with just 1 row:

enter image description here

In BigQuery, it works fine:

enter image description here

But using the view as a side-input in Dataflow return 0 rows:

INFO: Reading from BigQuery table <removed>:CPT_7414_PLAYGROUND.view_test
Mar 20, 2015 11:10:08 PM com.google.cloud.dataflow.sdk.io.BigQueryIO evaluateReadHelper
INFO: Number of records read from BigQuery: 0

Do side-inputs support views in BigQuery, or do you need to do something else to use a view for a side-input?

Upvotes: 3

Views: 811

Answers (1)

Graham Polley
Graham Polley

Reputation: 14791

Found in the FAQ's, that views are not currently supported.

http://goo.gl/ZVNTnp

Upvotes: 1

Related Questions