How to join two bigquery tables using python and beam coGroupby concept without directly passing the join condition in the query?

Question

I am trying to join two bigquery tables in such a way that the data is read from table using query and inner join should be performed by beam coGroupBY key. How can I pass the primary key to join both tables?

Answer 1

Read data from two different bigquery tables in two different pcollection. Then create tuples with your join key using lamda or map function from beam. Once you have these two tuples for tables , go ahead and use coGroupBY key to join these two pcollections.