CODEWITHSUNDEEP
apache-kafkagoogle-bigquery
Bala kumar
Bala kumar

Reputation: 312

BigQuery to Kafka as a source

I have a streaming data from webpages that is loaded in to BigQuery and I want to connect the BigQuery to Kafka as a source. Is there any connector like kafka-connect that is used for BigQuery sink.

Thanks, Bala

Upvotes: 4

Views: 6407

Answers (2)

Peter
Peter

Reputation: 61

I have not tested / used it, but Google has partnered with Simba to provide ODBC and JDBC drivers for bq. This could possibly be used with the JDBC connector?

https://cloud.google.com/bigquery/providers/simba-drivers/

Upvotes: 2

Shahin Vakilinia
Shahin Vakilinia

Reputation: 355

For BigQuery to Kafka, I could not find any direct API. However, you can export data in BigQuery via 1 or Python Client for Google BigQuery . Then, you can use Kafka Python client to import data to Kafka.

For Kafka to BigQuery, Kafka Connect BigQuery Connector and bigquery-kafka-connect are the common sink connectors from Apache Kafka to Google BigQuery.

For more information please check Loading data from Kafka into BigQuery with Kafka Connect.

Upvotes: 2

Related Questions