CODEWITHSUNDEEP
google-bigquery
loren
loren

Reputation: 61

Creating a public dataset (or: split storage costs and compute costs across two projects)

I would like to use BigQuery to host datasets that others can query without incurring processing charges against my project. I understand that when I upload a dataset to a project, the storage costs are associated with the project. I want others to be able to discover my dataset, access it via their project/account (preferably without my intervention), and run as many queries on it as they choose to pay for. So, storage costs would go to me, but compute costs would go to those who run the queries.

Is there a way to do this in BigQuery? I asked this via the Google Cloud enterprise sales web form but did not get a response.

Upvotes: 6

Views: 2387

Answers (1)

Michael Manoochehri
Michael Manoochehri

Reputation: 7877

Absolutely! You can certainly make a dataset public to be queried from other projects, or even share your dataset only with a specific domain, group or user.

In this model, users would be charged for queries to their own Project IDs, while your project covers the storage costs of the datasets. Note that if the users running queries in a different project want to store their resulting tables from their query results, they would of course pay for this storage themselves.

BigQuery currently doesn't provide a mechanism for public dataset discovery. You would have to share the details of your project's public dataset(s) yourself. The GitHub Archive project has a good example of this.

Upvotes: 7

Related Questions