cshin9
cshin9

Reputation: 1490

Is uploading directly to BigQuery faster than uploading to Cloud Storage?

I'm uploading a delimited file from my PC into BigQuery. Two ways I could do this:

Is there a difference in upload time for each of these methods?

Upvotes: 3

Views: 267

Answers (1)

Jeremy Condit
Jeremy Condit

Reputation: 7046

Nope, goes through the same infrastructure either way.

The advantage of uploading directly to BQ is that it's simpler: only one service to interact with.

The advantage of uploading to GCS is that it gives you more flexibility. You can repeat your load job without re-uploading if the load job happens to fail (bad schema, etc), and you may have other reasons to want a copy of the data in GCS (loading into other systems, etc).

Upvotes: 4

Related Questions