Johan
Reputation: 40628
Loading data from a Google Persistent Disk into BigQuery?
What's the recommended way of loading data into BigQuery that is currently located in a Google Persistent Disk? Are there any special tools or best practises for this particular use case?
Upvotes: 0
Views: 112
Answers (1)
Felipe Hoffa
Reputation: 59355
Copy to GCS (Google Cloud Storage), point BigQuery to load from GCS.
There's no current direct connection between a persistent disk and BigQuery. You could send the data straight to BigQuery with the bq CLI, but makes everything slower if you ever need to retry.
Upvotes: 1
Related Questions
- Comparison of loading from different file formats in BigQuery
- Google BQ - how to upsert existing data in tables?
- Google BigQuery - Streaming Data Into BigQuery
- How to create temporary table in Google BigQuery
- Loading Data from Google BigQuery into Spark (on Databricks)
- Is there (still) an advantage to staging data on Google Cloud Storage before loading into BigQuery?
- Loading data from BigQuery into Redis
- Loading data automatically from Oracle DB to Google BigQuery
- Strategy for loading data into BigQuery and Google cloud Storage from local disk
- Uploading files into Google Persistent Disk