Hai Nguyen
Reputation: 11
Automation of Colab Enterprise notebook within BigQuery Studio workspace
I have a colab notebook stored in BigQuery studio (screen attached, Notebook 1). Essentially, Notebook 1 will take data from a table stored in the same GCP project, perform some transformation and export into another table in the same project. I want to automate this in a way that Notebook 1 will run everyday at 7AM to update the data.
I have looked online but seem to not find a solution, as most solution points to using Jupyterlab in Vertex AI. Does anyone know how to automate this process? Should I use Google Cloud Functions for this?
Upvotes: 1
Views: 264
Answers (0)
Related Questions
- Sync GCP PostgreSQL tables to GCP BigQuery
- long-running job on GCP cloud run
- Possible to route multiple projects to a Cloud Function endpoint?
- How to schedule a GCP VM Instance with a custom python command when the instance gets started?
- Is it possible to connect to the private IP of a Cloud SQL instance in GCP Vertex AI pipeline?
- How to use pandas-gbq with BigQuery Storage API within AI platform training?
- Google Analytics -> Bigquery -> daily export to IBM cloud storage
- How do I export a dataframe to a BigQuery table from Cloud Datalab?