CODEWITHSUNDEEP
google-cloud-storagegoogle-cloud-run
philo
philo

Reputation: 3690

google cloud run: upload to gcs: data transfer limit?

I wrote a Cloud Run app to accept a user file upload, do some processing to it, and respond with the processed output. It failed, saying "HTTP response was too large: 50930613. The limit is: 33554432."

I have an idea to upload the file to GCS instead, and have my app redirect to the GCS location. But before I set all that up, am I going to run into the same issue, with egress being limited to 32MB? I've seen a SO question saying that that is the case for AppEngine.

Upvotes: 2

Views: 2092

Answers (2)

philo
philo

Reputation: 3690

I was able to send that same file to GCS using the client libraries. I don't want to say for sure that there's no limit, but at least 50MB is fine.

Upvotes: 0

Mayeru
Mayeru

Reputation: 1094

Your idea is correct, since the response from Cloud Run is also limited to 32MB.

You would need to:

1- Process the data and upload it to a Cloud Storage bucket using the client libs (depending on the language that you are using).

2.- Point the user to the download url of the object. You can also use signed urls if you want to keep the object private, but according to your use case you might not need to (since you will delete the file shortly after either way).

Upvotes: 4

Related Questions