CODEWITHSUNDEEP
google-apigoogle-bigquerystreaming
xiaolong
xiaolong

Reputation: 3657

BigQuery stream inserts: Maximum allowed row size exceeded

While using BigQuery stream insert, specifically, the tabledata.insertAll method, I got errors saying Maximum allowed row size exceeded. It looks like the maximum row size allowed is only 1MB when using stream inserts (confirmed by this quota page).

error message: [{
    "index": 13,
    "errors": [{
        "reason": "invalid",
        "location": "",
        "debugInfo": "",
        "message": "Maximum allowed row size exceeded. Allowed: 1048576 Row size: 1383661"
    }]

How do one get around this situation - if I really need streaming inserts?

Upvotes: 1

Views: 847

Answers (1)

rsantiago
rsantiago

Reputation: 2099

As you mentioned, the best approach to address this issue is changing the code to break down the size.

Another way is contacting the Google Cloud Platform Support to request an increase, for example you can ask for doubling the limit. Keep in mind that it might or might not be granted. To request an increase, it is needed to upgrade your account as indicated in the Program Coverage for Free Trial period or even better having a support package.

Upvotes: 1

Related Questions