CODEWITHSUNDEEP
csvgoogle-bigqueryerror-code
Research 2
Research 2

Reputation: 11

Error code: Inavlid in Loading Data on BigQuery

I have a large CSV file (nearly 10,000 rows) and I am trying to upload it on the BigQuery but it gives me this error:

ile-00000000: CSV table references column position 8, but line starting at position:622 contains only 8 columns. (error code: invalid)

Can anyone please tell me a possible to reason to it? I have double checked my Schema and it looks alright.

Thanks

Upvotes: 1

Views: 2852

Answers (2)

muntasir kabir
muntasir kabir

Reputation: 258

The error message suggests that the load job failed because at least one row has fewer columns than the automatically detected schema dictates.

Add

allow_jagged_rows=true

in the options.

Upvotes: 0

Justin Mortensen
Justin Mortensen

Reputation: 21

I had this same issue when trying to import a large data set in a csv to a BigQuery table.

The issue turned out to be some ascii control characters (\b, \t, \r, \n) in the data that was written in the csv. When the csv was being sent to BigQuery these characters caused the BiqQuery csv parser to misinterpret the line and break because the data didn't match with the number of columns in the header.

Replacing these characters with a space (to preserve formatting as best as possible) allowed me to import the data without further issues.

Upvotes: 0

Related Questions