CODEWITHSUNDEEP
google-cloud-dataflow
abhishek jha
abhishek jha

Reputation: 1095

Getting HTTP transport error while executing google dataflow job

I am getting a constant error while executing a Dataflow job:

BigQuery import job "dataflow_job_838656419" failed., : BigQuery creation of import job for table "TestTable" in dataset "TestDataSet" in project "TestProject" failed., : BigQuery execution failed., : HTTP transport error: Message: Invalid value for: String is not a valid value HTTP Code: 400

It does not give any specific reason for the google Dataflow job failing continuously. How do I know what is the error I am committing while executing the google Dataflow job?

Upvotes: 1

Views: 1203

Answers (1)

Sam McVeety
Sam McVeety

Reputation: 3214

The issue is the incorrect use of the BigQuery API, which is case-sensitive with respect to field type. Please specify "STRING" as the field type in the schema that you're providing.

Please see https://cloud.google.com/bigquery/docs/reference/rest/v2/tables for more details.

Upvotes: 4

Related Questions