CODEWITHSUNDEEP
azure-data-factory
Patterson
Patterson

Reputation: 2821

Unable to Copy JSON Lines file format in Azure Data Factory

I'm trying to run a simple 'Copy Activity' in Azure Data Factory v2, to copy a JSON Lines file with the format .jsonl. However, I keep on getting the following error when I try to copy:

Failure happened on 'Source' side. ErrorCode=JsonInvalidDataFormat,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Error occurred when deserializing source JSON file 'grantofrepresentation-2019-08.jsonl'. Check if the data is in valid JSON object format.,Source=Microsoft.DataTransfer.Common,''Type=Newtonsoft.Json.JsonReaderException,Message=Unexpected end of content while loading JObject. Path 'ce_data_classification.solsDeceasedAliasNamesList.value', line 2535, position 9228.,Source=Newtonsoft.Json,'

I'm sure ADF can handle .jsonl files but I have never worked with .jsonl files before.

Can someone confirm ADFv2 can copy .jsonl files, and let me know where I might be going wrong?

Upvotes: 0

Views: 1246

Answers (1)

Leon Yue
Leon Yue

Reputation: 16431

I tested and Data Factory supports the JSON format file which end with ".jsonl" , see my example: enter image description here

Please make sure you have set the JSON format as the dataset: enter image description here

Ref： JSON format in Azure Data Factory

Upvotes: 1

Related Questions