CODEWITHSUNDEEP
azureazure-data-factory
Vishnu Suresh
Vishnu Suresh

Reputation: 187

Azure Mapping Data Flow : Not able to use blob storage dataset as a source

I added a Azure Blob dataset as a source to a Azure mapping data flow, but am not able to view the preview as it is showing the below error :

Dataset is using 'AzureStorage' linked service type, which is not supported in data flow.

Given below is the dataset JSON :

{
"name": "PIT_Input",
"properties": {
    "linkedServiceName": {
        "referenceName": "data_staging",
        "type": "LinkedServiceReference"
    },
    "annotations": [],
    "type": "DelimitedText",
    "typeProperties": {
        "location": {
            "type": "AzureBlobStorageLocation",
            "container": "dataflowpoc"
        },
        "columnDelimiter": ",",
        "escapeChar": "\\",
        "firstRowAsHeader": true,
        "quoteChar": "\""
    },
    "schema": []
  }
}

data_staging is a linked service of type Azure Storage.

The documentation states that Azure Blob datasets can used as a source. Please tell me what I'm doing wrong here.

Upvotes: 1

Views: 2228

Answers (1)

Leon Yue
Leon Yue

Reputation: 16401

According you dataset JSON, you just choose the container dataflowpoc, didn't specify the file.

You only could preview the file data which type is "DelimitedText": enter image description here

Dataset Preview data, we can not preview all the data if files in the container with different schema: enter image description here

Dataset JSON:

{
    "name": "DelimitedText1",
    "properties": {
        "linkedServiceName": {
            "referenceName": "AzureBlobStorage1",
            "type": "LinkedServiceReference"
        },
        "annotations": [],
        "type": "DelimitedText",
        "typeProperties": {
            "location": {
                "type": "AzureBlobStorageLocation",
                "container": "containerleon"
            },
            "columnDelimiter": ",",
            "escapeChar": "\\",
            "firstRowAsHeader": false,
            "quoteChar": "\""
        },
        "schema": []
    },
    "type": "Microsoft.DataFactory/factories/datasets"
}

But in Data Flow Data Preview, we can see all the data in the files: enter image description here

I think your error just happened by accident, please refresh the Data Factory and try again.

Update:

The error is solved: "I changed the type of the Linked Service from Azure storage to Azure blob storage, and it worked."

Hope this helps.

Upvotes: 1

Related Questions