CODEWITHSUNDEEP
azureazure-data-factory
prayora kc
prayora kc

Reputation: 9

Azure Data Factory Cannot retrieve output

With ADF I created web activity with Post method and got my output. I need to get the output that's in json to be stored in my blob storage. I tried copy data method but it gives me error of "Failure happened on 'Source' side.

ErrorCode=UserErrorHttpStatusCodeIndicatingFailure,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The HttpStatusCode 404 indicates failure. { "statusCode": 404, "message": "Resource not found" },Source=Microsoft.DataTransfer.ClientLibrary,'"

I have added dynamic value as an input in the copy activity but gives me error in debug. I am able to see the desired output in the input(debug mode) but output in not the same. Here is what it shows as output:

{
    "effectiveIntegrationRuntime": "DefaultIntegrationRuntime (West US)",
    "executionDuration": 0,
    "durationInQueue": {
        "integrationRuntimeQueue": 1
    },
    "billingReference": {
        "activityType": "ExternalActivity",
        "billableDuration": [
            {
                "meterType": "AzureIR",
                "duration": 0.016666666666666666,
                "unit": "Hours"
            }
        ]
    }
}

Goal here is to get the output stored in a blob as csv so I can import that file to sql table. How do I get the output stored in blob storage?

Upvotes: 0

Views: 866

Answers (2)

gunn
gunn

Reputation: 321

Yes, the point is to store only domain name in HTTP LinkedService, and store the whole relative URL (e.g. /api/v1/products) in input dataset.

Upvotes: 0

prayora kc
prayora kc

Reputation: 9

I was able to get this to work by simply using copy activity. The reason why it was failing at first was because of the relative URL. On rest data after adding connection, I separated base and relative URL. I added rest data as a source and for sink I just added SQL table. Was able to store the response directly to table.

Upvotes: 1

Related Questions