Zahid Khan
Zahid Khan

Reputation: 3233

How to get response from HTTP Sink Plugin in Cloud Data Fusion?

Expertise: I am new to Cloud Data Fusion.

What I am trying to achieve: Create a Data pipeline in the Google Cloud Data Fusion:

  1. Read a file from GCS.
  2. Call an HTTP Endpoint with the parsed data of GCS.
  3. Save the response received from HTTP in the GCS file.

enter image description here

However, it seems HTTP Plugin(Sink) doesn't have the capability to receive the data back from the endpoint.

Upvotes: 1

Views: 463

Answers (1)

MBHA Phoenix
MBHA Phoenix

Reputation: 2217

Probably you cloud fusion is on a private network, your http endpoint is exposed on the internet so you can contact it but you cannot receive the response. Cloud Nat is usually used for this kind of requirements.

Upvotes: 1

Related Questions