CODEWITHSUNDEEP
google-cloud-platformgoogle-cloud-dataflowapache-beam
Mahesh kagitha
Mahesh kagitha

Reputation: 1

GCP Dataflow +Apache beam - Http SOAP xml API to external on-prem webservice

Does GCP Dataflow support transformation of calling external API endpoint using SOAP xml POST? I couldn't find any Apache Beam library supporting this need directly. If not SOAP, can I do REST API callouts through Apache Beam transformations?

Upvotes: 0

Views: 216

Answers (1)

Mazlum Tosun
Mazlum Tosun

Reputation: 6572

It's possible to do api calls in a DoFn. You only need using your api client class inside the DoFn and process your call.

You should care about performance in this case, due to network access of your api calls.

If you have the possibility to retrieve the data from the api directly in the input connector (IO), you will have better performances.

Upvotes: 1

Related Questions