CODEWITHSUNDEEP
google-cloud-platformgoogle-cloud-data-fusioncdap
Paolo Fusari
Paolo Fusari

Reputation: 115

GCP Data Fusion HTTP post-run plugin errors

from CDAP documentation exists an HTTPS post-run plugin to trigger pipeline start based on the successful execution of another pipeline (Scheduling). I'm trying to use this functionality in GCP Data Fusion but the plugin even if installed (because I can see it from Control Center) seems to be not available.

I also tried to install manually the plugin HTTP Plugin v2.2.0 as stated in the documentation but has only sink and source action. Also if I try to use the plugin an error is displayed

HTTP Properties 1.2.0 (No widgets JSON found for the plugin. Please check the documentation on how to add.)

this error seems related to the fact that Data Fusion is trying to use version 1.2.0 (the one already installed) with properties of version 2.2.0.

Any suggestions on how to solve this issue?

Update

I can see the two vesions http-plugin from Control Center

enter image description here

but I cannot set the version

enter image description here

Problem about http plugin hasn't been solved but I found the existence of pipeline trigger to execute pipeline based on status of another pipeline, this feateure is only available with Enterprise edition.

Upvotes: 1

Views: 1031

Answers (2)

Nick_Kh
Nick_Kh

Reputation: 5243

I believe you can find HTTPCallback post action plugin for the particular batch pipeline attaching appropriate pipeline alert.

Following Configure menu from the main dashboard plate:

enter image description here

Create the new Alert object invoking HTTPCallback plugin properties list:

enter image description here

Upvotes: 0

Mo Eseifan
Mo Eseifan

Reputation: 56

Depending on the version of the you Data Fusion instance, it may still be defaulting to the old version of the plugin. To select the new version of the plugin you should:

  1. Navigate to the Studio
  2. Hover your mouse over the HTTP plugin in the sidebar
  3. After a second or so, a box will appear with the plugin details. You will see the current version of the plugin and a button beside it that says "Change", click on this button. If you don't see this button that means you only have one version of the plugin in your instance. enter image description here
  4. You will see a list of all the versions of the plugin in this instance, select the one you want. The version you select will be the new default version.

You should now be able to use v2.2.0 of the plugin.

Upvotes: 0

Related Questions