CODEWITHSUNDEEP
talend
Arnon Rodman
Arnon Rodman

Reputation: 541

Talend multiple build jobs

We are using open source Talend studio and we have more then 50 jobs. Each build generate zip file contains all it's artifacts ( .bat .sh context, jar files)

Is there a way to generate multiple build process from the studio or command line ( Talend open source tool )

Upvotes: 3

Views: 1671

Answers (2)

kdev
kdev

Reputation: 705

Not an ideal solution but you can use a small script to split the whole zip into separate job zips:

ZIP=test.zip # path to your all-in-one zip file
ROOT=$(basename $ZIP .zip)
DEST=./dest
rm -rf $DEST # be careful with this one!
mkdir -p $DEST
unzip $ZIP
find $ROOT -mindepth 1 -maxdepth 1 -type d ! -name lib|while read JOBPATH
do
        JOB=$(basename $JOBPATH)
        echo "job: $JOB"
        DJOB="$DEST/$JOB"
        mkdir -p "$DJOB"
        cp -R "$JOBPATH" "$DJOB/$JOB"
        cp $ROOT/jobInfo.properties $DJOB # here you should replace job=<proper job name> and jobId, but not sure you really need it
        mkdir -p "$DJOB/lib"
        RUNFILE="${JOBPATH}/${JOB}_run.sh"
        LIBS=$(grep "^java" "$RUNFILE"|cut -d' ' -f 5)
        IFS=':' read -ra ALIB <<< "$LIBS"
        for LIB in "${ALIB[@]}"; do
                if [ "$LIB" = "." -o "$LIB" = "\$ROOT_PATH" ]; then continue; fi
                echo "$LIB"
        done|grep "\$ROOT_PATH/../lib"|cut -b 19-|while read DEP
        do
                cp "$ROOT/lib/$DEP" "$DJOB/lib/"
        done
        (cd $DJOB ; zip -r -m ../$JOB.zip .)
        rmdir $DJOB
done

Upvotes: 1

54l3d
54l3d

Reputation: 3973

In the "build job" window, there is a double arrow in the left,

enter image description here

Click on it, and you get the job tree, select all jobs or what you want, and you will get a single zip file containing all your jobs each one in a separate folder.

Upvotes: 2

Related Questions