CODEWITHSUNDEEP
amazon-web-servicesaws-lambdaaws-glueaws-step-functions
Rahul Berry
Rahul Berry

Reputation: 93

How can we trigger multiple jobs in AWS glue?

I'm new to AWS glue, can anyone please explain how we can triggers multiple jobs together through a single jobs or through any other means.

Upvotes: 0

Views: 4889

Answers (2)

Sandeep Fatangare
Sandeep Fatangare

Reputation: 2144

Glue workflow, Glue triggers will help you -

Upvotes: 0

Abhijit
Abhijit

Reputation: 11

You can do it using Lambda function . In Lambda code import boto3

build a dictionary with all the gluejobnames . Then loop on it and pass the gluejobname one by one to trigger all the glue jobs you want to trigger .

 import boto3
 client = boto3.client('glue')
 response = client.start_job_run(
   JobName=glueJobName.get(gluejobname),
   Arguments={
     '--day_partition_key': 'date',
     '--hour_partition_key': 'hour'
   }
 )

Upvotes: 1

Related Questions