CODEWITHSUNDEEP
amazon-web-servicesamazon-s3aws-glueaws-event-bridge
Techno_Eagle
Techno_Eagle

Reputation: 111

get file details whenever a file land in s3 bucket & then trigger a glue job for each individual files

I have a general glue job which will execute based on the file name that is landing in s3 bucket. So right now we are creating an event based trigger which will execute a workflow. (Event is whenever a file land in s3). Is there any way to get the file details like file name or s3 uri and then pass this info to the workflow as a parameter.

Upvotes: 2

Views: 1381

Answers (1)

Marcin
Marcin

Reputation: 238061

how can i use this fiile name as a parameter for my glue job?

The AWS docs explain how to pass arguments to a glue job and how to read them in the job itself. So basically your lambda would call start_job_run and pass Arguments (e.g. S3 object name) to your job. The job, when started, would read the arguments passed and perform actions based on them.

Upvotes: 3

Related Questions