CODEWITHSUNDEEP
amazon-web-servicesaws-glueaws-cloudwatch-log-insights
Data girl
Data girl

Reputation: 177

log groups and log stream name question for aws glue

I have a glue job that is developed in my account and i had ran it multiple times and corresponding logs are available in aws/awsglue/ log streams in cloud watch . But there are other developers also developing glue jobs, which makes me very hard to differentiate between the multiple logs names . as log names doesnt have a user friendly name in cloudwatch logs. is there a way to rename the logs related to my aws glue job ?

Upvotes: 2

Views: 1310

Answers (1)

teejay
teejay

Reputation: 806

May be a little late for OP, but hopefully helpful to others...

You can enable logging with default settings by checking the Continuous logging option under the Advanced properties section of the Job details tab within the AWS Console for the Glue job.

To specify custom log stream and log group, you can use the --continuous-log-logGroup and --continuous-log-logStreamPrefix job parameters.
These are key-value pairs you specify in the Job parameters section under Advanced properties.

See documentation for more detailed information.

Upvotes: 0

Related Questions