CODEWITHSUNDEEP
aws-cloudformationjobsaws-glue
Agukov
Agukov

Reputation: 91

cloudformation glue job type python shell

I am struggling to find how to create a python shell (not spark) glue job via cloudformation, i am unable to find what property defines that.

Only one that would make sence is jobcommand name, but its limited to glueetl as per https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-glue-job-jobcommand.html

Upvotes: 3

Views: 2349

Answers (3)

Krzysztof Słowiński
Krzysztof Słowiński

Reputation: 7237

Use `pythonshell' in Name property of Command, as explained in docs.

PythonShellJob:
  Type: AWS::Glue::Job
  Properties:
    Command:
      Name: pythonshell
      ScriptLocation: "s3://my-glue-scripts//my-script-file.py"
    Role: !Ref MyJobRole

Upvotes: 0

Sandeep Fatangare
Sandeep Fatangare

Reputation: 2144

You have to use pythonshell for python and should not specify dpus.

Upvotes: 0

Agukov
Agukov

Reputation: 91

Even though cloudformation page states that the only accepted value is glueetl, glue documentation states that pythonshell is an option aswell. https://docs.aws.amazon.com/glue/latest/dg/add-job-python.html

Upvotes: 5

Related Questions