CODEWITHSUNDEEP
pythonamazon-web-servicesamazon-emramazon-vpcmrjob
Gonzalo
Gonzalo

Reputation: 166

mrjob: Is it possible to run a job flow in a VPC?

I'm using mrjob to run some MapReduce tasks on EMR, and I want to run a job flow in a VPC. I looked at the documentation of mrjob and boto, and none of them seems to support this.

Does anyone know if this is possible to do?

Upvotes: 3

Views: 603

Answers (1)

Gonzalo
Gonzalo

Reputation: 166

Right now (v 0.3.5) is not possible. I made a pull request on the github project to add support for the 'api_params' parameter of boto, so you can pass parameters directly to the AWS API, and use the 'Instances.Ec2SubnetId' parameter to run a job flow in a VPC subnet.

Upvotes: 6

Related Questions