Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Add TaskInstance* properties to JobFlowInstanceConfig in emr.py

See original GitHub issue

Ask Hello, I’m looking to get the two TaskInstance* properties to the JobFlowInstanceConfig resource in emr.py. First time posting so let me know if I missed some protocol or step or if you have any questions.

Troubleshooting steps I took Following the info in CONTRIBUTING.md, I constructed the spec, generated emr.py and checked the diff to see if the properties appeared. They did not. I then checked the CloudFormationResourceSpecification.json file for the presence of those two properties and they were not there. I guess this means that AWS hasn’t updated this content on their end?

Issue Analytics

State:
Created 2 years ago
Comments:6 (3 by maintainers)

Top GitHub Comments

1reaction

markpeekcommented, Mar 28, 2022

@avmarchenko I patched these changes into Release 4.0.0 via 2c94e3dd9d8a516762a267a98216fd0a43365908

1reaction

markpeekcommented, Mar 10, 2022

Yes, that technique is an easy localized workaround. The needed change is to make it a list of those objects (according to the docs):

from troposphere.emr import JobFlowInstancesConfig, InstanceFleetConfigProperty, InstanceGroupConfigProperty
JobFlowInstancesConfig.props["TaskInstanceFleets"] = ([InstanceFleetConfigProperty], False)
JobFlowInstancesConfig.props["TaskInstanceGroup"] = ([InstanceGroupConfigProperty], False)

Leave this open for now so I can track it and feel free to follow up if the above works.

Top Results From Across the Web

EMR::Cluster JobFlowInstancesConfig - AWS CloudFormation

JobFlowInstancesConfig is a property of the AWS::EMR::Cluster resource. ... These task instance fleets are added to the cluster as part of the cluster ......

AWS::EMR::Cluster JobFlowInstancesConfig - 亚马逊云科技

JobFlowInstancesConfig is a property of the AWS::EMR::Cluster resource. ... You can now define task instance groups or task instance fleets using the ...

awsdocs/aws-cloudformation-user-guide - GitHub

JobFlowInstancesConfig is a property of the AWS::EMR::Cluster resource. ... You can now define task instance groups or task instance fleets using the ...

How to specify Ec2 Instance Attributes in a AWS EMR Cluster ...

I want to create a cloud formation template for EMR using AWS:EMR:Cluster, ... of the JobFlowInstancesConfig property type to do this.

Airflow - Task Instance in EMR operator - Stack Overflow

Created a custom operator that inherits from EmrAddStepsOperator; Added this operator as Plugin; Called the newly operator in my DAG file. Here ...