EMR: How do I specify bid price as "OnDemandPrice" in instanceGroups configuration?
See original GitHub issuePlease fill out the sections below to help us address your issue.
What issue did you see ? I am trying to submit a job flow on EMR to start a cluster. I want to set bid price as “OnDemandPrice” instead of USD amount as per the documentation here https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/emr.html#EMR.Client.run_job_flow
However, when I invoke run_job_flow()
I get the following exception:
botocore.exceptions.ClientError: An error occurred (ValidationException) when calling the RunJobFlow operation: The bid price is invalid. Revise the configuration and resubmit.
My configuration for the instanceGroups looks like this:
"InstanceGroups": [
{
"InstanceRole": "MASTER",
"Market": "SPOT",
"InstanceType": "r5d.16xlarge",
"BidPrice": "OnDemandPrice",
"InstanceCount": 1
},
{
"InstanceRole": "CORE",
"Market": "SPOT",
"InstanceType": "r5d.16xlarge",
"BidPrice": "OnDemandPrice",
"InstanceCount": 5
}
]
EMR Version: emr-6.2.0
Steps to reproduce If you have a runnable example, please include it as a snippet or link to a repository/gist for larger code examples.
Debug logs
Full stack trace by adding boto3.set_stream_logger('')
to your code.
Issue Analytics
- State:
- Created 2 years ago
- Reactions:1
- Comments:10 (5 by maintainers)
Top GitHub Comments
Thank you for the feedback
Hi @shanfadnis,
Thanks for the additional information! I don’t see anything obvious that stands out as problematic, but I’ve reached out to the EMR team to get their thoughts on this. I’ll let you know as soon as I have an update!