Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Add support for AWS Batch

See original GitHub issue

It seems like AWS Batch can handle a lot of the logistics of bringing up and down the cluster automatically given a Docker image. I’m curious if it would make sense to integrate this into cloudprovider in some way: https://docs.aws.amazon.com/batch/latest/userguide/multi-node-parallel-jobs.html

Issue Analytics

State:
Created 4 years ago
Reactions:8
Comments:7 (3 by maintainers)

Top GitHub Comments

3reactions

samuelsinayokocommented, Jun 2, 2020

Hi! Haven’t contributed to Dask before but I’d be willing to look into this issue. I’m guessing the idea is to write a class similar to the Fargate one in https://github.com/dask/dask-cloudprovider/blob/master/dask_cloudprovider/providers/aws/ecs.py#L1167 but targeting AWS Batch?

1reaction

jacobtomlinsoncommented, Jun 4, 2020

@samuelsinayoko that’s right!

Top Results From Across the Web

Efficient Batch Computing – AWS Batch – Amazon Web Services

AWS Batch allows developers, scientists, and engineers to efficiently process hundreds of thousands of batch and machine learning computing jobs on AWS.

What Is AWS Batch? - AWS Batch

As a fully managed service, AWS Batch helps you to run batch computing workloads of any scale. AWS Batch automatically provisions compute resources...

Getting Started with AWS Batch

Getting Started with AWS Batch · Step 1: Prerequisites · Step 2: Create a compute environment · Step 3: Create a job queue...

Setting up with AWS Batch

To use the AWS CLI with AWS Batch , you must use a version of the AWS CLI that supports the latest AWS...

Launch template support - AWS Batch

AWS Batch supports using Amazon EC2 launch templates with your EC2 compute environments. With launch templates, you can modify the default configuration of...