question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Create EKS operators

See original GitHub issue

Description

The same way that we have GKEStartPodOperator and GKECreateClusterOperator we should add operators that interact with EKS and abstracts all amazon logic from the airflow user.

Use case / motivation

This will allow airflow to be a general purpose kubernetes orchestrator. Able to do multi-cluster orchestration across multiple clouds.

Related Issues

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:7 (4 by maintainers)

github_iconTop GitHub Comments

1reaction
dimbermancommented, Mar 29, 2021

Hi @ferruzzi, this looks great!

In general, we don’t need anything super formal for creating operators (though this is useful). If you were to make a core change that would involve submitting an AIP, but for this you’re good to go!

0reactions
ferruzzicommented, Jun 17, 2021

Best I can tell that is an underlying issue which I don’t intend to tackle at this time.

Quick update, most of the code for this has been implemented, but moto didn’t have any EKS support. So I have a PR in with them to add that, then I’ll drop a PR here once they push that to their release.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Amazon Elastic Kubernetes Service (EKS) Operators
Airflow provides operators to create and interact with the EKS clusters and compute infrastructure. Prerequisite Tasks. Manage Amazon EKS Clusters.
Read more >
Creating an Amazon EKS cluster - AWS Documentation
When an Amazon EKS cluster is created, the IAM entity (user or role) that creates the cluster is permanently added to the Kubernetes...
Read more >
rancher/eks-operator - GitHub
EKS operator is a Kubernetes CRD controller that controls cluster provisioning in Elastic Kubernetes Service using an EKSClusterConfig defined by a Custom ...
Read more >
Getting Started with the OpenFaaS Kubernetes Operator ...
In order to create an EKS cluster you can use eksctl. eksctl is an open source command-line utility made by Weaveworks in collaboration...
Read more >
Amazon EKS - AWS Controllers for Kubernetes - OperatorHub.io
Channel · Version · Capability Level · Provider · Links · Repository · Container Image · Created At.
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found