Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

google provider - GKEStartPodOperator without gcloud to get conf

See original GitHub issue

Description

Retrieve the GKE conf with python code and not by running a gcloud subprocess cmd

-> https://github.com/apache/airflow/blob/5247445ff13e4b9cf73c26f902af03791f48f04d/airflow/providers/google/cloud/operators/kubernetes_engine.py#L355

Use case/motivation

It’s currently necessary to have gcloud to use the GKEStartPodOperator , but it look like it’s possible without by only using python libs

https://github.com/googleapis/python-container/issues/6#issuecomment-970746358

Related issues

No response

Are you willing to submit a PR?

Yes I am willing to submit a PR!

Code of Conduct

I agree to follow this project’s Code of Conduct

Issue Analytics

State:
Created a year ago
Comments:11 (2 by maintainers)

Top GitHub Comments

2reactions

rbiegaczcommented, May 30, 2022

Yes, I can work on this item. Please, assign it to me.

2reactions

mik-lajcommented, Apr 4, 2022

It is worth remembering that the token may expire and we need to refresh it. We can be inspired by how it is done in EKS. https://github.com/apache/airflow/pull/17951

Top Results From Across the Web

Use the Google Kubernetes Engine operators | Cloud Composer

This page walks you through an example DAG that creates a Google Kubernetes Engine cluster with the GKECreateClusterOperator , uses the GKEStartPodOperator with ......

Google Kubernetes Engine Operators - Apache Airflow

GKEStartPodOperator extends KubernetesPodOperator to provide authorization using Google Cloud credentials. There is no need to manage the kube_config file, ...

Updating Airflow

The Old and New provider configuration keys that have changed are as follows ... airflow.providers.google.cloud.log.stackdriver_task_handler ...

Using GKE with Terraform | Guides | hashicorp/google

Getting Started with the Google provider · Google Provider Configuration Reference ... with Terraform or a static config without gcloud is more desirable....

dbt at scale on Google Cloud - Part 3

IAM binding for impersonation / workload identity: Once you have applied those two resources, your GKEStartPodOperator that has a Kubernetes service account ...