question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Pod fails to run when task or dag name contains non ASCII characters (k8s executor)

See original GitHub issue

Apache Airflow version: 2.0.1

Kubernetes version (if you are using kubernetes) (use kubectl version): 1.20.5

Environment:

  • Cloud provider or hardware configuration: Azure AKS

What happened:

When task or dag name is defined with a non ascii character, pod creations fails with a kubernetes.client.rest.ApiException: (422) (task maintains scheduled status) this is because the hostname defined for the pod is based on dag and task name…

What you expected to happen:

Create the pod and run the task

How to reproduce it: Run a task with name “campaña” on K8s executor,

Error log

{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"Pod \"dagnamecampaña.0fb696e661e347968216df454b41b56f\" is invalid: metadata.name: Invalid value: \"dagnamecampaña.0fb696e661e347968216df454b41b56f\": a lowercase RFC 1123 subdomain must consist of lower case alphanumeric characters, '-' or '.', and must start and end with an alphanumeric character (e.g. 'example.com', regex used for validation is '[a-z0-9]([-a-z0-9]*[a-z0
-9])?(\\.[a-z0-9]([-a-z0-9]*[a-z0-9])?)*')","reason":"Invalid"

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:5 (5 by maintainers)

github_iconTop GitHub Comments

1reaction
potiukcommented, Jul 14, 2021

@flolas -> I think sanitization of the name and converting it to ASCII -only is a great idea. Would you maybe want to submit a PR for that ? That would be great contribution to the project 😃

0reactions
potiukcommented, Jul 14, 2021

cool!

Read more comments on GitHub >

github_iconTop Results From Across the Web

Kubernetes Executor — Airflow Documentation - Apache Airflow
The Kubernetes executor runs each task instance in its own pod on a Kubernetes cluster. KubernetesExecutor runs as a process in the Airflow...
Read more >
The Kubernetes executor for GitLab Runner
An array of items containing the Kubernetes docker-registry secret names used to authenticate Docker image pulling from private registries. namespace, Namespace ...
Read more >
Release Notes - Apache Airflow documentation - Amazon AWS
Fix example_datasets dag names (#26495). Zip-like effect is now possible in task mapping (#26435). Use task decorator in docs instead of classic operators ......
Read more >
IGES:IG2 FILE WITH THE FILE NAME CONTAINING NON ...
Error description. IGES:IG2 file with the file name containing non- ASCII characters cannot be opened. . SCENARIO: 1. Start CATIA V5 2. Open...
Read more >
Airflow DAG parallel task delay/latency in execution by 60 ...
However, we have observed that the DAG's tasks though are getting ... has a task that calls a python code to trigger a...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found