question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Startup slow due to securityContext with large log volume

See original GitHub issue

Apache Airflow version: 2.0.0

Kubernetes version (if you are using kubernetes) (use kubectl version): 1.11

  • Cloud provider or hardware configuration: alicloud
  • Install tools: helm chart
  • Others:

What happened:

uid/gid causes a massive delay on starting webserver with a large log volume. default behavior for Kubernetes to run chown recursively on the entire volume at mount time when fsGroup is set: https://github.com/kubernetes/kubernetes/issues/67014

What you expected to happen:

How to reproduce it:

Issue Analytics

  • State:open
  • Created 3 years ago
  • Comments:8 (7 by maintainers)

github_iconTop GitHub Comments

1reaction
junnpluscommented, Mar 30, 2021

@dimberman I remove fsGroup from webserver and worker deployment.

+++ b/chart/templates/webserver/webserver-deployment.yaml
@@ -75,7 +75,6 @@ spec:
       restartPolicy: Always
       securityContext:
         runAsUser: {{ .Values.uid }}
-        fsGroup: {{ .Values.gid }}
       {{- if or .Values.registry.secretName .Values.registry.connection }}
       imagePullSecrets:
         - name: {{ template "registry_secret" . }}
0reactions
dimbermancommented, Mar 29, 2021

@Junnplus what do you mean by “option to skip fsgroup”? Can you give me an example of how that has been done?

Read more comments on GitHub >

github_iconTop Results From Across the Web

10 Kubernetes Security Context settings you should understand
The changing of group ownership of an entire volume can cause pod startup delays for slow and/or large filesystems.
Read more >
Slow mount times for very large CSI volumes (minio & more), modify ...
With a lot of storage (160+ Gibibytes) MinIO pods can take 30 minutes to 1 hour to start up, because the MinIO sub...
Read more >
Write permissions on volume mount with security context ...
I have a startup script that creates a directory in /opt/var/logs (during container startup) and also starts tomcat service.
Read more >
Deployments timing out if storage contains lots of small files
OSE is not able to launch pods with this volume attached. ... Post-start lifecycle hooks aren't run and container logs aren't linked (as...
Read more >
Managing security context constraints
Customizing the default SCCs can lead to issues when some of the platform pods deploy or OpenShift Container Platform is upgraded. During upgrades...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found