question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Airflow Docker - Webserver not starting

See original GitHub issue

Apache Airflow version: 2.0.2

Environment:

  • Cloud provider or hardware configuration:
  • OS (e.g. from /etc/os-release): Ubuntu 20.04.2 LTS

Hi there,

I’m running Airflow via Docker using the official docker-compose image, and whilst everything seems to work fine, the webserver gets stuck in an endless loop of:

image

Whilst the image suggests port 8080 is taken, it is not. Nonetheless, I have tried forcing a different external port:

airflow-webserver:
    <<: *airflow-common
    command: webserver
    ports:
      - 5050:8080

And the problem persists.

After a bit more investigation, I found out that apparently, both the scheduler and webserver are using the same port (see image below), unless I’m misinterpreting the log. Is this supposed to happen?

image

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Reactions:1
  • Comments:11 (6 by maintainers)

github_iconTop GitHub Comments

2reactions
potiukcommented, May 19, 2021

Exit 137 is almost always Out-of-memory. Here you can find the documentation about the right Docker settings for development: https://github.com/apache/airflow/blob/master/BREEZE.rst#docker-community-edition

1reaction
potiukcommented, May 19, 2021

I think it misses the Memory setting thoughj, but I would recommend at least 4GB RAM /8GB comfortable allocated for Docker if you want to run containerised Airflow.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Webservice not working in Airflow docker container
I need to run two webservice when anyone run the docker image. I am using ENTRYPOINT to execute run the web service through...
Read more >
Running Airflow in Docker
This procedure assumes familiarity with Docker and Docker Compose. ... If enough memory is not allocated, it might lead to the webserver continuously ......
Read more >
How to Run Airflow Locally With Docker - Towards Data Science
This command will stop and delete all running containers, delete volumes with database data and downloaded images. If you run docker ps once ......
Read more >
puckel/docker-airflow - Docker Image
docker run -d -p 8080:8080 puckel/docker-airflow webserver. If you want to run another executor, use the other docker-compose.yml files provided in this ...
Read more >
7 Common Errors to Check When Debugging Airflow DAGs
Even if you're not running anything particularly heavy, underprovisioning your Webserver will likely return some funky behavior. Increase the ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found