Airflow Docker - Webserver not starting
See original GitHub issueApache Airflow version: 2.0.2
Environment:
- Cloud provider or hardware configuration:
- OS (e.g. from /etc/os-release): Ubuntu 20.04.2 LTS
Hi there,
I’m running Airflow via Docker using the official docker-compose image, and whilst everything seems to work fine, the webserver gets stuck in an endless loop of:
Whilst the image suggests port 8080 is taken, it is not. Nonetheless, I have tried forcing a different external port:
airflow-webserver:
<<: *airflow-common
command: webserver
ports:
- 5050:8080
And the problem persists.
After a bit more investigation, I found out that apparently, both the scheduler and webserver are using the same port (see image below), unless I’m misinterpreting the log. Is this supposed to happen?
Issue Analytics
- State:
- Created 2 years ago
- Reactions:1
- Comments:11 (6 by maintainers)
Top Results From Across the Web
Webservice not working in Airflow docker container
I need to run two webservice when anyone run the docker image. I am using ENTRYPOINT to execute run the web service through...
Read more >Running Airflow in Docker
This procedure assumes familiarity with Docker and Docker Compose. ... If enough memory is not allocated, it might lead to the webserver continuously ......
Read more >How to Run Airflow Locally With Docker - Towards Data Science
This command will stop and delete all running containers, delete volumes with database data and downloaded images. If you run docker ps once ......
Read more >puckel/docker-airflow - Docker Image
docker run -d -p 8080:8080 puckel/docker-airflow webserver. If you want to run another executor, use the other docker-compose.yml files provided in this ...
Read more >7 Common Errors to Check When Debugging Airflow DAGs
Even if you're not running anything particularly heavy, underprovisioning your Webserver will likely return some funky behavior. Increase the ...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
Exit 137 is almost always Out-of-memory. Here you can find the documentation about the right Docker settings for development: https://github.com/apache/airflow/blob/master/BREEZE.rst#docker-community-edition
I think it misses the Memory setting thoughj, but I would recommend at least 4GB RAM /8GB comfortable allocated for Docker if you want to run containerised Airflow.