Airflow 2.0 does not send metrics to statsD when Scheduler is run with Daemon mode

Apache Airflow version: 2.0.0

Environment:

• OS (e.g. from /etc/os-release): Ubuntu 20.04 LTS
• Python version: 3.8
• Kernel (e.g. uname -a): x86_64 x86_64 x86_64 GNU/Linux 5.4.0-58-generic #64-Ubuntu
• Install tools: pip

What happened:

Airflow 2.0 does not send metrics to statsD.

I configure Airflow with official documentation (https://airflow.apache.org/docs/apache-airflow/stable/logging-monitoring/metrics.html) and by this article https://dstan.medium.com/run-airflow-statsd-grafana-locally-16b372c86524 (but I used port 8125).

I turned on statsD:

statsd_on = True
statsd_host = localhost
statsd_port = 8125
statsd_prefix = airflow

But I do not see airflow metrics at http://localhost:9102/metrics (statsD metrics endpoint).

---

P.S. I noticed this error just using Airflow 2.0. In version 1.10.13 everything is ok in the same environment.

Thank you for advance.

[ankxyz]

@potiuk Of course. Moreover, I generated airflow.cfg from scratch to test it.

Сlarification (recently noticed): the problem arises just if I run airflow scheduler in daemon mode:

airflow scheduler -D

If I start it normally (without param -D) or using nohup - everything ok:

nohup airflow scheduler >> ${AIRFLOW_HOMW}/logs/scheduler.log 2>&1 &

So I have the problem just with daemon mode.

[ashb]

Oh yes, daemon mode will close all open files and sockets.