Capture airflow run duration

[#1]

I have a requirement to gather run duration (time) for the last 3 months, for a particular airflow job.

In our CDE environment we use airflow to call spark DBT jobs, of late the run duration of job have increased drastically.
I assume there would be a way to gather this jobs runtime duration for further analysis etc. Hoping for some assistance / guidance in getting his done.

CDE Version - 1.19.3-b29

Thanks 

Wert

[#2]

Hello @wert_1311 Thank you for bringing this to our Community. 

I see this has already by requested by you here: 
[0a]https://community.cloudera.com/t5/Support-Questions/Monitor-alert-long-running-Airflow-jobs/m-p/3883...

Did it not help? If not, Please try the following:

Airflow has the following metrics that can be used: 
[0b]https://airflow.apache.org/docs/apache-airflow/stable/administration-and-deployment/logging-monitori...

For the integration, I'd suggest you explore the feasibility based on your use-case. For example, the Metrics configuration setup is given here for StatD and OpenTelemetry.
[0c] https://airflow.apache.org/docs/apache-airflow/stable/administration-and-deployment/logging-monitori...

Also, I am citing the third-party  apps that may be helpful: 
[0d] https://github.com/search?q=airflow+prometheus&type=repositories

Let us know how it goes. 

V