I have a requirement to gather run duration (time) for the last 3 months, for a particular airflow job. In our CDE environment we use airflow to call spark DBT jobs, of late the run duration of job have increased drastically. I assume there would be a way to gather this jobs runtime duration for further analysis etc. Hoping for some assistance / guidance in getting his done. CDE Version - 1.19.3-b29 Thanks  Wert ... View more

Hi, I am in need for some sort of alerting mechanism to monitor long running CDE jobs, basically we use Airflow to call /run Spark DBT jobs I am looking if there is a way to monitor / alert if any jobs cross certain threshold time limit. Would appreciate if anyone has implemented it / guide in this direction. Thanks  Wert ... View more

Hi, I require some assistance with CDP -PC CDE cli command. What I am trying to achieve is to run cde jobs via cde cli with the current days date. My command line is - cde job run --name generate_post_view --vcluster-endpoint https://my.cluster.com/dex/api/v1 --user my.user_id Would need assistance on how to pass date argument in this command line so that I don’t have to go to CDE UI and edit the date for running every job. Appreciate any help in this Thanks  ... View more

I was trying to find some documents about where would the location for HS2 & HMS logs be located for CDP-PC on AWS, but could get none the nearest I could get is https://docs.cloudera.com/data-warehouse/cloud/troubleshooting/topics/impala-logs-s3.html. but this is not what I want.  Appreciate any help in this. ... View more

We are seeing an error / alert and unable to schedule / run jobs in CDE. We are on CDP - PC Any guidance  in resolving this  Tks  Wert ... View more

Hello, We have several Data Hub Clusters on CDP - PC, currently conducting health checks manually, which is time consuming and repetitive. Would like to know if there are some automated scripts / ways, we could get this task completed which would give us the health status of nodes, Cloudera services running on them. Any assistance / guidance is appreciated. ... View more

Hello, Is there a way we can monitor long running queries in Impala on  CDP-PC or a dashboard where this can be viewed and if required an alert to be triggered.   Thanks  Wert. ... View more