About wert_1311

wert_1311 · ‎08-07-2024

I have a requirement to gather run duration (time) for the last 3 months, for a particular airflow job. In our CDE environment we use airflow to call spark DBT jobs, of late the run duration of job have increased drastically. I assume there would be a way to gather this jobs runtime duration for further analysis etc. Hoping for some assistance / guidance in getting his done. CDE Version - 1.19.3-b29 Thanks Wert

wert_1311 · ‎05-24-2024

Hi, I am in need for some sort of alerting mechanism to monitor long running CDE jobs, basically we use Airflow to call /run Spark DBT jobs I am looking if there is a way to monitor / alert if any jobs cross certain threshold time limit. Would appreciate if anyone has implemented it / guide in this direction. Thanks Wert

wert_1311 · ‎02-01-2024

Hi, I require some assistance with CDP -PC CDE cli command. What I am trying to achieve is to run cde jobs via cde cli with the current days date. My command line is - cde job run --name generate_post_view --vcluster-endpoint https://my.cluster.com/dex/api/v1 --user my.user_id Would need assistance on how to pass date argument in this command line so that I don’t have to go to CDE UI and edit the date for running every job. Appreciate any help in this Thanks

wert_1311 · ‎12-27-2023

Hi @smruti I am looking in Data Warehouse> Virtual Warehouse (CDP- PC)and under configuration I am unable to get the path, unsure if I am looking at the right place

wert_1311 · ‎12-13-2023

I am facing with an issue with Atlas UI, I am trying to get a list of 'Not Classified' Items from hive_table it returns with a list, however when I try to increase the 'Page Limit' to around 2000 items the page goes blank and it tries to reload which it never succeeds. The initial search is also slow. CDP - PC (CM - 7.9 / RUNTIME VERSION - 7.2.16-1.cdh7.2.16.p0.36344516) Appreciate any help / guidance in resolving this issue. Thanks

wert_1311 · ‎11-17-2023

Hello, We have been receiving Solar error : The health test result for SOLR_SERVER_WEB_METRIC_COLLECTION has become concerning: The web server of this role is responding with metrics. The most recent collection took 38.2 second(s). Warning threshold: 10 second(s). The health test result for SOLR_CORE_STATUS_COLLECTION_HEALTH has become good: This Solr Server is responding to simple HTTP API requests. The most recent request took 27 millisecond(s). Have checked solar logs, but could not find any error related items, any help / guidance in resolving / pointing the right approach to fix is appreciated. CDP - PC (CM VERSION - 7.9.0 / RUNTIME VERSION - 7.2.x) Thanks Wert

wert_1311 · ‎11-16-2023

Hello All, Some of our CDE Jobs are unable to run and we see error - ERROR could not get run from storage, will no longer check run for preparation cancelation: %!w(*fmt.wrapError=&{could not get run from storage: context canceled 0xc00010e0d0}) Appreciate any help on this

wert_1311 · ‎11-16-2023

I was trying to find some documents about where would the location for HS2 & HMS logs be located for CDP-PC on AWS, but could get none the nearest I could get is https://docs.cloudera.com/data-warehouse/cloud/troubleshooting/topics/impala-logs-s3.html. but this is not what I want. Appreciate any help in this.

wert_1311 · ‎10-09-2023

We are seeing an error / alert and unable to schedule / run jobs in CDE. We are on CDP - PC Any guidance in resolving this Tks Wert

wert_1311 · ‎10-04-2023

Hello, We have several Data Hub Clusters on CDP - PC, currently conducting health checks manually, which is time consuming and repetitive. Would like to know if there are some automated scripts / ways, we could get this task completed which would give us the health status of nodes, Cloudera services running on them. Any assistance / guidance is appreciated.

Online	Offline
Last Visited	‎01-17-2025 08:00 AM

Member Since	‎09-25-2018 02:43 AM
Last Visited	‎01-17-2025 08:00 AM
Posts	99
Kudos received	6

Cloudera Community

Re: Impala Error updating the catalog due to lock ...

Re: Question regarding dns entries

Re: Event Server storage

Re: Hue Error

Re: Swap Memory Alerts

Capture airflow run duration

Monitor / alert long running Airflow jobs.

CDE CLI Date argument

Re: HS2 & Hive Metastore logs on CDP PC

Atlas Search Issue

Solr Web Metric Error

Error while running CDE jobs

HS2 & Hive Metastore logs on CDP PC

Airflow scheduler does not appear to be running.

Health Checks for Data Hub Clusters