Cloudera Community
wert_1311
user rank
Expert Contributor
My Accepted Solutions
Show All

Re: HS2 & Hive Metastore logs on CDP PC

by Master Collaborator Master Collaborator in Support Questions
‎12-27-2023 06:53 AM
1 Kudo
‎12-27-2023 06:53 AM
1 Kudo
@wert_1311 It should be in the following location in S3: s3://<s3_bucket_name>/clusters/<environment_id>/<database_catalog_id>/warehouse/tablespace/external/hive/sys.db/logs/dt=YYYY-MM-DD/ns=<virtual_warehouse_id>/ Hiveserver2 log directory will be named app=hiveserver2/ You could also view hiveserver2 pod logs using kubectl: e.g. kubectl logs hiveserver2-0 -n compute-1584641610-f14f -c hiveserver2 ... View more

Error while running CDE jobs

by Expert Contributor in Support Questions
‎11-16-2023 03:42 AM
‎11-16-2023 03:42 AM
Hello All, Some of our CDE Jobs are unable to run and we see error - ERROR could not get run from storage, will no longer check run for preparation cancelation: %!w(*fmt.wrapError=&{could not get run from storage: context canceled 0xc00010e0d0}) Appreciate  any help on this ... View more

Re: Health Checks for Data Hub Clusters

by Expert Contributor Expert Contributor in Support Questions
‎10-06-2023 06:36 AM
1 Kudo
‎10-06-2023 06:36 AM
1 Kudo
You can check this CDP API references docs . https://docs.cloudera.com/cdp-public-cloud/cloud/api/topics/mc-api-overview.html#mc-api-overview Specific to Datahub :  https://cloudera.github.io/cdp-dev-docs/api-docs/datahub/index.html#_healthcheck If this answers your query, please accept this post as Solution.  ... View more

Prometheus alert

by Expert Contributor in Support Questions
‎08-24-2023 02:46 AM
‎08-24-2023 02:46 AM
Hello, I am very new to CDP PC, on one of our flows  in Cloudera Data Flow, we see  alert 'Prometheus is approaching its memory limit'. Would like to understand why this occurs and what could be done to resolve this alert.   TIA   ... View more

Re: Connection to Kubernetes pods

by Expert Contributor in Support Questions
‎06-20-2023 08:21 AM
1 Kudo
‎06-20-2023 08:21 AM
1 Kudo
@steven-matison    Thanks for link ... View more

Re: Unable to register environment

by Guru in Support Questions
‎06-13-2023 06:55 AM
1 Kudo
‎06-13-2023 06:55 AM
1 Kudo
@wert_1311 Your error indicates that two of your roles are missing or incomplete.   1. Data Access Role (arn:aws:iam::8859X2XX911XX:role/Cloudera-datalake-admin-role) is not set up correctly. Please follow the official documentation on required policies for Data Access Role. Missing policies (chunked): arn:aws:iam::8859X2XX911XX:role/Cloudera-datalake-admin-role:s3:AbortMultipartUpload:arn:aws:s3:::cdp-my-bucket/hive_replica_functions_dir/* 2. Data Access Role (arn:aws:iam::8859X2XX911XX:role/Cloudera-ranger-audit-role) is not set up correctly. Please follow the official documentation on required policies for Data Access Role. Missing policies (chunked): arn:aws:iam::8859X2XX911XX:role/Cloudera-ranger-audit-role:s3:PutObject:arn:aws:s3:::cdp-my-bucket/ranger/audit/* Go back to the quickstart and docs, and make sure completd all the setups.  Here is a link with more about the credentials   https://docs.cloudera.com/cdp-public-cloud/cloud/requirements-aws/topics/mc-aws-req-credential.html   There are steps in the page above describing the 2 roles which have conflicts in your error.  The error indicates, in the end of each message, which policies are missing.     ... View more

Re: Data not inserting in hive table (CDP)

by Expert Contributor in Support Questions
‎12-27-2022 07:51 AM
2 Kudos
‎12-27-2022 07:51 AM
2 Kudos
@asish Thanks!!! that worked. ... View more

Re: Error while activating parcels

by New Contributor in Support Questions
‎10-31-2022 05:45 PM
‎10-31-2022 05:45 PM
This is not working for me. [31/Oct/2022 17:39:51 -0700] 336377 WorkerThread downloader ERROR Failed op: Src file /opt/cloudera/parcels/.flood/CDH-7.1.8-1.cdh7.1.8.p0.30990532-el8.parcel/CDH-7.1.8-1.cdh7.1.8.p0.30990532-el8.parcel does not exist Traceback (most recent call last): File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/downloader.py", line 502, in callable callback(url, curr_op) File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/parcel_cache.py", line 200, in cb This is the error i see in logs ... View more

Re: Impalad Frontend Connections

by Master Collaborator Master Collaborator in Support Questions
‎05-31-2022 03:22 AM
‎05-31-2022 03:22 AM
Hi @wert_1311    It shows the number of impalad connections are hitting the limit.   You can check on these below points:   1. you can increase the value of "Impala Daemon Max Client Connections" property in the impala configs if really more number of connections are coming. 2. If you think the connections are less but the opened connections are not closing properly and causing the issue you can check the timeouts has been set properly in the Hue safety-valve advance configs.   -idle_session_timeout=3600 -idle_query_timeout=3600      Regards, Chethan YM ... View more

Re: Hue Runcpserver Log Empty

by Master Guru Master Guru in Support Questions
‎03-02-2022 08:40 PM
2 Kudos
‎03-02-2022 08:40 PM
2 Kudos
@wert_1311 No downtime needed. Only agent CM agent restart on Hue servers may required if you see the alternative not taking effect. ... View more
Contact Me
Online
Offline
Last Visited
‎01-17-2025 08:00 AM
Community Statistics
Member Since ‎09-25-2018 02:43 AM
Last Visited ‎01-17-2025 08:00 AM
Posts 99
Kudos received 6