Member since
05-03-2022
6
Posts
3
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
431 | 02-08-2024 06:35 AM |
06-10-2024
01:34 AM
1 Kudo
Hello. We are running CDP 7.1.7 and we have warning concerning 'Heap Dump Directory Free Space' : This role's Heap Dump Directory is on a filesystem with less than 5.0 GiB of its space free. /tmp (free: 3.7 GiB (94.74%), capacity: 3.9 GiB) Our filesystem is small : Filesystem Size Used Avail Use% Mounted on /dev/mapper/vg_sys-lvtmp 3.9G 8.5M 3.7G 1% /tmp Is it safe to reduce the threshold ? Currently, Warning is set to 5 GiB and Critical is set to 3 GiB . Or is it better / safer to increase /tmp filesystem size ? Because /tmp is also used for storing Event server and Host monitor data and when are also facing free space warning message . Regards
... View more
Labels:
- Labels:
-
Cloudera Data Platform (CDP)
04-23-2024
01:10 AM
1 Kudo
Thank you, guys, for your answers.
... View more
04-15-2024
06:43 AM
Hello. Before deleting rows in a specific table (463,462 rows in table), HDFS file size is : $ hadoop fs -du -s -h /apps/hive/warehouse/prd_thmil.db/th_mil_fb_code_value_brut 54.2 M 162.6 M /apps/hive/warehouse/prd_thmil.db/th_mil_fb_code_value_brut 54.2 Mb is the size of 1 file and each file is replicated 2 times so 162.6 Mb is the total size, it OK. But after deleting more than 450,000 rows in the table (12,890 rows remaining after the DELETE), the file size didn't change at all. Is it normal ? When new rows are added in the table, file size won't grow and HDFS will 'overwrite' older data with the new one ? Regards
... View more
Labels:
- Labels:
-
HDFS
02-08-2024
06:35 AM
Solved : As we are running Cloudera Runtime 7.1.7, DAS is not deprecated so we have to use it : https://docs.cloudera.com/cdp-private-cloud-base/7.1.9/runtime-release-notes/topics/rt-pvc-deprecated-das.html
... View more
02-08-2024
05:39 AM
Hello. We are running Cloudera CDP 7.1.7 and Cloudera Manager 7.4.4 but when we access Hue UI we can only browse Jobs : Do we have to follow links given in the article ? https://docs.cloudera.com/cdp-private-cloud-base/7.1.8/hue-introduction/topics/hue-about-query-processor.html Is it for CDP 7.1.8 and higher ? Because when I look for adding a new service to our cluster, I can add DAS : but Query Processor is not listed : After installing and enabling Query Processor, will we be able to Query information or Timeline like in this article for CDW ? https://docs.cloudera.com/cdw-runtime/1.5.1/using-hue/topics/hue-view-query-information.html https://docs.cloudera.com/cdw-runtime/1.5.1/using-hue/topics/hue-view-query-timeline.html Thanks for your help.
... View more
Labels:
- Labels:
-
Cloudera Data Platform (CDP)
02-08-2024
12:58 AM
1 Kudo
Hello. In Yarn Queue Manager, there is 4 queues defined : but when we submit queries (using Hue or SAS Software to load data), only the default queue is used. And we can go very high : From what we undestand, Default queue is defined for using 20% of the cluster but can use up to 100%, so 70% is normal. But our cluster is 365 GB / 15 vCores and some applications can use more : 7 / 7 / 6 / 5 / 3 vCores in the graph = 28 vCore ! How is it possible ? Thanks for your help
... View more
Labels:
- Labels:
-
Cloudera Data Platform (CDP)