Member since
02-18-2019
83
Posts
3
Kudos Received
0
Solutions
08-19-2021
12:35 AM
Hello, We are observing our Impala Catalogue Server’s process frequently gets exited / killed (This role encountered 1 unexpected exit(s) in the previous 5 minute(s).This included 1 exit(s) due to OutOfMemory errors. Critical threshold: any.) I was going through this article (https://community.cloudera.com/t5/Support-Questions/Cloudera-6-2-1-Impala-GC-Overhead-limit-Exceeded/td-p/293225) it seems to be Heap Memory related, would like to know if there is any way / calculations to find how much Heap should be allocated to avoid these issues. CM / CDH 5.16.2 Java Heap Size of Catalog Server in Bytes = 15Gb Appreciate any guidance in this regard.
... View more
Labels:
07-15-2021
01:49 AM
Hello, Is there a way to find which kudu table is stored in which tablet server ? Thanks Amn
... View more
Labels:
06-16-2021
12:22 AM
Hi @salimhussain Enable Impala Audit Event Generation property was already unchecked, for patching activity we had to bring down the cluster and start it back, so I hope that this counts as a restart of Impala too? If it does, then we still have logs getting generated. Thanks Amn
... View more
06-05-2021
02:38 AM
Hello @Sean464 Hue is already installed kt renewer service is also running fine/green. We noticed this post our upgrade from 5.16.x to 6.3.x So can I follow the steps mentioned by @nthomas? Thanks Amn
... View more
06-01-2021
08:47 PM
Hello, I am getting the below error when trying to check logs via CM for Hue Kerberos Ticket Renewer. CM / CDH - 6.3.3 I checked / /var/log/hue but did not find kt_renewer.log. Appreciate any assistance to fix this. Thanks Amn
... View more
05-31-2021
12:55 AM
Hello, I need some assistance / guidance related to Impala Audit & Lineage Logs. In our cluster I see Impala Audit Logs (enable_audit_event_log) Un-checked, yet on the node level we see logs getting generated. [service1@myserver audit]# ls -ltrh
total 215M
-rw-r--r-- 1 impala impala 4.2M May 27 14:45 impala_audit_event_log_1.0-1622078304372
-rw-r--r-- 1 impala impala 3.9M May 27 15:34 impala_audit_event_log_1.0-1622083537006
-rw-r--r-- 1 impala impala 4.3M May 27 16:44 impala_audit_event_log_1.0-1622086468134
-rw-r--r-- 1 impala impala 4.3M May 27 17:18 impala_audit_event_log_1.0-1622090691805
-rw-r--r-- 1 impala impala 4.3M May 27 18:26 impala_audit_event_log_1.0-1622092726630
-rw-r--r-- 1 impala impala 4.2M May 27 20:07 impala_audit_event_log_1.0-1622096799288
-rw-r--r-- 1 impala impala 4.0M May 27 21:17 impala_audit_event_log_1.0-1622102850640
-rw-r--r-- 1 impala impala 3.7M May 28 01:36 impala_audit_event_log_1.0-1622107032783
-rw-r--r-- 1 impala impala 2.7M May 28 14:34 impala_audit_event_log_1.0-1622122581046
-rw-r--r-- 1 impala impala 4.7M May 28 18:17 impala_audit_event_log_1.0-1622169268919
-rw-r--r-- 1 impala impala 4.3M May 28 19:34 impala_audit_event_log_1.0-1622182634220
-rw-r--r-- 1 impala impala 4.3M May 28 20:30 impala_audit_event_log_1.0-1622187283341
-rw-r--r-- 1 impala impala 4.3M May 28 20:58 impala_audit_event_log_1.0-1622190632083
-rw-r--r-- 1 impala impala 4.4M May 28 21:25 impala_audit_event_log_1.0-1622192312991 Could anyone please share some light as to why this is happening? I was under the impression that if this is checked only then logs would get captured, kindly clarify CM / CDH – 6.3.3 Thanks Amn
... View more
Labels:
05-02-2021
07:45 PM
Hi @amk Hi, When I go to /var/lib/cloudera-scm-headlamp/hdfs/ I see the below listed : [nm1@myserver hdfs]# ls -ltr -rw-r----- 1 cloudera-scm cloudera-scm 710967007 Jan 29 23:35 fsimage -rw-r----- 1 cloudera-scm cloudera-scm 25680 Jan 29 23:44 aggregates drwxr-x--- 2 cloudera-scm cloudera-scm 8192 Jan 29 23:44 index -rw-r----- 1 cloudera-scm cloudera-scm 468901714 May 3 14:26 fsimage.tmp Are you suggesting that I move everything that is inside hdfs folder to tmp location that then start Rman server? Kindly confirm. Thanks Amn
... View more
04-15-2021
12:20 AM
Hello, I was trying to take report from HDFS Report and get the below message Upon checking /var/log/cloudera-scm-headlamp and see the following error 021-04-15 18:09:44,934 ERROR com.cloudera.headlamp.HeadlampIndexManager: Index build failed for service hdfs
java.util.concurrent.ExecutionException: java.lang.RuntimeException: java.lang.RuntimeException: java.io.IOException: Unsupported layout version -64
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:192)
at com.cloudera.headlamp.AbstractIndexBuilder.buildIndex(AbstractIndexBuilder.java:80)
at com.cloudera.headlamp.HeadlampIndex.buildIndex(HeadlampIndex.java:257)
at com.cloudera.headlamp.HeadlampIndex.reindex(HeadlampIndex.java:325)
at com.cloudera.headlamp.HeadlampIndexManager.reindexIndexes(HeadlampIndexManager.java:240)
at com.cloudera.headlamp.HeadlampIndexManager.access$100(HeadlampIndexManager.java:57)
at com.cloudera.headlamp.HeadlampIndexManager$1.run(HeadlampIndexManager.java:494)
Caused by: java.lang.RuntimeException: java.lang.RuntimeException: java.io.IOException: Unsupported layout version -64
at com.cloudera.headlamp.AbstractIndexBuilder$1.run(AbstractIndexBuilder.java:74)
at com.cloudera.cmf.cdhclient.CdhExecutor$RunnableWrapper.call(CdhExecutor.java:221)
at com.cloudera.cmf.cdhclient.CdhExecutor$RunnableWrapper.call(CdhExecutor.java:211)
at com.cloudera.cmf.cdhclient.CdhExecutor$CallableWrapper.doWork(CdhExecutor.java:236)
at com.cloudera.cmf.cdhclient.CdhExecutor$1.call(CdhExecutor.java:125)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: java.io.IOException: Unsupported layout version -64
at com.cloudera.headlamp.IndexBuilderCDH.buildIndexImpl(IndexBuilderCDH.java:77)
at com.cloudera.headlamp.AbstractIndexBuilder$1.run(AbstractIndexBuilder.java:72)
... 8 more
Caused by: java.io.IOException: Unsupported layout version -64
at org.apache.hadoop.hdfs.server.namenode.FSImageUtil.loadSummary(FSImageUtil.java:75)
at org.apache.hadoop.hdfs.tools.offlineImageViewer.CdhClientPBImageViewer.go(CdhClientPBImageViewer.java:113)
at com.cloudera.headlamp.IndexBuilderCDH.buildIndexImpl(IndexBuilderCDH.java:70)
... 9 more CM / CDH - 6.3.3 Appreciate any help / guidance in fixing this issue . Thanks Amn
... View more
Labels: