Hello, We are able to login to Hue UI locally with default user name / password, the issue arises when choosing AD Authentication it does not accept the username / password.   Error in Hue Access log [25/Nov/2022 14:00:29 -0800] DEBUG Initiating TLS [25/Nov/2022 14:00:29 -0800] DEBUG search_s('DC=mtest,DC=com', 2, '(&(sAMAccountName=%(user)s)(sAMAccountName={0}))') returned 0 objects: [25/Nov/2022 14:00:29 -0800] DEBUG Authentication failed for User1_dev: failed to map the username to a DN. [25/Nov/2022 14:00:29 -0800] WARNING 10.216.176.10 -anon- - "POST /hue/accounts/login HTTP/1.1" --- Failed login for user: User1_dev [25/Nov/2022 14:00:29 -0800] INFO 10.216.176.10 -anon- - "POST /hue/accounts/login HTTP/1.1" returned in 1062ms 200 114908 [25/Nov/2022 14:00:40 -0800] DEBUG 10.216.176.10 -anon- - "POST /hue/accounts/login HTTP/1.1" - Error in Runcpserver.log [25/Nov/2022 14:43:01 -0800] resource ERROR Error logging return call POST http://localhost:7187/api/v9 Traceback (most recent call last): File "/opt/cloudera/parcels/CDH-7.1.7-1.cdh7.1.7.p1000.24102687/lib/hue/desktop/core/src/desktop/lib/rest/resource.py", line 122, in _invoke resp_content = smart_unicode(resp.content, errors='replace') AttributeError: 'NoneType' object has no attribute 'content' [25/Nov/2022 14:43:01 -0800] navigator_client ERROR Failed to search for entities with search query: {"query": "((originalName:**^3)OR(originalDescription:**^1)OR(name:**^10)OR(description:**^3)OR(tags:**^5))AND((originalName:[* TO *])OR(originalDescription:[* TO *])OR(name:[* TO *])OR(description:[* TO *])OR(tags:[* TO *]))", "filterQueries": ["deleted:false"], "facetFields": ["tags"]} [25/Nov/2022 14:43:01 -0800] access INFO 10.216.176.10 admin - "POST /metadata/api/catalog/list_tags HTTP/1.1" returned in 43ms 500 308 [25/Nov/2022 14:43:01 -0800] access INFO 10.216.176.10 admin - "GET /desktop/api2/context/clusters/jobs HTTP/1.1" returned in 4ms 200 225 [25/Nov/2022 14:43:01 -0800] access INFO 10.216.176.10 admin - "GET /desktop/api2/context/namespaces/hive HTTP/1.1" returned in 215ms 200 287 [25/Nov/2022 14:43:01 -0800] access INFO 10.216.176.10 admin - "GET /desktop/api2/context/computes/impala HTTP/1.1" returned in 135ms 200 230 [25/Nov/2022 14:43:01 -0800] access INFO 10.216.176.10 admin - "GET /editor HTTP/1.1" returned in 266ms 200 127305 [25/Nov/2022 14:43:03 -0800] access INFO 10.216.176.10 admin - "POST /notebook/api/create_notebook HTTP/1.1" returned in 2ms 200 243 [25/Nov/2022 14:43:03 -0800] access INFO 10.216.176.10 admin - "GET /desktop/api2/user_preferences/default_app HTTP/1.1" returned in 2ms 200 27 [25/Nov/2022 14:43:03 -0800] access INFO 10.216.176.10 admin - "GET /notebook/api/get_history HTTP/1.1" returned in 9ms 200 70 [25/Nov/2022 14:43:03 -0800] access INFO 10.216.176.10 admin - "GET /desktop/workers/aceSqlSyntaxWorker.js HTTP/1.1" returned in 8ms 200 196 [25/Nov/2022 14:43:03 -0800] access INFO 10.216.176.10 admin - "POST /jobbrowser/jobs/ HTTP/1.1" returned in 8ms 200 12 [25/Nov/2022 14:43:03 -0800] access INFO 10.216.176.10 admin - "GET /desktop/workers/aceSqlLocationWorker.js HTTP/1.1" returned in 19ms 200 200 [25/Nov/2022 14:43:03 -0800] access INFO 10.216.176.10 admin - "POST /notebook/api/create_session HTTP/1.1" returned in 111ms 200 1113 [25/Nov/2022 14:43:03 -0800] navigator_client INFO (('query', 'parentPath:"/default" AND type:(table view field)'), ('offset', 0), ('limit', 450)) [25/Nov/2022 14:43:03 -0800] resource ERROR Error logging return call GET http://localhost:7187/api/v9 Traceback (most recent call last): File "/opt/cloudera/parcels/CDH-7.1.7-1.cdh7.1.7.p1000.24102687/lib/hue/desktop/core/src/desktop/lib/rest/resource.py", line 122, in _invoke resp_content = smart_unicode(resp.content, errors='replace') AttributeError: 'NoneType' object has no attribute 'content' [25/Nov/2022 14:43:03 -0800] navigator_client ERROR Failed to search for entities with search query: parentPath:"/default" AND type:(table view field) [25/Nov/2022 14:43:03 -0800] access INFO 10.216.176.10 admin - "POST /desktop/api/search/entities HTTP/1.1" returned in 36ms 500 366 [25/Nov/2022 14:43:03 -0800] access INFO 10.216.176.10 admin - "GET /desktop/api2/docs/ HTTP/1.1" returned in 25ms 200 116 [25/Nov/2022 14:43:03 -0800] access INFO 10.216.176.10 admin - "GET /desktop/api2/context/computes/hive HTTP/1.1" returned in 124ms 200 226 [25/Nov/2022 14:43:04 -0800] access INFO 10.216.176.10 admin - "GET /dynamic_bundle/workers/vendors~calcite-parser~druid-parser~elasticsearch-parser~flink-parser~generic-par~a12e5353-chunk-9e88fe32881dac37fa21.js HTTP/1.1" returned in 3ms 302 0 [25/Nov/2022 14:43:04 -0800] access INFO 10.216.176.10 admin - "GET /dynamic_bundle/workers/calcite-parser~druid-parser~elasticsearch-parser~flink-parser~generic-parser~hive~fd963363-chunk-9e88fe32881dac37fa21.js HTTP/1.1" returned in 4ms 302 0 [25/Nov/2022 14:43:04 -0800] access INFO 10.216.176.10 admin - "GET /dynamic_bundle/workers/hive-parser-chunk-9e88fe32881dac37fa21.js HTTP/1.1" returned in 12ms 302 0 [25/Nov/2022 14:43:04 -0800] access INFO 10.216.176.10 admin - "GET /dynamic_bundle/workers/vendors~calcite-parser~druid-parser~elasticsearch-parser~flink-parser~generic-par~a12e5353-chunk-9e88fe32881dac37fa21.js HTTP/1.1" returned in 1ms 302 0 [25/Nov/2022 14:43:04 -0800] access INFO 10.216.176.10 admin - "GET /dynamic_bundle/workers/calcite-parser~druid-parser~elasticsearch-parser~flink-parser~generic-parser~hive~fd963363-chunk-9e88fe32881dac37fa21.js HTTP/1.1" returned in 2ms 302 0 [25/Nov/2022 14:43:04 -0800] access INFO 10.216.176.10 admin - "GET /dynamic_bundle/workers/hive-parser-chunk-9e88fe32881dac37fa21.js HTTP/1.1" returned in 1ms 302 0 [25/Nov/2022 14:43:10 -0800] views WARNING Error closing impala session: Snippet type impala is not configured. [25/Nov/2022 14:43:10 -0800] access INFO 10.216.176.10 -anon- - "GET /accounts/logout HTTP/1.1" returned in 58ms 302 0 [25/Nov/2022 14:43:10 -0800] middleware INFO Redirecting to login page: / [25/Nov/2022 14:43:10 -0800] access INFO 10.216.176.10 -anon- - "GET / HTTP/1.1" --- login redirection [25/Nov/2022 14:43:10 -0800] access INFO 10.216.176.10 -anon- - "GET / HTTP/1.1" returned in 9ms 302 0 [25/Nov/2022 14:43:10 -0800] access INFO 10.216.176.10 admin - "POST /notebook/api/notebook/close HTTP/1.1" returned in 129ms 200 44 [25/Nov/2022 14:43:10 -0800] decorators INFO AXES: Calling decorated function: dt_login [25/Nov/2022 14:43:10 -0800] access INFO 10.216.176.10 -anon- - "GET /hue/accounts/login HTTP/1.1" returned in 49ms 200 114859 [25/Nov/2022 14:43:11 -0800] access INFO 127.0.0.1 -anon- - "HEAD /desktop/debug/is_alive HTTP/1.1" returned in 16ms 200 0 [25/Nov/2022 14:43:33 -0800] decorators INFO AXES: Calling decorated function: dt_login [25/Nov/2022 14:43:34 -0800] access WARNING 10.216.176.10 -anon- - "POST /hue/accounts/login HTTP/1.1" --- Failed login for user: USER1_dev [25/Nov/2022 14:43:34 -0800] decorators INFO AXES: Repeated login failure by 127.0.0.1. Updating access record. Count = 25 [25/Nov/2022 14:43:34 -0800] access INFO 10.216.176.10 -anon- - "POST /hue/accounts/login HTTP/1.1" returned in 1086ms 200 114908 [25/Nov/2022 14:43:45 -0800] decorators INFO AXES: Calling decorated function: dt_login   Also would like to understand is it mandatory to have unix server also domain joined on which hue is deployed for AD Authentication to work?   Appreciate all the help   Thanks  ... View more

Hello,   I am unable to launch Yarn Queue Manager Web UI and get error - Failed to load the Yarn Queue Manager UI. Reload the UI after fixing the issue. Reason - No active RM Found.   We have 2 RM (Active/ Standby) yet facing this error.    Reques any help / guidance to resolve this.   CM 7.6.1 Cloudera Runtime - 7.1.7 ... View more

Hello, We are observing Impala CatalogException: Error refreshing metadata for table due to lock contention errors on our Cluster. Came across this article - https://community.cloudera.com/t5/Support-Questions/Impala-Error-updating-the-catalog-due-to-lock-contention/td-p/329310 upon checking the suggestions made by Cloudera Tech - load_catalog_in_background is already unchecked nor do we find any error for JVM Pause in Catalogue Logs Java Heap Size of Catalog Server in Bytes = 28G CDH 6.3.3 Would appreciate any help in understanding why this happens and ways to fix this. ... View more

Hello,   Does Cloudera 6.3.3 (CM/CDH) support Oracle 19c ?   ... View more

Hi,   I am getting error when I run kudu ksck command   Errors: ================== Corruption: master consensus error: there are master consensus conflicts FAILED Runtime error: ksck discovered errors   All 3 Masters & Tablet server are reported as healthy, Any assistance / pointer in fixing this error.   Thanks    ... View more

Hello, We are seeing a few Impala queries running for more than 3 hours in Impala. Upon checking we found that the query is in exception state however on the Cloudera Impala GUI it still showing it as running. Would like to know if there is a way to kill such type of queries at Impala level. We have implemented Impala ACL and set the Queue Timeout to 5 minutes yet some queries keep running. Our applications connect to Impala via JDBC and we also have some users who use Hue to run queries.   Any assistance/guidance is much appreciated.   ... View more

Hello, We are observing our Impala Catalogue Server’s process frequently gets exited / killed (This role encountered 1 unexpected exit(s) in the previous 5 minute(s).This included 1 exit(s) due to OutOfMemory errors. Critical threshold: any.) I was going through this article (https://community.cloudera.com/t5/Support-Questions/Cloudera-6-2-1-Impala-GC-Overhead-limit-Exceeded/td-p/293225) it seems to be Heap Memory related, would like to know if there is any way / calculations to find how much Heap should be allocated to avoid these issues.   CM / CDH 5.16.2 Java Heap Size of Catalog Server in Bytes = 15Gb   Appreciate any guidance in this regard. ... View more

Hello,   Is there a way to find which kudu table is stored in which tablet server ?   Thanks  Amn ... View more

Hello, I am getting the below error when trying to check logs via CM for Hue Kerberos Ticket Renewer.     CM / CDH - 6.3.3 I checked / /var/log/hue but did not find kt_renewer.log. Appreciate any assistance to fix this.   Thanks Amn ... View more

Hello, I need some assistance / guidance related to Impala Audit & Lineage Logs. In our cluster I  see Impala Audit Logs (enable_audit_event_log) Un-checked, yet on the node level we see logs getting generated. [service1@myserver audit]# ls -ltrh total 215M -rw-r--r-- 1 impala impala 4.2M May 27 14:45 impala_audit_event_log_1.0-1622078304372 -rw-r--r-- 1 impala impala 3.9M May 27 15:34 impala_audit_event_log_1.0-1622083537006 -rw-r--r-- 1 impala impala 4.3M May 27 16:44 impala_audit_event_log_1.0-1622086468134 -rw-r--r-- 1 impala impala 4.3M May 27 17:18 impala_audit_event_log_1.0-1622090691805 -rw-r--r-- 1 impala impala 4.3M May 27 18:26 impala_audit_event_log_1.0-1622092726630 -rw-r--r-- 1 impala impala 4.2M May 27 20:07 impala_audit_event_log_1.0-1622096799288 -rw-r--r-- 1 impala impala 4.0M May 27 21:17 impala_audit_event_log_1.0-1622102850640 -rw-r--r-- 1 impala impala 3.7M May 28 01:36 impala_audit_event_log_1.0-1622107032783 -rw-r--r-- 1 impala impala 2.7M May 28 14:34 impala_audit_event_log_1.0-1622122581046 -rw-r--r-- 1 impala impala 4.7M May 28 18:17 impala_audit_event_log_1.0-1622169268919 -rw-r--r-- 1 impala impala 4.3M May 28 19:34 impala_audit_event_log_1.0-1622182634220 -rw-r--r-- 1 impala impala 4.3M May 28 20:30 impala_audit_event_log_1.0-1622187283341 -rw-r--r-- 1 impala impala 4.3M May 28 20:58 impala_audit_event_log_1.0-1622190632083 -rw-r--r-- 1 impala impala 4.4M May 28 21:25 impala_audit_event_log_1.0-1622192312991   Could anyone please share some light as to why this is happening? I was under the impression that if this is checked only then logs would get captured, kindly clarify CM / CDH – 6.3.3   Thanks  Amn ... View more

Hello, I was trying to take report from HDFS Report and get the below message Upon checking /var/log/cloudera-scm-headlamp and see the following error    021-04-15 18:09:44,934 ERROR com.cloudera.headlamp.HeadlampIndexManager: Index build failed for service hdfs java.util.concurrent.ExecutionException: java.lang.RuntimeException: java.lang.RuntimeException: java.io.IOException: Unsupported layout version -64 at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:192) at com.cloudera.headlamp.AbstractIndexBuilder.buildIndex(AbstractIndexBuilder.java:80) at com.cloudera.headlamp.HeadlampIndex.buildIndex(HeadlampIndex.java:257) at com.cloudera.headlamp.HeadlampIndex.reindex(HeadlampIndex.java:325) at com.cloudera.headlamp.HeadlampIndexManager.reindexIndexes(HeadlampIndexManager.java:240) at com.cloudera.headlamp.HeadlampIndexManager.access$100(HeadlampIndexManager.java:57) at com.cloudera.headlamp.HeadlampIndexManager$1.run(HeadlampIndexManager.java:494) Caused by: java.lang.RuntimeException: java.lang.RuntimeException: java.io.IOException: Unsupported layout version -64 at com.cloudera.headlamp.AbstractIndexBuilder$1.run(AbstractIndexBuilder.java:74) at com.cloudera.cmf.cdhclient.CdhExecutor$RunnableWrapper.call(CdhExecutor.java:221) at com.cloudera.cmf.cdhclient.CdhExecutor$RunnableWrapper.call(CdhExecutor.java:211) at com.cloudera.cmf.cdhclient.CdhExecutor$CallableWrapper.doWork(CdhExecutor.java:236) at com.cloudera.cmf.cdhclient.CdhExecutor$1.call(CdhExecutor.java:125) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.RuntimeException: java.io.IOException: Unsupported layout version -64 at com.cloudera.headlamp.IndexBuilderCDH.buildIndexImpl(IndexBuilderCDH.java:77) at com.cloudera.headlamp.AbstractIndexBuilder$1.run(AbstractIndexBuilder.java:72) ... 8 more Caused by: java.io.IOException: Unsupported layout version -64 at org.apache.hadoop.hdfs.server.namenode.FSImageUtil.loadSummary(FSImageUtil.java:75) at org.apache.hadoop.hdfs.tools.offlineImageViewer.CdhClientPBImageViewer.go(CdhClientPBImageViewer.java:113) at com.cloudera.headlamp.IndexBuilderCDH.buildIndexImpl(IndexBuilderCDH.java:70) ... 9 more     CM / CDH - 6.3.3 Appreciate any help / guidance in fixing this issue .   Thanks  Amn ... View more

Hello, Need some assistance / guidance on how we can reduce Non-HDFS Space. We see Non-HDFS Space of around 270 used, as we are facing space crunch, we would explore possibilities for getting non-hdfs space reduced. I have cleared all Yarn logs for the applications which were killed/ failed etc (our /data mountpoint houses dfs, yarn, kudu, impala), yet this does not solve our issue. Any assistance / guidance is much appreciated.   Thanks  Amn ... View more

Hello, We are getting alerts for Block Count on one of our data nodes as it has crossed the threshold of 10000. Since HDFS balancer did not fix the issue, the next thing I turned my focus to see if we are hitting small files issue. I was trying to put up a report via terminal script ( hdfs dfs -ls -R /tmp |grep ^- |awk '{if ($5 < 134217728) print $5, $8;}'| head -5 | column –t) but when I compare the result from the script output vs HDFS Report from Cloudera Manager I see a difference in the size of the same file.   Could anyone provide any guidance / assistance on this, or am I doing something wrong.   Thanks Amn ... View more