I got installed a new cloudera cluster with versions CM-6.3.1 and CDH-6.3.2 and now facing a problem never had with previous cloudera distributions. Cloudera Management Services (including Cloudera Service Monitor), Impala (Sentry Enabled), and all other related processes are working fine. Individual users are able to authenticate with LDAP and can query tables to which they are authorized. The problem is, the queries sent and executed to impala daemons do not appear in the Impala Queries tab in Cloudera Manager, although they can be observed in Completed Impala Queries chart, that is, there are changes in the queries/second metric when someone send a query, i checked the things discussed in the link below. https://community.cloudera.com/t5/Support-Questions/Empty-Impala-queries-in-Cloudera-Manager/td-p/79812 No troubles in either /var/log/cloudera-scm-firehose/mgmt-cmf-mgmt-SERVICEMONITOR-hostname.log.out or / var/log/cloudera-scm-server/cloudera-scm-server.log logs. There is enough disk space in the Service Monitor Storage Directory. And tried to set to different sizes from 1GB to 3GB Impala Storage (firehose_impala_storage_bytes) Everything seems fine, yet there are no queries in the Cloudera Manager Impala Queries Web-UI. What might be the cause of this situation? Any help would be highly appreciated, Thanks.
... View more
I recently upgraded my Cloudera environment from 5.8.x (hadoop 2.6.0, hdfs-1) to 6.3.x (hadoop 3.0.0, hdfs-1) and after some days of data loads with moveFromLocal, i just realized that the DFS Used% of datanode server on which i execute moveFromLocal are 3x more than that of others.
Then having run fsck with -blocks, -locations and -replicaDetails flags over the hdfs path to which i load the data; i observed that replicated blocks (RF=2) are all on that same server and not being distributed to other nodes unless i manually run hdfs balancer.
There was no such a problem in the Cloudera 5.8.x. Is there some new configuration should i make in Cloudera 6.3.x related to replication, rack awareness or something like that?
Any help would be highly appreciated.
... View more