About snm1523

snm1523 · ‎05-14-2021

@tusharkathpal , got hit to another issue, working on that. Will revert with these results by Monday.

snm1523 · ‎05-14-2021

Hello @vidanimegh, We are not changing any permissions to users (including me) on default DB. They are just default (whatever they get once created). We are managing permissions using Sentry on each DB that is created. We have verified permissions are all okay in Sentry as users (including me) are able to see / query tables in Impala via Hue but not in Hive. Thanks snm1523

snm1523 · ‎05-14-2021

Hello @tusharkathpal, Thank you for the reply. Have verified all the users are in correct groups and same on all nodes. Please suggest what can be checked further. Thanks snm1523

snm1523 · ‎05-10-2021

Any suggestions please?

snm1523 · ‎03-24-2021

Hello @Bandit , Have sent you an email. Thanks snm1523

snm1523 · ‎03-23-2021

Hello All, We have a around 22 databases and their respective tables which are accessible via Impala in Hue, but not via Hive for 3 newly added users. We get below error which is related to permissions to databases via Sentry, however, this looks strange to me since the permissions are managed at DB level and not specific to service. So if permissions are not correct, we should not have been able to access them via Impala as well. Error message: Error while compiling statement: FAILED: SemanticException No valid privileges User xxxxxx does not have privileges for SWITCHDATABASE The required privileges: Server=server1->Db=*->Table=+->Column=*->action=select->grantOption=false;Server=server1->Db=*->Table=+->Column=*->action=insert->grantOption=false;Server=server1->Db=*->Table=+->Column=*->action=alter->grantOption=false;Server=server1->Db=*->Table=+->Column=*->action=create->grantOption=false;Server=server1->Db=*->Table=+->Column=*->action=drop->grantOption=false;Server=server1->Db=*->Table=+->Column=*->action=index->grantOption=false;Server=server1->Db=*->Table=+->Column=*->action=lock->grantOption=false; Query that works fine in Impala but not Hive: select * from dbname.tablename limit 5; Please suggest what can be checked / done to fix this. Thanks snm1523

snm1523 · ‎02-08-2021

Hello, We have a strange issue here. We are on CDH 6.3.0 and have sentry in place for authorizations. A user is trying to execute queries from Hue on Impala Editor and fails with Authorization errors. However, same query works fine via Hive and also via Impala shell. It fails only from Hue editor. We have: 1. Refreshed metadata 2. Invalidated metadata 3. Verified permissions are in place in Sentry 4. There are no logs generated (I checked in Hue, Sentry Server and Catalog server). Please suggest if any other place should also be checked. Example query: select * from DB.table limit 5; Kindly help to diagnose and resolve this issue. Thanks Snm1523

snm1523 · ‎01-19-2021

Thank you for the reply @smdas After looking at the privilege logs, found that the port was reported to be used. In reality it was not being used so possible some caching issue. We rebooted the server and were able to then restart the DN successfully. Thanks snm1523

snm1523 · ‎01-11-2021

Hello, Does anyone has any clue about below error. Datanode is not coming up with this error in the logs. We are on Cloudera Hadoop 6.3.0. RECIEVED SIGNAL 15: SIGTERM Thanks snm1523

snm1523 · ‎10-07-2020

Hello @Elf , Yes I was able to. Have prepared a quick guide detailing the steps to be taken which in turn refers to Apache Griffin documentations and other required pre-reqs. Unsure, how do i share with you since I am unable to attach it here. Thanks snm1523

snm1523 · ‎10-07-2020

Hello Shishir, Would you mind to please how do we migrate a standalone Nifi setup to cluster mode? Thanks snm1523

snm1523 · ‎08-31-2020

Thank you... This helped.

snm1523 · ‎08-20-2020

Hi All, Need opinions / thoughts / best practices. Has anyone tried integrating Apache Griffin (An open source Data Quality solution for Big Data. More details at http://griffin.apache.org/#about_page) with deployed CDH clusters? If yes, any documentation available on how to get this done? What are the requirements / prereqs? Any recommendations on best practices? Any additional information or help or documentation (apart from the link shared) shared would be highly beneficial. Please share your thoughts / feedback / comments. Thanks SNM1523

snm1523 · ‎03-20-2020

Hello, If we Go to Clusters > Kudu > Click Actions, Run Kudu Rebalancer Tool, will it distribute data for overall Kudu or just Kudu Master or Kudu T-Servers. Target is to distribute currently uneven data, evenly acrossall nodes. If above does not work, is there any other way to distribute / balance data evenly across all kudu nodes. Also, do we need any downtime while rebalancing is in progress unlike HDFS. Overview of our infrastructure: 3 Kudu Masters 9 Tablet Servers Kudu 1.7.0-cdh5.16.2/ CM 5.16.2 Request some advice / assistance on the same. Thanks Snm1523

snm1523 · ‎02-14-2020

Hello, We are in the process of deploying CDP on Azure for our test system and later would move to Production. However, we are stuck with the port requirements for this deployment. As per the guidance from Cloudera, initially we were given a huge list of 7k+ port numbers that are required to be opened. That certainly would not pass network restrictions and hence, post further deep dive and discussions, we are currently at a point of getting only 6015 port number opened. We have also requested for a better explanation of why these 7k+ port numbers or just 6015 is required. However, while we are waiting for a response, I thought of to seek suggestions from the community, if anybody had deployed CDP on Azure and might have come across this. Would be great if anyone could advise on below: 1. What is the real need of 6015? I did not find any reference of this port in any of the community documentations by Cloudera 2. Will we really need a list of 7k+ ports to be opened? or anybody has quick list of required ports to be opened and can share that. 3. What are the other best practices / precautions you would have considered if deployed CDP on Azure or any other Cloud provider. Thanks snm1523

snm1523 · ‎01-24-2020

Perfect explanation. Thank you @EricL. This certainly helped.

snm1523 · ‎01-23-2020

Hello, While browsing through various articles related to Cloudera Manager, I came across an article which talks about exporting Cloudera Manager configs using a script. In this a wget from " ${SCM_URL} /cmf/exportCLI" url is doing the trick. Being fairly new with playing APIs, I tried to read across somethings related to CM APIs, however, did not find much. Would be great if someone could help me to understand which exact configurations are exported with the mentioned API. Apologies if seems to be a basic question. However, thought of asking community instead of creating confusions for myself. Thanks snm1523

snm1523 · ‎01-23-2020

Hello @GangWar, Thank you for the reply, Contacting Cloudera is certainly a best option and would most likely go for it. However, currently the project is in discussion and I was just trying to get views / thoughts from the community on such a scenario if anybody had ever come across. Thanks snm1523

snm1523 · ‎01-14-2020

Hello @Lewis , Thank you for the reply. I have a scenario, we are on multiple cdh 5.x versions on multiple clusters. Along with a small piece on Altus. Goal is to get everything on Azure, in such case would your opinion be to setup a fresh CDP on Azure and then move data and applications cluster by cluster to CDP? Thanks snm1523

snm1523 · ‎01-13-2020

Hello, Do we have a straight migration / upgrade path from CDH 5.x or 6.x to CDP on Azure? I tried to get this info in various forums / Cloudera documentations, however, was unable to find anything. Probably there is no such path or I may have missed something. Still, looking for a reconfirmation or guidance or advise on this. Please help. Thanks Snm1523

snm1523 · ‎09-27-2019

Hello All, Need suggestions / best practices / guidance to deploy below HBase replication scenario: We have 2 running HBase clusters which are in sync with each other (Bi directional HBase replication configured and enabled). With this it ensures that both HBase clusters have up to date data in HBase tables. We have a backup cluster deployed and the idea is to setup replication from both HBase clusters to Backup cluster. So ultimately, we will have 2 Active Masters of which data will be replicated to 1 Slave. If we configure HBase replication jobs for both master and keep them running, it could be the case of duplication of data (as per my understanding and logic). Would be great if anyone could share their experiences or guide further on to achieve this. Thanks Snm1523

snm1523 · ‎06-03-2019

Hello, Is there any way we can configure Cloudera Manager to send an email if utilization of CPU or Memory of a particular daemon / node (for eg. Impala daemon) crosses a specific limit (for eg. 80%)? Please advise. Thanks snm1523

snm1523 · ‎06-03-2019

Hello Harsh, Thank you for the help on this. I was able to identify some information that helped here. Will come back in case need further help. Will accept your reply as Solution. 🙂 Thanks snm1523

snm1523 · ‎03-07-2019

Thank you for the reply Harsh J. Would you be able to please help me with any quick command / script to identify avoidable open files or files stuck in some process using 'lsof' and guide further actions to take? I tried running a generic 'lsof | grep java' but it obviously gave me a huge list of files and became a bit difficult to get relevant information. Thanks snm1523

snm1523 · ‎03-06-2019

Hello All, I am looking for some best practices or recommendations to set a best possible value for rlimit_fds (Maximum Process File Descriptors) property. Currently, it is set to default i.e. 32768 and we are getting File Descriptor Threshold alerts. We would first like to look for a best possible value for rlimit_fds. Is there a formulae or a practice or few checks that can be performed to determine a best value? Thanks snm1523

snm1523 · ‎02-25-2019

Hello gzigldrum, Thank you for the guidance. This certainly helps. I will go through both the KB articles you shared and also review the Navigator Server and CM Agent logs for audit health warnings. Will comeback with the findings. In the meantime, any luck with HIVEMETASTORE_CANARY_HEALTH and NODE_MANAGER_WEB_METRIC_COLLECTION? Thanks snm1523

snm1523 · ‎02-22-2019

Hello Gzigldrum, Thank you for the reply. Below are the exact health messages from CM for each alert: HIVEMETASTORE_CANARY_HEALTH: The health test result for HIVEMETASTORE_CANARY_HEALTH has become bad: The Hive Metastore canary failed to create a database. OR The health test result for HIVEMETASTORE_CANARY_HEALTH has become bad: The Hive Metastore canary failed to create a partition in the table it created. OR The health test result for HIVEMETASTORE_CANARY_HEALTH has become bad: The Hive Metastore canary failed to drop the table it created. REGION_SERVER_AUDIT_HEALTH: The health test result for REGION_SERVER_AUDIT_HEALTH has become bad: There is a problem processing audits for REGIONSERVER. IMPALAD_QUERY_MONITORING_STATUS: he health test result for IMPALAD_QUERY_MONITORING_STATUS has become bad: There are 1 error(s) seen monitoring executing queries, and 0 errors(s) seen monitoring completed queries for this role in the previous 5 minute(s). Critical threshold: any. HIVESERVER2_SCM_HEALTH: The health test result for HIVESERVER2_SCM_HEALTH has become bad: This role s process is starting. This role is supposed to be started. NAME_NODE_AUDIT_HEALTH: The health test result for NAME_NODE_AUDIT_HEALTH has become bad: There is a problem processing audits for NAMENODE. NODE_MANAGER_WEB_METRIC_COLLECTION: The health test result for NODE_MANAGER_WEB_METRIC_COLLECTION has become bad: The Cloudera Manager Agent is not able to communicate with this role s web server. These health alerts occur in every 2-3 days in a time frame of 2-3 hours creating around 5-10 tickets during each interval. We have also checked from network side to verify if there was a network outage or a glitch in those windows, however, no luck. We have tried to diagnose through logs of each alert, but haven't found anything interesting. Hence, looking for some more guidance on what additional could be checked to identify a root cause of these. Thanks snm1523

snm1523 · ‎02-21-2019

Thank you for the quick replies, Gzigldrum. I have created a separate post explaining the alerts we get. Below is the link to the same. Flooded with failed health test alerts For every alert we get an incident in BMC as HP OVO is configured to generate an incident and assign it to us. Every morning we start with close to around 15-20 such incidents followed by 15-20 in rest of the day. Would be great if you could please post some suggestions to troubleshoot those alerts and help in permanently fixing them. Note: I will accept your previous reply as solution to this post. Thanks snm1523

snm1523 · ‎02-21-2019

Hello Gzigldrum, Thank you for the reply. However, the instructions provided in the KB article and values suggested by you are already applied. Please advise. Thanks Snm1523

snm1523 · ‎02-21-2019

Hello All, Need some suggestions on the exact reason of below heath tests getting failed multiple times, almost 3 times every day and generates atleast 3-4 alerts each time. 1. HIVEMETASTORE_CANARY_HEALTH 2. REGION_SERVER_AUDIT_HEALTH 3. IMPALAD_QUERY_MONITORING_STATUS 4. HIVESERVER2_SCM_HEALTH 5. NAME_NODE_AUDIT_HEALTH 6. NODE_MANAGER_WEB_METRIC_COLLECTION Any help or suggestion to permanently fix these alerts would of great help. Also, if anyone could also guide to reach root cause of this would also be helpful Thanks snm1523

Online	Offline
Last Visited	‎05-18-2021 07:07 AM

Date Registered	‎10-29-2015 07:36 PM
Last Visited	‎05-18-2021 07:07 AM
Total Messages Posted	60
Total Kudos Received	8

Re: Datanode not starting: SIGTERM error

Re: MKDirs failed to create file

Re: Strange permission Hive issue in accessing DBs

Re: Strange permission Hive issue in accessing DBs

Re: Strange permission Hive issue in accessing DBs

Re: Strange permission Hive issue in accessing DBs

Re: Integrating Apache Griffin to CDH Clusters

Strange permission Hive issue in accessing DBs

Authorization errors in Impala

Re: Datanode not starting: SIGTERM error

Datanode not starting: SIGTERM error

Re: Integrating Apache Griffin to CDH Clusters

Re: Migrating HDF 2.0 node from standalone to clus...

Re: Unsupported major.minor version 52.0-KAFKA-4.0...

Integrating Apache Griffin to CDH Clusters

Rebalancing in Kudu

CDP on Azure

Re: Cloudera Manager APIs

Cloudera Manager APIs

Re: CDH to CDP Migration

Re: CDH to CDP Migration

CDH to CDP Migration

HBase replication from Multiple HBase clusters

Report or alert based CPU and Memory usage

Re: Calculate File Descriptor in HBase

Re: Calculate File Descriptor in HBase

Calculate File Descriptor in HBase

Re: Flooded with failed health test alerts

Re: Flooded with failed health test alerts

Re: Best Practice to monitor alerts from Cloudera ...

Re: Best Practice to monitor alerts from Cloudera ...

Flooded with failed health test alerts