Member since
09-11-2018
76
Posts
7
Kudos Received
5
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
987 | 07-15-2021 06:18 AM | |
1426 | 06-21-2021 01:36 AM | |
2266 | 06-21-2021 01:29 AM | |
2106 | 04-19-2021 10:17 AM | |
3169 | 02-09-2020 10:24 PM |
04-20-2021
11:08 PM
Hi @sipocootap2 Answered it here - https://community.cloudera.com/t5/Support-Questions/How-can-I-get-fsimage-with-curl-command/m-p/314859/highlight/false#M226223 cheers,
... View more
04-20-2021
01:52 PM
@Seeker90 Zookeepers by default are supposed to be running in an ensemble [french together] thats a quorum in English. Minimum number of servers required to run the Zookeeper is called Quorum. Zookeeper replicates whole data tree to all the quorum servers. This number is also the minimum number of servers required to store a client’s data before telling the client it is safely stored. Quorum size should be calculated by Majority Rule Majority rule: QN = (N + 1) / 2 QN: Minimum number of servers in quorum N: Total number of servers. (should be an odd number) So, if we have 5 servers, then Quorum should be minimum of 3 servers. As long as a majority of the ensemble are up, the service will be available. Because Zookeeper requires a majority, it is best to use an odd number of machines ZooKeeper uses Quorums by default to prevent the "brain split" phenomenon. That is, only more than half of the nodes in the cluster can vote for the Leader. This way can ensure the uniqueness of the leader, Split-Brain is like when you have two nodes in your cluster, they both know that a master needs to be elected in this cluster. Then when there is no problem in the communication between the two of them, a consensus will be reached and one of them will be selected as the master. But if there is a problem with the communication between them, both nodes will feel that there is no master now, so each elects itself as the master, so there will be two masters in the cluster. So to avoid the current problem you are facing add 2 more Zk'ers and that problem will vanish Happy hadooping
... View more
04-20-2021
11:16 AM
Hi @Chetankumar , I think we answered in this thread :- https://community.cloudera.com/t5/Support-Questions/How-to-move-block-from-one-mount-point-to-other-and-remove/td-p/314861 If that answers all your questions, feel free to mark the post "accepted solution" Regards,
... View more
04-20-2021
11:05 AM
Hi @rubysimmons63 Also, Falcon is explained in detail in contrast with Atlas here, do check it out for better understanding :- https://community.cloudera.com/t5/Support-Questions/What-is-the-difference-between-Apache-atlas-and-Apache/m-p/122450 https://www.cloudera.com/products/open-source/apache-hadoop/apache-falcon.html Regards,
... View more
04-20-2021
10:53 AM
Hi @ryu , We can trigger manual GC in datanode JVM application AFAIK. The best way to deal with long GC pauses is to allocate right amount of heap memory. We recommend the formula of - 1gb heap per 1 million blocks. You can get the number of block count from NameNode Webui -> datanode (through ambari or CM). Increase the heap and that should fix your issue. Do check for "No GC detected" in Datanode logs, if you see those then it could be hardware problem triggering GC. Does that answers your questions. Let me know Regards, Vipin
... View more
04-20-2021
06:26 AM
Hi @kingpin Thanks for your reply. Yes this solution worked and now we are able to remove the old disk and after rebalance new disks are in use. We will continue to remove the disk from each node after the rebalance complete after each attempt.
... View more
03-31-2021
03:28 AM
1 Kudo
Hi @rocky_tian Although it appears to be https://issues.apache.org/jira/browse/KUDU-2412 but since you are on el7. Not sure if this jira is valid for your case. Ensure all the prerequisites kudu libraries are installed as mentioned in the doc :- https://kudu.apache.org/docs/installation.html#_install_on_rhel_or_centos_hosts Related external link - https://stackoverflow.com/questions/52526013/how-to-read-from-kudu-to-python Regards, Vipin
... View more
03-23-2021
07:35 AM
1 Kudo
Please note, the instructions are also available in our public documentation under "Installing OpenJDK".
... View more
03-04-2021
05:16 AM
1 Kudo
Hello, I tried with AuthMech=2 with UID as mentioned in the Cloudera Impala JDBC Driver documentation but I got HIveServer2 connection issue. When I tried with AuthMech=0, along with UID (In my case no authentication is needed), it resolved the table owner error. My connection string looks like - jdbc:impala://localhost:21050/default;UseSasl=0;AuthMech=0;UID=impala Hope this will resolve your issue as well.
... View more
02-04-2021
02:24 AM
Hi @Smashedcat32 To give some background on the ZooKeeper Canary, the ServiceMonitor will regularly check the health of the ZooKeeper Service by 1. connecting to the ZooKeeper quorum and locate the leader 2. create a znode 3. read the znode 4 deleting the znode. If any of these steps fail the ServiceMonitor will report the ZOOKEEPER_CANARY_HEALTH has become bad. In the health reported above, the reason was "Canary test failed to establish a connection or a client session to the ZooKeeper service", which means it failed on step 1. The problem could lie in three locations: 1. The ZooKeeper Quorum - Fsync, low GC , Low max client connections 2. The Service Monitor - false reports 3. Network connectivity between the Service Monitor and the ZooKeepers Now coming to your query regarding canary test commands, i dont think we have it available in docs. You can use the commands from ZK guide to test Example - To verify if the ZK instance is leader echo stat | nc ZOOKEEPER_IP ZOOKEEPER PORT | grep Mode http://www.corejavaguru.com/bigdata/zookeeper/cli https://zookeeper.apache.org/doc/r3.3.3/zookeeperStarted.html#sc_ConnectingToZooKeeper
... View more
- « Previous
-
- 1
- 2
- Next »