Member since
01-19-2017
3676
Posts
632
Kudos Received
372
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 608 | 06-04-2025 11:36 PM | |
| 1166 | 03-23-2025 05:23 AM | |
| 575 | 03-17-2025 10:18 AM | |
| 2172 | 03-05-2025 01:34 PM | |
| 1369 | 03-03-2025 01:09 PM |
05-08-2021
12:51 AM
thank you so much. I encountered same problem,but it solved after read your solution. I also changed the default config in Ambari to only 2 encryption types and hashed out the default ticket encryptions as well, then error went away.
... View more
04-22-2021
03:22 AM
Understood. In our case, the culprit turned out to be 50075 port in firewall. I've added as an answer. In any case, thanks for your support. Thanks, Megh
... View more
04-20-2021
01:52 PM
@Seeker90 Zookeepers by default are supposed to be running in an ensemble [french together] thats a quorum in English. Minimum number of servers required to run the Zookeeper is called Quorum. Zookeeper replicates whole data tree to all the quorum servers. This number is also the minimum number of servers required to store a client’s data before telling the client it is safely stored. Quorum size should be calculated by Majority Rule Majority rule: QN = (N + 1) / 2 QN: Minimum number of servers in quorum N: Total number of servers. (should be an odd number) So, if we have 5 servers, then Quorum should be minimum of 3 servers. As long as a majority of the ensemble are up, the service will be available. Because Zookeeper requires a majority, it is best to use an odd number of machines ZooKeeper uses Quorums by default to prevent the "brain split" phenomenon. That is, only more than half of the nodes in the cluster can vote for the Leader. This way can ensure the uniqueness of the leader, Split-Brain is like when you have two nodes in your cluster, they both know that a master needs to be elected in this cluster. Then when there is no problem in the communication between the two of them, a consensus will be reached and one of them will be selected as the master. But if there is a problem with the communication between them, both nodes will feel that there is no master now, so each elects itself as the master, so there will be two masters in the cluster. So to avoid the current problem you are facing add 2 more Zk'ers and that problem will vanish Happy hadooping
... View more
04-15-2021
12:44 PM
An easy way to solve this problem is to change the port that Apache - Nifi uses to run to another port that is different than 8080. We can make the change in the file: nifi.property under the folder: .\conf. 🙂
... View more
04-08-2021
04:54 AM
1 Kudo
Resolved the issue using below steps; Cloudera mangement service was added through UI using below steps: On clusters home page in UI, near Status, right corner -> Add -> cloudera managemnet service Before starting the service configure the TLS/SSL keystore like that of HDFS and YARN and restart the service.
... View more
04-07-2021
06:29 AM
@Shelton Excuse for the delayed response. I have attached the screenshot of the policy in ranger. hivedev policies Test policy -1 Test policy - 2 So according to policy, 'shaz' should have access 'qubz' database and 'edward' should not have access to the 'qubz' database. Beeline: edward@dev-2:~$ beeline SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/usr/hdp/apache-hive-3.1.0-bin/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/usr/hdp/hadoop-3.1.0/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] Beeline version 3.1.0 by Apache Hive beeline> !connect jdbc:hive2://dev-2:10000/; Connecting to jdbc:hive2://dev-2:10000/; Enter username for jdbc:hive2://dev-2:10000/: edward Enter password for jdbc:hive2://dev-2:10000/: Connected to: Apache Hive (version 3.1.0) Driver: Hive JDBC (version 3.1.0) Transaction isolation: TRANSACTION_REPEATABLE_READ 0: jdbc:hive2://dev-2:10000/> show databases; INFO : Compiling command(queryId=root_20210407130935_a28fc25d-2398-4e61-a205-f24e3ba937f1): show databases INFO : Concurrency mode is disabled, not creating a lock manager INFO : Semantic Analysis Completed (retrial = false) INFO : Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:database_name, type:string, comment:from deserializer)], properties:null) INFO : Completed compiling command(queryId=root_20210407130935_a28fc25d-2398-4e61-a205-f24e3ba937f1); Time taken: 0.01 seconds INFO : Concurrency mode is disabled, not creating a lock manager INFO : Executing command(queryId=root_20210407130935_a28fc25d-2398-4e61-a205-f24e3ba937f1): show databases INFO : Starting task [Stage-0:DDL] in serial mode INFO : Completed executing command(queryId=root_20210407130935_a28fc25d-2398-4e61-a205-f24e3ba937f1); Time taken: 0.015 seconds INFO : OK INFO : Concurrency mode is disabled, not creating a lock manager +----------------+ | database_name | +----------------+ | default | | kylin | | mytesting | | qubz | +----------------+ 4 rows selected (0.115 seconds) 0: jdbc:hive2://dev-2:10000/> show tables from qubz; INFO : Compiling command(queryId=root_20210407131007_896cb7af-5452-4b5e-bd6c-1393c25e1bd7): show tables from qubz INFO : Concurrency mode is disabled, not creating a lock manager INFO : Semantic Analysis Completed (retrial = false) INFO : Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:tab_name, type:string, comment:from deserializer)], properties:null) INFO : Completed compiling command(queryId=root_20210407131007_896cb7af-5452-4b5e-bd6c-1393c25e1bd7); Time taken: 0.016 seconds INFO : Concurrency mode is disabled, not creating a lock manager INFO : Executing command(queryId=root_20210407131007_896cb7af-5452-4b5e-bd6c-1393c25e1bd7): show tables from qubz INFO : Starting task [Stage-0:DDL] in serial mode INFO : Completed executing command(queryId=root_20210407131007_896cb7af-5452-4b5e-bd6c-1393c25e1bd7); Time taken: 0.013 seconds INFO : OK INFO : Concurrency mode is disabled, not creating a lock manager +-----------+ | tab_name | +-----------+ +-----------+ No rows selected (0.043 seconds) But, edward was able to see 'qubz' db ( to which he was restricted access, In old Ranger, DB will not be even visible - Is this expected here? ) but no tables visible, whereas 'shaz' user was able to view the DB as well as tables as expected.
... View more
04-07-2021
03:02 AM
Huge thanks. It works for me.
... View more
04-06-2021
02:50 AM
Hello Michael, In your insert query are you referring to table like "databasename.tablename"?, if yes, then first try to execute "use databasename" And then execute the query.
... View more
04-05-2021
05:13 AM
Hi @raghu9raghavend , did you manage to upgrade Java to the latest version or any version above 8u161? We are getting the same error, any versions below 8u161 doesn't give this error but once upgraded to any versions above 8u161, that is the time the error is showing.
... View more
03-23-2021
09:23 PM
Edit: I've learned that decommissioning nodes might not be the preferred way. otherwise, the problem statement remains the same. i.e. The job should not get scheduled on nodes where a particular service is down.
... View more