If its a new cluster, and its the yarn job, please make sure that you have mr-framework uploaded to /user/yarn/mapreduce/mr-framewor in hdfs. All yarn job will fail with below error if that path missing: Error: java.io.IOException: Can't get Master Kerberos principal for use as renewer $ hdfs dfs -put 3.1.1.7.1.7.2032-1-mr-framework.tar.gz /user/yarn/mapreduce/mr-framework ... View more

In general, ambari will create that znode by default. we dont need to create manually. logs shows that issue with sasl. we can still create znode manually after logging into zookeeper cli. [root@c2757-node3 ~]# /opt/cloudera/parcels/CDH-7.1.6-1.cdh7.1.6.p0.10506313/lib/zookeeper/bin/zkCli.sh -server c2757-node3.coelab.cloudera.com:2181 /usr/java/jdk1.8.0_232-cloudera/bin/java Connecting to c2757-node3.coelab.cloudera.com:2181 Welcome to ZooKeeper! JLine support is enabled WATCHER:: WatchedEvent state:SyncConnected type:None path:null [zk: c2757-node3.coelab.cloudera.com:2181(CONNECTED) 0] ls / [confstore, hbase, hiveserver2, kafka, rmstore, solr-infra, zookeeper] [zk: c2757-node3.coelab.cloudera.com:2181(CONNECTED) 1] ls /hiveserver2 [serverUri=c2757-node3.coelab.cloudera.com:10000;version=3.1.3000.7.1.6.0-297;sequence=0000000024] [zk: c2757-node3.coelab.cloudera.com:2181(CONNECTED) 7] create /sample Created /sample [zk: c2757-node3.coelab.cloudera.com:2181(CONNECTED) 8] ls / [confstore, hbase, hiveserver2, kafka, rmstore, sample, solr-infra, zookeeper] ... View more

@prashanthshetty as this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post. ... View more

@er_sharma_shant @jsensharma Can you guys please tell me how to resolve hiveserver2 start issue by adding the znode name for hiveserver2 in zkcli shell?.. I have hiveserver2 instance created in zkcli shell, but it does not have znode name because of which hiveserver2 is failing to start. Welcome to ZooKeeper! 2022-02-03 02:31:36,504 - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread@1013] - Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) JLine support is enabled 2022-02-03 02:31:36,592 - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread@856] - Socket connection established, initiating session, client: /127.0.0.1:36762, server: localhost/127.0.0.1:2181 2022-02-03 02:31:36,609 - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread@1273] - Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x27ebd79aecc014c, negotiated timeout = 30000 WATCHER:: WatchedEvent state:SyncConnected type:None path:null [zk: localhost:2181(CONNECTED) 0] ls / [cluster, registry, controller, brokers, storm, infra-solr, zookeeper, hbase-unsecure, hadoop-ha, tracers, admin, isr_change_notification, log_dir_event_notification, accumulo, controller_epoch, hiveserver2, hiveserver2-leader, druid, rmstore, atsv2-hbase-unsecure, consumers, ambari-metrics-cluster, latest_producer_id_block, config] [zk: localhost:2181(CONNECTED) 1] ls /hiveserver2 [] [zk: localhost:2181(CONNECTED) 2] Any help would be much appreciated!!!. Thank you ... View more

@Shelton As you have mentioned solution in Point 3, 3. There seems to be a problem with hiveserver creating a znode in zookeeper. [caught exception: ZooKeeper node /hiveserver2 is not ready yet] How can I create hiveserver2 znode instance in zookeeper if its not created?.  ... View more

Thanks, ccibi75 This worked for me. ... View more

Adding a bit of clarification to above mentioned solution. Find "Ranger External URL" in the field  Ranger > Configs > Advanced > Ranger Settings. It will be something like "http://<ranger_admin_host>:6080" . Copy this URL and update the particular service to which Ranger plugin is enabled. For example : If its HDFS, HDFS > Configs > Advanced > Advanced ranger-hdfs-security > ranger.plugin.hdfs.policy.rest.url. Usually this field should be auto populated by Ranger External URL value. If its not, it will be like "{{policy_mgr_url}}". Update this field by adding "Ranger External URL". Restart Ranger service, ranger KMS service and all required services.  ... View more

Hi Prash, Since i upgraded the packages in the early stage of the setup. I just created a dump (backup) for the Kerberos , and use the yum update command to upgrade it. After updated the packages, the cluster could be started.     ... View more

@Aditya : Thank, this is really informative ... View more

Hi, In order to find the adequate space in any directory during installation or upgrade procedures, for example while doing HDP upgrade you should verify about the availability of adequate space on /usr/hdp for the target HDP version. For that use below format: df -h <Path_of_interest> Example : [alex@machine1]# df -h /usr/hdp/ Filesystem Size Used Avail Use% Mounted on /dev/mapper/system-root 528G 22G 506G 5% / [alex@machine1]# You can all parameters like Size of disk, used space, available spave and percentage of usage. ... View more