Member since
01-19-2017
3679
Posts
632
Kudos Received
372
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 1001 | 06-04-2025 11:36 PM | |
| 1568 | 03-23-2025 05:23 AM | |
| 784 | 03-17-2025 10:18 AM | |
| 2821 | 03-05-2025 01:34 PM | |
| 1862 | 03-03-2025 01:09 PM |
11-20-2019
12:23 PM
1 Kudo
@mike_bronson7 Cloudera could be in the process of certification for RHEL 7.7 for the last major release of HDP 3.1.x which I highly doubt, you are aware HDP 3.1.3 and Ambari 2.7.3.0 could be the last major release as Cloudera recommends most clients running HDp 3.1 to either go the Cloud with CDP or wait for the On-prem version which should be around the corner, also people questioning Java 11 compatibility with HDP should be looking more to its compatibility with CDP the next-generation HDP It makes no business sense to keep investing in a product that will soon be retired/ obsolete! So currently there is no HDP or Ambari version certified on RHEl 7.7 and I have high doubts whether that's a priority @cloudera Happy hadooping
... View more
11-20-2019
11:42 AM
@asmarz The error is below in bold I /usr/bin/hdp-select set oozie-client 3.1.4.0-315' returned 1. symlink target /usr/hdp/current/oozie-client for oozie already exists and it is not a symlink. Possible cause the symlink is broken or exists and is pointing to different location or version so removing symlink and reinstalling the client should resolve the issue Validate Can you validate that the link exists? Move the symlink mv /usr/hdp/current/oozie-client /usr/hdp/current/oozie-client_back Recreate the symlink ln -s /usr/hdp/3.1.0.0-78/oozie /usr/hdp/current/oozie-client My version above is 2.1.0.0.x this should match your exact version
... View more
11-19-2019
02:45 PM
@fklezin Any updates do you still need help?
... View more
11-19-2019
12:57 PM
3 Kudos
@mike_bronson7 Here is a good compromise hoping you have enough disk space change directory # cd /opt/confluent/zookeeper/data Move the directory # mv version-2 version-2_bck Recreate with same permissions # mkdir version-2 # chown user:group version-2 Compare the permissions # ls -al version-2 version-2_bck Now you can restart zookeeper
... View more
11-19-2019
12:22 PM
2 Kudos
@mike_bronson7 Yes, in fact, a better solution is mv all the contents of /opt/confluent/zookeeper/data/version-2 usually ie [log.1,log.18263] there could be many that's why its easier to move than delete but remember to recreate the version-2 directory with the same user: group and permissions take note of those details 🙂 HTH
... View more
11-19-2019
12:11 PM
@asmarz When you delete components at times you leave the database in an inconsistent status. you will need to log onto the Ambari Database to do some manual cleaning. There are 3 important tables that hold the component status hostcomponentstate hostcomponentdesiredstate servicecomponentdesiredstate A targeted select on the component name to show , run the below to check if your oozie components are still [root@nakuru ~]# psql ambari ambari Password for user ambari: #default password is "bigdata" psql (8.4.20) Type "help" for help. ambari=> select distinct component_name from hostcomponentstate; If you see the oozie components in the databases then you will have to delete those entries, I have used 'OOZIE_SERVER','OOZIE_CLIENT' in the below example Delete the orphaned Oozie entries [root@nakuru ~]# psql ambari ambari Password for user ambari: #default password is "bigdata" psql (8.4.20) Type "help" for help. ambari=> delete from hostcomponentstate where component_name='OOZIE_CLIENT'; DELETE 1 ambari=> delete from hostcomponentstate where component_name='OOZIE_SERVER'; DELETE 1 ambari=> delete from hostcomponentdesiredstate where component_name='OOZIE_CLIENT'; DELETE 1 ambari=> delete from hostcomponentdesiredstate where component_name='OOZIE_SERVER'; DELETE 1 ambari=> delete from servicecomponentdesiredstate where component_name='OOZIE_CLIENT'; DELETE 1 ambari=> delete from servicecomponentdesiredstate where component_name='OOZIE_SERVER'; DELETE 1 ambari=> commit; WARNING: there is no transaction in progress COMMIT ambari=> \q [root@nakuru ~]# You can then stop all the components in the cluster and restart the database, you might need to restart some stale configurations that might have been orphaned due to the removal of the oozie components HTH
... View more
11-19-2019
11:21 AM
2 Kudos
@mike_bronson7 Yes "Unable to load database on disk" is due to corruption also as a backup r # mv /opt/confluent/zookeeper/data/version-2 /tmp Then restart the zookeeper it should copy the snapshot from one of the healthy nodes in the quorum HTH
... View more
11-18-2019
09:08 PM
@divya_thaore Yes please you need to use the Linux CLI to navigate to those directories
... View more
11-18-2019
01:50 PM
1 Kudo
@mike_bronson7 I see the difference in the response of the CURL. HTTP/1.1 404 Not Found [Before] HTTP/1.1 405 Method Not Allowed [Now] I have just tried on my cluster without the -i v and it worked Worked for me right now curl -u admin:admin -H "X-Requested-By: ambari" -X DELETE "http://node02:8080/api/v1/clusters/HDP/hosts/node01/host_components/SPARK2_THRIFTSERVER" Seen a case where with only a -i curl -i -u admin:admin -H "X-Requested-By: ambari" -X DELETE "http://node02:8080/api/v1/clusters/HDP/hosts/node01/host_components/SPARK2_THRIFTSERVER" Please revert
... View more
11-18-2019
12:54 PM
@fklezin I think your zeppelin is not aware of the python version in the Zeppelin config at /usr/hdp/current/zeppelin-server/conf/interpreter.json, and change the below line 30 in the config: "zeppelin.pyspark.python": { "type": "string", "name": "zeppelin.pyspark.python", "value": "python" }, To "zeppelin.pyspark.python": { "type": "string", "name": "zeppelin.pyspark.python3", "value": "python" }, Make sure you have these values in Ambari UI--> Zeppelin-->Config-->Advanced zeppelin-env export PYSPARK_PYTHON=python3 export PYSPARK_DRIVER_PYTHON=python3 Restart Zeppelin and retry
... View more