Member since
01-19-2017
3681
Posts
633
Kudos Received
372
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 1643 | 06-04-2025 11:36 PM | |
| 2089 | 03-23-2025 05:23 AM | |
| 1000 | 03-17-2025 10:18 AM | |
| 3783 | 03-05-2025 01:34 PM | |
| 2604 | 03-03-2025 01:09 PM |
05-26-2022
12:07 AM
@George-Megre The Master nodes firstly are not meant for launching tasks or interaction. Edge or gateway nodes are used to run client applications and cluster administration tools. Setup of Edge/gateway node is similar to any Hadoop node except no Hadoop cluster services runs on the GW/Edge nodes they are mere entry points and connection gateway to the Master Components like HDFS (NN) HBASE etc provide you have installed the client libraries. In your case, I am sure you have the Hbase client/gateway roles on the 3 nodes and not on the master noded. The HBase client role gives the connectivity to Hbase but again I don't see why you would like to connect /initiate the HBase shell from the master node? Geoffrey
... View more
03-30-2022
12:53 PM
@iamfromsky True let me check on that and revert on the config. Can you share your integration steps or document?
... View more
03-30-2022
11:38 AM
@iamfromsky The path you are mentioning has permissions issues. As the root user can you # chmod 777 /run/cloudera-scm-agent/process/9392-yarn-NODEMANAGER/creds.localjceks Then retry if that's successful then fine-tune the permissions . Hope that helps
... View more
01-16-2022
09:53 AM
@Koffi This is typical of a rogue process hasn't reslease the Caused by: java.net.BindException: Address already in use You will need to run # kill -9 5356 The restart the NN that should resolve the issue
... View more
12-19-2021
08:51 AM
@Koffi Any updates on the commands ?
... View more
12-19-2021
04:24 AM
@Koffi Yes you obviously cannot run safe mode when the namenodes are down I can see the JN and ZKFC are all up can you run the below command on the last known good Namenode nn01 hopping you are running it as root su -l hdfs -c "/usr/hdp/current/hadoop-hdfs-namenode/../hadoop/sbin/hadoop-daemon.sh start namenode" If nn01 starts without any issue then run the same command on nn02 else share the logs from nn01
... View more
12-17-2021
08:56 PM
@Koffi This issue seems linked to your previous posting. Your last healthy name node was nn01, right? The assumption here is you are logged in as root Instructions to fix that one journal node. 1) Put both nn01 and nn02 in safe mode ( NN HA) $ sudo su - hdfs
[hdfs@host ~]$ hdfs dfsadmin -safemode enter Safe mode is ON in nn01/<nn01_IP>:8020 Safe mode is ON in nn02/<nn02_IP>:8020 2) Save Namespace [hdfs@host ~]$ hdfs dfsadmin -saveNamespace Save namespace successful for nn01/<nn01_IP>:8020 Save namespace successful for nn02/<nn02_IP>:8020 3) Backup zip/tar the journal dir from a working JN node of (nn01) and copy it to the non-working JN's of (nn02)node to something like /hadoop/hdfs/journal/<Cluster_name>/current 4) Leave safe mode [hdfs@host ~]$ hdfs dfsadmin -safemode leave Safe mode is OFF in nn01/<nn01_IP>:8020 Safe mode is OFF in nn02/<nn02_IP>:8020 4) Restart HDFS From Ambari you can now start the nn01 first when it comes up then start nn02 Please let me know.
... View more
10-02-2021
11:11 AM
@Phanikondeti Please can you share how you installed your nifi , version, and install documents followed? The errors logs would be good to share too.
... View more
09-09-2021
07:19 AM
@rachida_el-hamm Here is a very good resource, sit back and sip your coffee or tea. It should help you resolve your MySQL issue Happy hadooping
... View more
08-29-2021
07:19 AM
@npr20202 I am sorry but you will have to continue being a magician 🙂 If you don't want then you have to teach your users the secret sauce or magic wand. We too face the same problems with multiple users Spark/Impala/PySpark I have made them add the INVALIDATE METADATA and REFRESH (spark) )command at the start of their queries and that works perfectly Else the automatic invalidate/refresh of metadata is enabled and available in CDP 7.2.10. As long as Impala depends on HMS that issue will exist 🙂 Happy hadooping
... View more