Member since
01-25-2024
7
Posts
2
Kudos Received
0
Solutions
09-17-2024
08:31 AM
Looking forward for the detailed information. Thanks
... View more
09-17-2024
07:39 AM
Hello team, My main work is dependent on HBase Data. I have Source (RHEL 7 CDH cluster) and Destination (RHEL 9 Open-Source Cluster self-managed cluster) RHEL 9 Open-Source Cluster Conf: Apache Services Configured and running: Zookeeper Hadoop Yarn is Default conf HBase Migration Approach: Export - Import approach: Did the export on the source side. Tried doing distcp to source which won't work because of authentication mismatch and non-presence of marred because it was not configured in the source side. So I did the winSCP to destination and tried import which didn't work because the MapRed was not configured because it was not in the requirement. So I skipped this approach. Snapshot approach: I took snapshot on source side and tried doing snapshot-export. It gave an error saying that the destination is a 'SIMPLE AUTH' but the source is Kerberos Authenticated. So, it didn't work. Manual Approach: Took snapshots on source. Hadoop Get: Used get command to copy the snapshots file, /hbase/data/DataCapture (Actual Data Dir) and /hbase/data/hbase (Meta Data Dir) winSCP: Then used winSCP to transfer these directories from source to destination. Meta Conf: But before that I have replaced the metadata info in RHEL 7 and replaced with RHEL 9 HBase info. Region Servers Server Start Codes Stopped HBase and restarted but it didnt work out and its throwing the following error which i do 'list' : 2024-09-17 08:32:32,622 INFO zookeeper.ClientCnxn: EventThread shut down for session: 0x102e6e64b450116 2024-09-17 08:32:41,113 INFO client.RpcRetryingCallerImpl: Call exception, tries=12, retries=16, started=68591 ms ago, cancelled=false, msg=org.apache.hadoop.hbase.PleaseHoldException: Master is initializing at org.apache.hadoop.hbase.master.HMaster.checkInitialized(HMaster.java:3188) at org.apache.hadoop.hbase.master.MasterRpcServices.getTableDescriptors(MasterRpcServices.java:1073) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:415) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:124) at org.apache.hadoop.hbase.ipc.RpcHandler.run(RpcHandler.java:102) at org.apache.hadoop.hbase.ipc.RpcHandler.run(RpcHandler.java:82) , details=, see https://s.apache.org/timeout What is the best way to proceed sir ? Should i format the HBase? Or change the root dir to new one to start freshly? What approach should i procced sir? Should is configure Map-Red to do import on the destination side? As the destination side authentication is 'SIMPLE AUTH' do i need to Kerberos it sir or I can modify the configurations in the source RHEL 7 Cloudera managed to 'SIMPLE AUTH' ?. Note: My client uses LADP, AD and kerberos for Application purposes. The KDC is Active directory itself (AD Kerberos) Or is there any other way ? Please give me a detailed information sir. Really appreciate it. Thanks, Srikanth
... View more
09-17-2024
07:34 AM
I have 5 Nodes: NN1 NN2 DN1 DN2 DN3 Three Apache Services: Zookeeper Hadoop Yarn HBase Will need MapRed too For authentication-Companywide my client is using LDAP, AD. For application purpose they setup Kerberos and Active Directory as KDC. So, its AD Kerberos. I don't handle KDC by myself - Security team does. Currently I have setup an open-source self-managed Hadoop cluster and its configured to 'SIMPLE AUT' I want to use the authentication, so how do i proceed sir? Can someone please help with detailed steps and instruction?
... View more
Labels:
07-25-2024
12:23 PM
1 Kudo
Thanks and really appreciate you for sharing the info.
... View more
07-22-2024
11:37 AM
Requirement: Building an open source Hadoop cluster. No Ambari (No support for RHEL 9) and No CM manager (My company is not ready). Server Information: I have 5 nodes in RHEL 9: 2 masters and 3 slaves. Apache Services to be installed as per my company requirement: - Hadoop - Hbase - Zookeeper Online Resources: Overwhelmed to follow because Its tough for me to figure out how I will be able to interlinked everything together. Needed solution: Can someone please share the standard and most updated resources which i can follow to setup my cluster. And make those services talk to each other in a right direction. Like where to start ? As I know its hadoop but after that I got no clue. I did all the coding part in my previous project and now this admin part is a pain to me. Please someone help. Really appreciate. Thanks, Srikanth
... View more
Labels:
- Labels:
-
Apache HBase
-
Apache Zookeeper
-
HDFS
01-25-2024
06:45 PM
1 Kudo
Can you please tell me how I can access Ambari ? Or how to work on cloudera VM on UTM. I have finished all the installations.
... View more