Member since
07-30-2020
216
Posts
40
Kudos Received
59
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
297 | 09-26-2024 05:30 AM | |
1002 | 10-26-2023 08:08 AM | |
1758 | 09-13-2023 06:56 AM | |
1998 | 08-25-2023 06:04 AM | |
1463 | 08-17-2023 12:51 AM |
07-26-2022
02:40 AM
Hi, Are you able to submit the job using YARN client mode (--deploy-mode client)?
... View more
07-25-2022
10:50 AM
1 Kudo
Hi @federicoferruti Have you added yarn gateway on the system from where the command is ran so that it gets the basic configuration to connect to RM. If HA is enabled, do check of you have set yarn.resourcemanager.webapp.address.<rm‐id>.
... View more
07-25-2022
04:49 AM
Hi Hanni, Are you able to view the content from the commndline? When accessing the files from Web Ui, the default user as per hadoop.http.staticuser.user is drwho. So make sure this user has the necessary permissions for the file. As the file has read permission for others, do check the Namenode logs for any warnings. Also, try using a different browser and check if above doesn't help.
... View more
07-24-2022
12:49 AM
1 Kudo
Hi @Meepoljd As per the description of the issue, I believe you are hitting ZOOKEEPER-1622 . Cloudera has already released TSB-2022-577 for this. As mentioned in the TSB, the session IDs should be unique but due to this bug, two clients might use the same session ID and hence causing the unexpected session termination.
... View more
07-22-2022
02:43 AM
1 Kudo
Hi, A hole in region chain most probably indicates there are some regions which are not yet online and hence creates a hole. # cat hbck.report | grep "not deployed on any region server" If you see regions in the above command output, you will need to assign them using hbase shell.
... View more
07-22-2022
01:44 AM
1 Kudo
Hello @loridigia You can try to assign the region from hbase shell. > assign '28dd7c81713c9347e8dfe4e6993b1ec7' If you can attach the below command output (with valid ticket ), we can check which all regions are offiline or in transition. # hbase hbck -details
... View more
07-21-2022
07:37 AM
As per the stack trace, it seems to be an issue with the JDK. Do check HIVE-21237 HIVE-21584
... View more
07-21-2022
07:24 AM
2 Kudos
Hello @loridigia , It seems due to the outage there would be multiple ServerCrashProcedures created for the Regionservers. The Dead region severs with same names are different instances of the Region servers with a different epoch timestamp. As the Hbase Master was also down, it might be possible that it was not able to process the expiration of the Region servers. You might see some Crash procedures waiting to be finished under "Procedures & Locks" section of the Active Hbase Master Web UI. As you have already solved this issue in the past involving zookeeper. I guess you can try this : 1. Stop Hbase 2. Login to zookeeper using #hbase zkcli ( with a valid hbase ticket ) 3. Delete the /hbase-secure znode. rmr /hbase-secure 4. Sideline the entries under HDFS dir. hdfs dfs -mv /hbase/MasterProcWALs/* /tmp. ( Not sure if this was done earlier ) 5. Start Hbase
... View more
07-18-2022
02:00 AM
Hello @KPG1 , The time taken to mark a datanode as stale is give by dfs.namenode.stale.datanode.interval, with a default of 30 seconds. If this is happening with a specific Datanode, you can check if there is any network issues between the Datanode and the Namenode or if the Datanode has any JVM pauses reported by checking the Datanode logs. As a bandaid, you can bump up the above parameter till the underlying problem is solved.
... View more
07-13-2022
10:55 AM
Hello, Based on the above test, I guess you are hitting HBASE-21852 which is still unresolved in the upstream.
... View more