Member since
11-22-2013
35
Posts
0
Kudos Received
6
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2920 | 07-21-2014 10:36 AM | |
2020 | 06-30-2014 09:05 AM | |
1401 | 06-27-2014 11:15 AM | |
3778 | 05-29-2014 10:17 AM | |
2389 | 12-19-2013 10:36 AM |
03-16-2017
01:45 PM
Regarding where to host the 3 journal nodes using QJM: Apache docs (and similarly in Cloudera HA guide) state: The JournalNode daemon is relatively lightweight, so these daemons may reasonably be collocated on machines with other Hadoop daemons, for example NameNodes, the JobTracker, or the YARN ResourceManager My 2 NameNode machines are not good candidates for hosting 2 of the 3 daemons due the recommendation that these have a dedicated disk drive. So with those out of the picture, the question circulating around my team is whether we can put these 3 daemons on nodes running data node daemons OR if we should dedicate 3 small virtual machines to running them. To me, 3 new VMs is overkill. Note that we have YARN RM on a datanode as well due to the small size of the cluster. Thanks for your input and if there are better suggestions, please let me know.
... View more
07-21-2014
10:36 AM
Thank you Harsh for your email !!! i was hitting below issue, I increased this "dfs.image.transfer.timeout" and it fixed the issue. https://issues.apache.org/jira/browse/HDFS-4301 Checkpoint was working fine but the issue started when my fsimage size reached 2.1GB. Best Regards, Bommuraj
... View more
07-21-2014
10:27 AM
Thank you Harsh. its working !!!
... View more
06-30-2014
09:05 AM
Thank you Manikumar for your input. I just found below location in cloudera manager to add the custome parameters. HDFS -> CONFIGURATION -> SERVICE WIDE -> ADVANCED -> HDFS Service Environment Safety Valve Best Regards, Bommuraj
... View more
06-27-2014
11:15 AM
yes, i did change in below location HDFS -> CONFIGURATION -> SERVICE WIDE -> ADVANCED -> HDFS Service Safety Valve Best Regards, BOmmuraj
... View more
06-27-2014
11:09 AM
THank You Hazim appreciated your help !!!
... View more
06-26-2014
10:06 AM
Thank you very much busbey... i will do the upgrade from cdh4 -> cdh5. Best Regards, Bommuraj
... View more
05-29-2014
10:17 AM
Hi, As per HARSH.J suugestion, i added more HEAP size (5 GB to 8 GB) to Name Node & Secondary Name Node. issue resolved !!! Thank you HARSH. Best Regards, Bommuraj
... View more
03-17-2014
11:17 AM
Thank you Harsh !!!
... View more
02-26-2014
10:17 AM
Thank you Harsh !!!
... View more