v_singh
Explorer

Re: HDP- Datanodes are crashing

by Explorer in Support Questions
‎08-09-2017 04:57 AM
‎08-09-2017 04:57 AM
Thanks for quick reponse. Going to bring overcommit 2 to 0. ... View more

HDP- Datanodes are crashing

by Explorer in Support Questions
‎08-09-2017 04:22 AM
‎08-09-2017 04:22 AM
We have 4 nodes Hadoop cluster. 2 Master nodes 2 data nodes After sometimes we found that our data nodes are failing. then, we go and see the log section it always tell cannot allocate memory. ENV <code>HDP 2.3.6 VERSION HAWQ 2.0.0 VERSION linux os : centos 6.0 Getting following error Data nodes are crashing WITH following logs <code>os::commit_memory(0x00007fec816ac000, 12288, 0) failed; error='Cannot allocate memory' (errno=12) Memory Info vm_overcommit ratio is 2 DATANODE heap size 2 GB Namenode heap size 2 GB <code>MemTotal: 30946088 kB MemFree: 11252496 kB Buffers: 496376 kB Cached: 11938144 kB SwapCached: 0 kB Active: 15023232 kB Inactive: 3116316 kB Active(anon): 5709860 kB Inactive(anon): 394092 kB Active(file): 9313372 kB Inactive(file): 2722224 kB Unevictable: 0 kB Mlocked: 0 kB SwapTotal: 15728636 kB SwapFree: 15728636 kB Dirty: 280 kB Writeback: 0 kB AnonPages: 5705052 kB Mapped: 461876 kB Shmem: 398936 kB Slab: 803936 kB SReclaimable: 692240 kB SUnreclaim: 111696 kB KernelStack: 33520 kB PageTables: 342840 kB NFS_Unstable: 0 kB Bounce: 0 kB WritebackTmp: 0 kB CommitLimit: 31201680 kB Committed_AS: 26896520 kB VmallocTotal: 34359738367 kB VmallocUsed: 73516 kB VmallocChunk: 34359538628 kB HardwareCorrupted: 0 kB AnonHugePages: 2887680 kB HugePages_Total: 0 HugePages_Free: 0 HugePages_Rsvd: 0 HugePages_Surp: 0 Hugepagesize: 2048 kB DirectMap4k: 6132 kB DirectMap2M: 2091008 kB DirectMap1G: 29360128 kB ... View more

How does HDFS process work?

by Explorer in Support Questions
‎06-05-2016 10:48 AM
2 Kudos
‎06-05-2016 10:48 AM
2 Kudos
Being Novice ,Trying to Understand file write process in haddop? file read process in hadoop? how to run a job in hadoop ? It would be very helpful in understanding if we have basic steps for it. Thanks in advance ! ... View more
Labels:

Re: How do i make Upgrade Plan for HDP versio...

by Explorer in Support Questions
‎04-15-2016 05:46 AM
‎04-15-2016 05:46 AM
Thanks for command. We wanted to prepare Upgrade plan using Spreadsheet with actual steps for Upgrade hdp stack using Ambari. We wanted to follow the steps of process at the time of upgrade. But not sure where to start the process. and what are step -by-step commands involve in it. ... View more

How do i make Upgrade Plan for HDP version us...

by Explorer in Support Questions
‎04-15-2016 02:58 AM
‎04-15-2016 02:58 AM
We are Novice to Hadoop.Started working few months back. Now, time to take first time Upgrade of HDP. We are trying to prepare Upgrade Plan for HDP New version in that, We are looking step-by-step process for UPGRADE.Additionaly, we can remember the previous configuration of PHD cluster Later on. We Would like to know , if we can transform documentation into simple parameters which we can refer at the time of Upgrades. Thanks in advance ! Your time is always valuable for me ... View more
Contact Me
Online
Offline
Last Visited
‎08-09-2017 08:22 AM
Public Statistics
Date Registered ‎04-13-2016 03:26 PM
Last Visited ‎08-09-2017 08:22 AM
Total Messages Posted 11
Total Kudos Received 2