- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
hardware namenode and secondary namenode
Created ‎04-26-2016 01:40 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi.
My primary namenode has the double hardware of the secondary namenode, is a good architecture???
Thanks
Created ‎05-02-2016 06:42 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi @Roberto Sancho: 47GB RAM is not a lot for a NN. It will work for a PoC, but this is definitely not recommended for production.
Created ‎04-26-2016 01:49 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Roberto,
I would recommend using Namenode HA (High Availability) rather than a secondary namenode. However, in a HA scenario the Namenode specs would be identical which would increases your total costs.
Hope it helps, Chris
Created ‎04-26-2016 01:58 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi:
Yes ill make Namenode HA (High Availability), but the active namenode will have more hardware that the stanby namenode, will be a problem???
thanks
Created ‎04-26-2016 02:08 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Well, it depends mainly on the memory of standby namenode. Imagine the following scenario: If the active namenode fails, the standby namenode takes over very quickly because it has the latest state available in memory: both the latest edit logs entries and an up-to-date block mapping. That means the RAM should be more or less the same in both namenodes.
Cheers, Chris
Created ‎04-26-2016 02:27 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
A common HW setup would be 12+ cores, 128-256 GB RAM
Created ‎04-27-2016 06:22 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi:
Actually my unique master has 12 cores and 47 gb ram y new machine will have 256 ram and 12 and 20 cors, it will be ok??
Created ‎05-02-2016 06:42 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi @Roberto Sancho: 47GB RAM is not a lot for a NN. It will work for a PoC, but this is definitely not recommended for production.
