Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Container allocation by Application master in Hadoop Cluster.

Highlighted

Container allocation by Application master in Hadoop Cluster.

New Contributor

As we know Default Minimum Container Size is 1024 MBs

Consider Hadoop Cluster <1-Master & 3-Datanodes>

Namenode : master (3GB RAM, 2 Cores)

Datanodes : data1 (512MB RAM, 1 Core),

data2(512MB RAM, 1 Core),

data3(1GB RAM, 1 Core).

Input File Size : "File"=500MB with Replication factor 3 (All the nodes having all the blocks)

Default Block Size = 128 MB

therefor "File" will be split into 4-Blocks

Due to Repli.Factor = 3, all the nodes will be having all the 4-Blocks i.e 4-Containers.

Default Minimum Container Size is 1024 MBs

Question1 : On which datanode AM will allocate Container?

Question2 : Data1 & Data2 has 512MB of RAM, Does that mean AM will never allocate container on these datanodes???