Support Questions
Find answers, ask questions, and share your expertise

Who agreed with this topic

a lots of Swapping with no running mapreduce jobs

New Contributor

I have 20 node cluster. currently it is not running any mapreduce jobs. but i still see lots of swapping. i dont understand why it is swapping out of memory and falling on to disk. I tried setting swappiness to zero, but still see hosts doing swapping

can you advise what settings will suite best for me. ideally, the memory shouldnt fall to disk. Thank you for your assistance!!

 

one-sec datanode log:

10:08:34.616 AMINFOorg.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner
Verification succeeded for BP-1479097632-20.104.30.10-1396209644268:blk_-7222921073662474817_91803
10:08:35.216 AMINFOorg.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner
Verification succeeded for BP-1479097632-20.104.30.10-1396209644268:blk_3621092520087214031_238959
10:08:35.616 AMINFOorg.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner
Verification succeeded for BP-1479097632-20.104.30.10-1396209644268:blk_-1934182820396581735_244044
10:08:35.815 AMINFOorg.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner
Verification succeeded for BP-1479097632-20.104.30.10-1396209644268:blk_1283653989553224084_238971
10:08:40.216 AMINFOorg.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner
Verification succeeded for BP-1479097632-20.104.30.10-1396209644268:blk_4382530891251343028_19439
10:08:41.615 AMINFOorg.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner
Verification succeeded for BP-1479097632-20.104.30.10-1396209644268:blk_-601245050305217824_248311
10:08:41.816 AMINFOorg.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner
Verification succeeded for BP-1479097632-20.104.30.10-1396209644268:blk_-6797507380375413815_238559
10:08:43.815 AMINFOorg.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner
Verification succeeded for BP-1479097632-20.104.30.10-1396209644268:blk_7227613745462040822_98940
10:08:45.816 AMINFOorg.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner
Verification succeeded for BP-1479097632-20.104.30.10-1396209644268:blk_-488671150116843865_241195
10:08:46.216 AMINFOorg.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner
Verification succeeded for BP-1479097632-20.104.30.10-1396209644268:blk_-1183015651820068721_183821
10:08:46.815 AMINFOorg.apache.hadoop.hdfs.server.datanode.BlockPoolSliceScanner
Verification succeeded for BP-1479097632-20.104.30.10-1396209644268:blk_-8729851147273263236_242392

 

•hadoop-02.acs1cloud.interna
Swapping

•hadoop-04.acs1cloud.internal
Swapping

•hadoop-05.acs1cloud.internal
Swapping

•hadoop-11.acs1cloud.internal
Swapping

•hadoop-18.acs1cloud.internal
Swapping

  •  
    Health History
    10:02 AMConcerning
    • Swapping
     
    9:46 AMGood
    • Swapping
     
    9:22 AMConcerning
    • Swapping
     
    8:46 AMGood
    • Swapping
     
    8:32 AMConcerning
    • Swapping
     
    7:39 AMGood
    • Swapping
     
Who agreed with this topic