Member since
11-05-2015
10
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
4116 | 11-10-2015 09:35 AM |
04-18-2016
09:58 AM
Some more questions based on this thread Once storage configuration is defined and SSDs/ Disks are identified by HDFS, does all drives (SSDs+ DIsks) are used and single virtual storage ? if yes does it mean while running jobs/queries some data blocks would be fetched from Disks while others from SSDs? or two different virtual storage hot and cold?? If Yes, while copying/generating data in HDFS, will there be 3 copies of data across disks+storage or 3 copies in Disks and 3 copies in SSDs ; total 6 copies? how do I force data to be used from SSDs only or DISKs only; while submitting any Jobs/queries using various tools(hive, Impala, spark etc)
... View more
11-10-2015
11:47 AM
Congratulations on solving the issue. Thank you for sharing the steps in case someone else faces something similar.
... View more
11-06-2015
08:18 AM
thats what exactly happned; now that all disks are in hdfs ; we started to move some data to hdfs; what I am seeing now is disk1 on all nodes reached 100%. CDH is again showing same health issues; currently, we are still in mid of transfering data to hdfs. should I wait till transfer is over and let CDH re-balance drives? should i disable such disk usage checks from configuration tab? would it affect performance of data processing across nodes? shoukd we re install everything / a fresh start with having more storage drives to begin with? thanks
... View more