Member since
08-07-2017
144
Posts
3
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2298 | 03-05-2019 12:48 AM | |
9459 | 11-06-2017 07:28 PM |
11-14-2017
01:41 AM
@HarshJ Thanks for inputs. I checked heap charts on jobtracker instance and it's hitting the maximum heap value frequently and then reducing to little less value. Also, there has not been any change/increase in load. I checked the jobtracker logs but couldn't find any pauses as logging is not enabled for GC. Can you please let me know what are the history retention configurations of jobtracker? Can you please suggest me how to identify the reason behind the GC taking significant time? Thanks, Priya
... View more
11-13-2017
08:26 PM
@saranvisa, Thanks for the reply . I will try the option you mentioned .
... View more
11-13-2017
02:27 AM
Hi,
We are getting warning (concerning) messages for mapreduce1 jobtracker frequently on our Cloudera CDH 5.9 cluster. Currently java heap size of jobtracker is 4.11GB and it's 14-node cluster.
Below is the warning message that appears regarding the garbage collection.
Test of whether this role spends too much time in garbage collection.
Concerning:Average time spent in garbage collection was 20.6 seconds(34.28%)per minute over the previous 5 minute(s).Warning threshold:30.00%
Can someone please help me to get rid of the issue?
Thanks,
Priya
... View more
Labels:
- Labels:
-
Cloudera Manager
-
MapReduce
11-06-2017
07:28 PM
@mathieu.d, Thanks for reply, will try this and let you know.
... View more
11-02-2017
02:37 AM
Hi, We are trying to implement Archival program for HDFS files using mapreduce action and I am getting below error from oozie every time. JA018 Main class [org.apache.oozie.action.hadoop.ShellMain], exit code [1] The Job Browser lists the job as successful but the workflow shows status Kill with the above error.
I checked the hue WebUI as well, there also same error message. Can you please help me with this error? Thanks, Priya
... View more
Labels:
- Labels:
-
Apache Oozie
-
Cloudera Manager
-
HDFS
10-23-2017
10:47 PM
@Harsh J, Thanks for quick reply. I thought the ouptut of fsck command includes replica multiplier and gives final total block count. Thanks for the clarification. I checked Datanodes page on namenode WebUI and block count for each datanode is more than threshold value. Thanks, Priya
... View more
10-23-2017
10:25 PM
@Harsh J Thanks for the reply. I am checking the block count by using the command hdfs fsck path and referring to total blocks column in the output. Please suggest whether this is the right way or not. Thanks, Priya
... View more
10-18-2017
09:02 PM
@saranvisa, It was b>a earlier. I removed files using command line and block count is below threshold value. However it's not reflected in cloudera manager console. Please suggest. Thanks,
... View more
10-17-2017
07:50 PM
@saranvisa, b>a for all the datanodes. I have cleaned up the unwanted data and in command line block count is showing below threshold value however it's not reflected in the cloudera manager console. Please suggest. Thanks,
... View more
10-17-2017
02:49 AM
Hello All, We have CDH5.9.2 hadoop 13-node cluster and from one week, I am exeperiencing block count concerning warning notification in cloudera manager for all 6 datanodes. We have multitenancy implemented in our cluster. So I deleted the older files via hdfs command line and block count is below the threshold value. But still the block count concerning warning appears in the cloudera manager. Please suggest. Thanks, Priya
... View more
Labels:
- Labels:
-
Cloudera Manager