Member since
02-26-2017
25
Posts
1
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
25851 | 03-22-2017 07:11 PM |
05-31-2017
06:26 PM
Hi mbigelow, Thanks for your reply. Appreciate it.
... View more
05-28-2017
07:50 PM
Hi , I got the error as below. It seems we need to set memory for physical memory , but i can't find the configation about it. Where can i set physical memory? But the way , i just run some simple insert query in HIVE, and this error not happened on every time , i want to get the reason. ERROR: Diagnostic Messages for this Task: Container [pid=51661,containerID=container_e50_1493005386967_25486_01_000243] is running beyond physical memory limits. Current usage: 1.0 GB of 1 GB physical memory used; 2.7 GB of 2.1 GB virtual memory used. Killing container. Dump of the process-tree for container_e50_1493005386967_25486_01_000243 : |- PID PPID PGRPID SESSID CMD_NAME USER_MODE_TIME(MILLIS) SYSTEM_TIME(MILLIS) VMEM_USAGE(BYTES) RSSMEM_USAGE(PAGES) FULL_CMD_LINE |- 51661 51659 51661 51661 (bash) 0 0 108662784 305 /bin/bash -c /usr/java/jdk1.8.0_101/bin/java -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN.............
... View more
Labels:
- Labels:
-
Cloudera Manager
04-10-2017
07:05 PM
Sorry for late reply. I need to test it after business time. I set it to 2046->1024->512-> 256 and found NetWork IO take a low value with the number reducing. I'm sure the parameter is working for it. For someone who will refer this ticket. The speed of data transformation will take a very low speed for NetworkIO if you set a low value to this parameter. so please adjust schedul of jobs.
... View more
04-09-2017
06:35 PM
Yes, I set it from 4096 to 2048. The Network IO at the same level when it was 4096. Maybe i need to set less number than 2048?
... View more
04-06-2017
06:17 PM
It looks it(Maximum Number of Transfer Threads) is not working. I set it from 4096 to 2048 , but NetworkIO still take a high value.
... View more
04-03-2017
02:02 AM
Hi , I want to limit speed of data transformation with CDM because other process*(Not bigdata , not CDH) is using same internet resource with it(CDM). and the process* can't be run as no resource. How can i set it in CHM? I tried to set 'DataNode Balancing Bandwidth' in HDFS configuration to 1Mb. But it looks not working.
... View more
Labels:
- Labels:
-
Cloudera Manager
-
HDFS
03-22-2017
07:11 PM
I installed the host again , and the problem has been fixed. I'm not sure the reason.
... View more
03-20-2017
10:58 PM
I created a new ticket for this problem as a summury, but i can't find it , why? I move it to here. I want to add a host to existing cluster as a datanode. But the host don't work fine as expected. 1, I confirmed status of agent and it is working fine. cloudera-scm-agent (pid 162575) is running... 2, I restarted the cluster and CDM , the problem can't be resolve. 3, I stopped agent and add the host and restart agent again , the problem can't be resolve also. Looking forward to your response. And please let me know if you want more info. Thanks, Wenjie
... View more
03-20-2017
10:57 PM
NO , The problem has not be resolved.
... View more