About wenjie

wenjie · ‎05-31-2017

Hi mbigelow, Thanks for your reply. Appreciate it.

wenjie · ‎05-28-2017

Hi , I got the error as below. It seems we need to set memory for physical memory , but i can't find the configation about it. Where can i set physical memory? But the way , i just run some simple insert query in HIVE, and this error not happened on every time , i want to get the reason. ERROR: Diagnostic Messages for this Task: Container [pid=51661,containerID=container_e50_1493005386967_25486_01_000243] is running beyond physical memory limits. Current usage: 1.0 GB of 1 GB physical memory used; 2.7 GB of 2.1 GB virtual memory used. Killing container. Dump of the process-tree for container_e50_1493005386967_25486_01_000243 : |- PID PPID PGRPID SESSID CMD_NAME USER_MODE_TIME(MILLIS) SYSTEM_TIME(MILLIS) VMEM_USAGE(BYTES) RSSMEM_USAGE(PAGES) FULL_CMD_LINE |- 51661 51659 51661 51661 (bash) 0 0 108662784 305 /bin/bash -c /usr/java/jdk1.8.0_101/bin/java -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN.............

wenjie · ‎04-10-2017

Sorry for late reply. I need to test it after business time. I set it to 2046->1024->512-> 256 and found NetWork IO take a low value with the number reducing. I'm sure the parameter is working for it. For someone who will refer this ticket. The speed of data transformation will take a very low speed for NetworkIO if you set a low value to this parameter. so please adjust schedul of jobs.

wenjie · ‎04-09-2017

Yes, I set it from 4096 to 2048. The Network IO at the same level when it was 4096. Maybe i need to set less number than 2048?

wenjie · ‎04-06-2017

It looks it(Maximum Number of Transfer Threads) is not working. I set it from 4096 to 2048 , but NetworkIO still take a high value.

wenjie · ‎04-03-2017

Thanks Fawze. I will try it and take a feedback.

wenjie · ‎04-03-2017

Hi , I want to limit speed of data transformation with CDM because other process*(Not bigdata , not CDH) is using same internet resource with it(CDM). and the process* can't be run as no resource. How can i set it in CHM? I tried to set 'DataNode Balancing Bandwidth' in HDFS configuration to 1Mb. But it looks not working.

wenjie · ‎03-22-2017

I installed the host again , and the problem has been fixed. I'm not sure the reason.

wenjie · ‎03-20-2017

I created a new ticket for this problem as a summury, but i can't find it , why? I move it to here. I want to add a host to existing cluster as a datanode. But the host don't work fine as expected. 1, I confirmed status of agent and it is working fine. cloudera-scm-agent (pid 162575) is running... 2, I restarted the cluster and CDM , the problem can't be resolve. 3, I stopped agent and add the host and restart agent again , the problem can't be resolve also. Looking forward to your response. And please let me know if you want more info. Thanks, Wenjie

wenjie · ‎03-20-2017

NO , The problem has not be resolved.

Online	Offline
Last Visited	‎06-01-2017 01:56 AM

Member Since	‎02-26-2017 05:53 PM
Last Visited	‎06-01-2017 01:56 AM
Posts	25
Kudos received	1

Cloudera Community

Re: ERROR MESSAGE:This host is not in contact with...

Re: ERROR:is running beyond physical memory limits...

ERROR:is running beyond physical memory limits.

Re: How to limit speed ?

Re: How to limit speed ?

Re: How to limit speed ?

Re: How to limit speed ?

How to limit speed ?

Re: ERROR MESSAGE:This host is not in contact with...

Re: ERROR MESSAGE:This host is not in contact with...

Re: This host is not in contact with the Host Moni...