04-03-2017 02:02 AM
I want to limit speed of data transformation with CDM because other process*(Not bigdata , not CDH) is using same internet resource with it(CDM). and the process* can't be run as no resource.
How can i set it in CHM?
I tried to set 'DataNode Balancing Bandwidth' in HDFS configuration to 1Mb.
But it looks not working.
04-10-2017 07:05 PM
Sorry for late reply.
I need to test it after business time.
I set it to 2046->1024->512-> 256 and found NetWork IO take a low value with the number reducing.
I'm sure the parameter is working for it.
For someone who will refer this ticket.
The speed of data transformation will take a very low speed for NetworkIO if you set a low value to this parameter.
so please adjust schedul of jobs.