question Re: How to limit speed ? in Archives of Support Questions (Read Only)

How to limit speed ?

wenjie — Mon, 03 Apr 2017 09:02:02 GMT

Hi ,

I want to limit speed of data transformation with CDM because other process*(Not bigdata , not CDH) is using same internet resource with it(CDM). and the process* can't be run as no resource.

How can i set it in CHM?

I tried to set 'DataNode Balancing Bandwidth' in HDFS configuration to 1Mb.

But it looks not working.

Re: How to limit speed ?

Fawze — Mon, 03 Apr 2017 14:47:30 GMT

Hi @wenjie,

Try this:

Maximum Number of Transfer Threads

Re: How to limit speed ?

wenjie — Tue, 04 Apr 2017 06:00:32 GMT

Thanks Fawze.

I will try it and take a feedback.

Re: How to limit speed ?

wenjie — Fri, 07 Apr 2017 01:17:48 GMT

It looks it(Maximum Number of Transfer Threads) is not working.

I set it from 4096 to 2048 , but NetworkIO still take a high value.

Re: How to limit speed ?

Fawze — Fri, 07 Apr 2017 05:57:36 GMT

The Network IO at the same level when it was 4096?

Re: How to limit speed ?

wenjie — Mon, 10 Apr 2017 01:35:39 GMT

Yes, I set it from 4096 to 2048.
The Network IO at the same level when it was 4096.

Maybe i need to set less number than 2048?

Re: How to limit speed ?

Fawze — Mon, 10 Apr 2017 06:19:22 GMT

Try to do it very low and then check.

Re: How to limit speed ?

wenjie — Tue, 11 Apr 2017 02:05:38 GMT

Sorry for late reply.

I need to test it after business time.

I set it to 2046->1024->512-> 256 and found NetWork IO take a low value with the number reducing.

I'm sure the parameter is working for it.

For someone who will refer this ticket.

The speed of data transformation will take a very low speed for NetworkIO if you set a low value to this parameter.

so please adjust schedul of jobs.