Support Questions

Find answers, ask questions, and share your expertise

How to limit speed ?

avatar
Contributor

Hi , 

 

I want to limit speed of data transformation with CDM because other process*(Not bigdata , not CDH) is using same internet resource with it(CDM). and the process* can't be run as no resource. 

 

How can i set it in CHM?

I tried to set 'DataNode Balancing Bandwidth' in HDFS configuration to 1Mb.

But it looks not working.

 

 

1 ACCEPTED SOLUTION

avatar
Master Collaborator

Hi @wenjie,

 

Try this:

Maximum Number of Transfer Threads
 

View solution in original post

7 REPLIES 7

avatar
Master Collaborator

Hi @wenjie,

 

Try this:

Maximum Number of Transfer Threads
 

avatar
Contributor
Thanks Fawze.

I will try it and take a feedback.

avatar
Contributor

It looks it(Maximum Number of Transfer Threads) is not working.

 

I set it from 4096 to 2048 , but NetworkIO still take a high value.

avatar
Master Collaborator

The Network IO at the same level when it was 4096?

avatar
Contributor
Yes, I set it from 4096 to 2048.
The Network IO at the same level when it was 4096.

Maybe i need to set less number than 2048?

avatar
Master Collaborator
Try to do it very low and then check.

avatar
Contributor

Sorry for late reply.

I need to test it after business time.

 

I set it to 2046->1024->512-> 256 and found NetWork IO take a low value with the number reducing.

I'm sure the parameter is working for it.

 

For someone who will refer this ticket.

The speed of data transformation will take a very low speed for NetworkIO if you set a low value to this parameter.

so please adjust schedul of jobs.