Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to limit speed ?

Solved Go to solution

How to limit speed ?

Contributor

Hi , 

 

I want to limit speed of data transformation with CDM because other process*(Not bigdata , not CDH) is using same internet resource with it(CDM). and the process* can't be run as no resource. 

 

How can i set it in CHM?

I tried to set 'DataNode Balancing Bandwidth' in HDFS configuration to 1Mb.

But it looks not working.

 

 

1 ACCEPTED SOLUTION

Accepted Solutions

Re: How to limit speed ?

Super Collaborator

Hi @wenjie,

 

Try this:

Maximum Number of Transfer Threads
 
7 REPLIES 7

Re: How to limit speed ?

Super Collaborator

Hi @wenjie,

 

Try this:

Maximum Number of Transfer Threads
 

Re: How to limit speed ?

Contributor
Thanks Fawze.

I will try it and take a feedback.

Re: How to limit speed ?

Contributor

It looks it(Maximum Number of Transfer Threads) is not working.

 

I set it from 4096 to 2048 , but NetworkIO still take a high value.

Re: How to limit speed ?

Super Collaborator

The Network IO at the same level when it was 4096?

Re: How to limit speed ?

Contributor
Yes, I set it from 4096 to 2048.
The Network IO at the same level when it was 4096.

Maybe i need to set less number than 2048?

Re: How to limit speed ?

Super Collaborator
Try to do it very low and then check.
Highlighted

Re: How to limit speed ?

Contributor

Sorry for late reply.

I need to test it after business time.

 

I set it to 2046->1024->512-> 256 and found NetWork IO take a low value with the number reducing.

I'm sure the parameter is working for it.

 

For someone who will refer this ticket.

The speed of data transformation will take a very low speed for NetworkIO if you set a low value to this parameter.

so please adjust schedul of jobs.