Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here. Want to know more about what has changed? Check out the Community News blog.

How to limit speed ?

SOLVED Go to solution
Highlighted

How to limit speed ?

Contributor

Hi , 

 

I want to limit speed of data transformation with CDM because other process*(Not bigdata , not CDH) is using same internet resource with it(CDM). and the process* can't be run as no resource. 

 

How can i set it in CHM?

I tried to set 'DataNode Balancing Bandwidth' in HDFS configuration to 1Mb.

But it looks not working.

 

 

1 ACCEPTED SOLUTION

Accepted Solutions

Re: How to limit speed ?

Super Collaborator

Hi @wenjie,

 

Try this:

Maximum Number of Transfer Threads
 
7 REPLIES 7

Re: How to limit speed ?

Super Collaborator

Hi @wenjie,

 

Try this:

Maximum Number of Transfer Threads
 

Re: How to limit speed ?

Contributor
Thanks Fawze.

I will try it and take a feedback.

Re: How to limit speed ?

Contributor

It looks it(Maximum Number of Transfer Threads) is not working.

 

I set it from 4096 to 2048 , but NetworkIO still take a high value.

Re: How to limit speed ?

Super Collaborator

The Network IO at the same level when it was 4096?

Re: How to limit speed ?

Contributor
Yes, I set it from 4096 to 2048.
The Network IO at the same level when it was 4096.

Maybe i need to set less number than 2048?

Re: How to limit speed ?

Super Collaborator
Try to do it very low and then check.

Re: How to limit speed ?

Contributor

Sorry for late reply.

I need to test it after business time.

 

I set it to 2046->1024->512-> 256 and found NetWork IO take a low value with the number reducing.

I'm sure the parameter is working for it.

 

For someone who will refer this ticket.

The speed of data transformation will take a very low speed for NetworkIO if you set a low value to this parameter.

so please adjust schedul of jobs.