Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

SUT testing on hadoop for all disk reads/writes

Highlighted

SUT testing on hadoop for all disk reads/writes

Expert Contributor

Current CDH5 and RedHat 6.6 and I have dn to a SSD drive but I need to change cloudera to read/write more or not to write any data to memory but to disk. What setting would I change to produce 100% disk reads and writes?

1 REPLY 1

Re: SUT testing on hadoop for all disk reads/writes

New Contributor

I know of two linux options but no idea if this works with cloudera.

 

Try creating a script to test with:

 

-------------------------------- start of script

 

#!/bin/bash

 

echo 1 > /proc/sys/vm/drop_caches

 

or

 

echo 100 > /proc/sys/vm/dirty_expire_centisecs
echo 100 > /proc/sys/vm/dirty_writeback_centisecs

 

-------------------------------- end of script

 

You can test the results if you have run terasort and memory is in use.

 

Try htop watch memory with "alt - f6" pick memory  from htop menu and watch it when you exec the script. Memory will flush and dirty cache will be purged.

 

Thanks for your previous solutions and shutdown techique.

Don't have an account?
Coming from Hortonworks? Activate your account here