Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

SUT testing on hadoop for all disk reads/writes

Highlighted

SUT testing on hadoop for all disk reads/writes

Expert Contributor

Current CDH5 and RedHat 6.6 and I have dn to a SSD drive but I need to change cloudera to read/write more or not to write any data to memory but to disk. What setting would I change to produce 100% disk reads and writes?

1 REPLY 1

Re: SUT testing on hadoop for all disk reads/writes

New Contributor

I know of two linux options but no idea if this works with cloudera.

 

Try creating a script to test with:

 

-------------------------------- start of script

 

#!/bin/bash

 

echo 1 > /proc/sys/vm/drop_caches

 

or

 

echo 100 > /proc/sys/vm/dirty_expire_centisecs
echo 100 > /proc/sys/vm/dirty_writeback_centisecs

 

-------------------------------- end of script

 

You can test the results if you have run terasort and memory is in use.

 

Try htop watch memory with "alt - f6" pick memory  from htop menu and watch it when you exec the script. Memory will flush and dirty cache will be purged.

 

Thanks for your previous solutions and shutdown techique.