This worked for me, the snipped below is an example for limiting the diskspace to 5gb   <property>    <name>firehose_time_series_storage_bytes</name>    <value>5368709120</value> </property> ... View more

Hi Wilfred,   Thanks for your response.   I am using a same setup but with standard Spark 1.3. But I am seeing that even though I have set the minimum and maximum shares for a queue (both min and max memory set at 80% of available memory), if there is already a spark job running in a different queue taking 40% memory, it is never preempted! The job in the queue with 80% memeory asking for 70% of memory waits until job in the other queue is finished. It is weird that in the same setup the preemption works for Hadoop mapreduce jobs but not for spark jobs any idea?   Thanks, Vinay ... View more

bulmanp - The private_key parameter should be the contents of the private key file (in your case, the 2nd option should have worked).  Here is the working code I use :   f = open("/root/.ssh/id_rsa", "r") id_rsa = f.read() #print id_rsa f.close() #passwordless certificate login apicommand = cm.host_install(user_name="root", private_key=id_rsa, host_names=hostIds, cm_repo_url=cm_repo_url, java_install_strategy="NONE", unlimited_jce=True).wait()    ... View more