Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created on 05-04-2017 08:33 AM - edited 09-16-2022 04:33 AM
Hi Cloudera Gurus!
I am working with AWS and Lambda functions written in Python working with automatization.
I can add datanodes properly now but, always, after the deploy the configuration for HDFS nd YARN, I need to "refresh the cluster" and I don't know how. I tried the following:
cms.hosts_start_roles(hosts)
if refresh == True:
cms.hosts_start_roles(hosts)
print "Deploying client configuration for HDFS and YARN"
yarn.deploy_client_config()
time.sleep(30)
hdfs.refresh()
time.sleep(30)
print "Refresh HDFS nd YARN"
hdfs.deploy_client_config()
time.sleep(30)
yarn.refresh()
time.sleep(30)
refresh = False
print "Finish"I don't know what I am missing but for HDFS is working all perfectly, but not for YARN. Image attached:
Any ideas what I am missing in my python code?
I am really confused.
Thanks all
Created 05-29-2017 10:24 AM
You might want to try refreshing the ResourceManager (RM) from the UI.
That would be going to CM> YARN> Instances> RM> [Actions]> Refresh RM;
With the API this would be Commands>Refresh see [0] and python [1]
"For YARN services, this command should be executed on ResourceManager roles. It refreshes the role's queue and node information."
Let me know if this works for you.
[1] https://github.com/cloudera/cm_api/blob/master/python/src/cm_api/endpoints/services.py#L824-L831
Created on 05-05-2017 08:16 AM - edited 05-05-2017 08:25 AM
any help here?
Using CDH 5.10.0
Created 05-29-2017 06:11 AM
No ideas about what could be happening here?
REgards
Created 05-29-2017 10:24 AM
You might want to try refreshing the ResourceManager (RM) from the UI.
That would be going to CM> YARN> Instances> RM> [Actions]> Refresh RM;
With the API this would be Commands>Refresh see [0] and python [1]
"For YARN services, this command should be executed on ResourceManager roles. It refreshes the role's queue and node information."
Let me know if this works for you.
[1] https://github.com/cloudera/cm_api/blob/master/python/src/cm_api/endpoints/services.py#L824-L831
Created 06-01-2017 05:52 AM